nixbot

builds

succeeded vm-test-run-nix-grpc-farm checks.aarch64-linux.farm · build #226 · raw

1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb: QEMU running (pid 49)13lb # Disk image does not exist, creating the virtualisation disk image...14worker2 # Disk image does not exist, creating the virtualisation disk image...15lb # Formatting '/build/vm-state-lb/tmp.EXmkplE79i', fmt=raw size=107374182416worker2: QEMU running (pid 52)17worker2 # Formatting '/build/vm-state-worker2/tmp.Mx6MbhPbGS', fmt=raw size=107374182418worker2 # mke2fs 1.47.4 (6-Mar-2025)19worker1: QEMU running (pid 51)20lb # mke2fs 1.47.4 (6-Mar-2025)21worker1 # Disk image does not exist, creating the virtualisation disk image...22client # Disk image does not exist, creating the virtualisation disk image...23client: QEMU running (pid 50)24worker1 # Formatting '/build/vm-state-worker1/tmp.zYgi2OJf8H', fmt=raw size=107374182425client # Formatting '/build/vm-state-client/tmp.eeJqRF6S7j', fmt=raw size=107374182426lb # Discarding device blocks: 0/262144 done27worker2 # Discarding device blocks: 0/262144 done28worker1 # mke2fs 1.47.4 (6-Mar-2025)29(finished: start all VMs, in 0.84 seconds)30worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes31worker1 # Discarding device blocks: 0/262144 done32client: waiting for unit network-addresses-eth1.service33worker2 # Filesystem UUID: 2e73ab74-40e8-4f65-9aba-7f053dc9560634worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes35client: waiting for the VM to finish booting36worker2 # Superblock backups stored on blocks:37worker1 # Filesystem UUID: c3b4906b-4f0b-40de-ad4a-2b4ad137bdb438lb # Creating filesystem with 262144 4k blocks and 65536 inodes39client # mke2fs 1.47.4 (6-Mar-2025)40worker2 # 32768, 98304, 163840, 22937641worker1 # Superblock backups stored on blocks:42lb # Filesystem UUID: 5c53f899-0f12-423c-bc60-77ca397d49f743client # Discarding device blocks: 0/262144 done44worker2 # 45worker1 # 32768, 98304, 163840, 22937646lb # Superblock backups stored on blocks:47client # Creating filesystem with 262144 4k blocks and 65536 inodes48worker2 # Allocating group tables: 0/8 done49worker1 # 50lb # 32768, 98304, 163840, 22937651client # Filesystem UUID: e46af822-8676-42cf-92d1-abbb401c86ab52worker2 # Writing inode tables: 0/8 done53worker1 # Allocating group tables: 0/8 done54lb # 55client # Superblock backups stored on blocks:56worker2 # Creating journal (8192 blocks): done57worker1 # Writing inode tables: 0/8 done58lb # Allocating group tables: 0/8 done59client # 32768, 98304, 163840, 22937660worker2 # Writing superblocks and filesystem accounting information: 0/8 done61worker1 # Creating journal (8192 blocks): done62lb # Writing inode tables: 0/8 done63client # 64worker2 # 65worker1 # Writing superblocks and filesystem accounting information: 0/8 done66lb # Creating journal (8192 blocks): done67client # Allocating group tables: 0/8 done68worker2 # Virtualisation disk image created.69worker1 # 70lb # Writing superblocks and filesystem accounting information: 0/8 done71worker1 # Virtualisation disk image created.72lb # 73client # Writing inode tables: 0/8 done74lb # Virtualisation disk image created.75client # Creating journal (8192 blocks): done76client # Writing superblocks and filesystem accounting information: 0/8 done77client # 78client # Virtualisation disk image created.79worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681worker2 # [ 0.000000] KASLR enabled82worker2 # [ 0.000000] random: crng init done83worker2 # [ 0.000000] Machine model: linux,dummy-virt84worker2 # [ 0.000000] efi: UEFI not found.85worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88worker2 # [ 0.000000] Zone ranges:89worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90worker2 # [ 0.000000] DMA32 empty91worker2 # [ 0.000000] Normal empty92worker2 # [ 0.000000] Device empty93worker2 # [ 0.000000] Movable zone start for each node94worker2 # [ 0.000000] Early memory node ranges95worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098worker2 # [ 0.000000] psci: probing for conduit method from DT.99worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.100worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101worker2 # [ 0.000000] psci: Trusted OS migration not required102worker2 # [ 0.000000] psci: SMC Calling Convention v1.1103worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105worker2 # [ 0.000000] Detected PIPT I-cache on CPU0106worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface108worker2 # [ 0.000000] CPU features: detected: Spectre-v4109worker2 # [ 0.000000] CPU features: detected: Spectre-BHB110worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112worker2 # [ 0.000000] alternatives: applying boot alternatives113worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ahm6s8h6xkcww2bv7li5wy42bw93n9mc-nixos-system-worker2-test/init regInfo=/nix/store/vbxzsw3sjq7ymr3pha1fqzwrddhzwflp-closure-info/registration console=ttyAMA0,115200n8 console=tty0114lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]115worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/vbxzsw3sjq7ymr3pha1fqzwrddhzwflp-closure-info/registration", will be passed to user space.116lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026117lb # [ 0.000000] KASLR enabled118worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes119lb # [ 0.000000] random: crng init done120lb # [ 0.000000] Machine model: linux,dummy-virt121worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)122worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)123lb # [ 0.000000] efi: UEFI not found.124lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT125worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB126lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]127worker2 # [ 0.000000] software IO TLB: area num 1.128lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]129lb # [ 0.000000] Zone ranges:130worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB131lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]132worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)133lb # [ 0.000000] DMA32 empty134lb # [ 0.000000] Normal empty135worker2 # [ 0.000000] Fallback order for Node 0: 0136lb # [ 0.000000] Device empty137lb # [ 0.000000] Movable zone start for each node138worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216139lb # [ 0.000000] Early memory node ranges140worker2 # [ 0.000000] Policy zone: DMA141lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]142worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off143worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1144lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]145worker2 # [ 0.000000] allocated 3145728 bytes of page_ext146lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000147worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages148lb # [ 0.000000] psci: probing for conduit method from DT.149lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.150worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups151worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.152lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs153worker2 # [ 0.000000] rcu: RCU event tracing is enabled.154lb # [ 0.000000] psci: Trusted OS migration not required155lb # [ 0.000000] psci: SMC Calling Convention v1.1156worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.157worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.158lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)159worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.160worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.161lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296162lb # [ 0.000000] Detected PIPT I-cache on CPU0163worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.164lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)165worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1166lb # [ 0.000000] CPU features: detected: GICv3 CPU interface167lb # [ 0.000000] CPU features: detected: Spectre-v4168worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.169lb # [ 0.000000] CPU features: detected: Spectre-BHB170worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.171lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38172lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23173worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.174lb # [ 0.000000] alternatives: applying boot alternatives175worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0176worker2 # [ 0.000000] GICv3: 256 SPIs implemented177worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented178worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq179worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI180worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0181lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test/init regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration console=ttyAMA0,115200n8 console=tty0182worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000183worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]184worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]185worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)186lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration", will be passed to user space.187worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026188lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes189worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)190worker1 # [ 0.000000] KASLR enabled191worker1 # [ 0.000000] random: crng init done192worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000193lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)194worker1 # [ 0.000000] Machine model: linux,dummy-virt195worker1 # [ 0.000000] efi: UEFI not found.196worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000197lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)198worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT199worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.200lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB201lb # [ 0.000000] software IO TLB: area num 1.202worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]203worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns204lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB205worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]206worker1 # [ 0.000000] Zone ranges:207worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).208lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)209worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]210lb # [ 0.000000] Fallback order for Node 0: 0211worker1 # [ 0.000000] DMA32 empty212worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns213worker1 # [ 0.000000] Normal empty214lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216215worker1 # [ 0.000000] Device empty216lb # [ 0.000000] Policy zone: DMA217worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns218worker1 # [ 0.000000] Movable zone start for each node219worker1 # [ 0.000000] Early memory node ranges220worker2 # [ 0.000050] arm-pv: using stolen time PV221lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off222worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]223lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1224worker2 # [ 0.000878] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)225lb # [ 0.000000] allocated 3145728 bytes of page_ext226worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]227worker2 # [ 0.001092] Console: colour dummy device 80x25228lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages229client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]230worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000231worker2 # [ 0.001102] printk: legacy console [tty0] enabled232lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups233worker1 # [ 0.000000] psci: probing for conduit method from DT.234lb # [ 0.000000] rcu: Hierarchical RCU implementation.235worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.236worker2 # [ 0.001310] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)237client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026238lb # [ 0.000000] rcu: RCU event tracing is enabled.239client # [ 0.000000] KASLR enabled240worker2 # [ 0.001317] pid_max: default: 32768 minimum: 301241worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs242client # [ 0.000000] random: crng init done243lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.244worker1 # [ 0.000000] psci: Trusted OS migration not required245worker2 # [ 0.001403] LSM: initializing lsm=capability,landlock,yama,bpf,ima246client # [ 0.000000] Machine model: linux,dummy-virt247worker1 # [ 0.000000] psci: SMC Calling Convention v1.1248lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.249worker2 # [ 0.001615] landlock: Up and running.250client # [ 0.000000] efi: UEFI not found.251worker2 # [ 0.001618] Yama: becoming mindful.252lb # [ 0.000000] Rude variant of Tasks RCU enabled.253client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT254worker2 # [ 0.002463] LSM support for eBPF active255lb # [ 0.000000] Tracing variant of Tasks RCU enabled.256worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)257worker2 # [ 0.002659] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)258client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]259worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296260lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.261worker1 # [ 0.000000] Detected PIPT I-cache on CPU0262client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]263worker2 # [ 0.002693] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)264client # [ 0.000000] Zone ranges:265lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1266worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)267worker2 # [ 0.003904] cacheinfo: Unable to detect cache hierarchy for CPU 0268client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]269worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface270lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.271client # [ 0.000000] DMA32 empty272worker2 # [ 0.004719] rcu: Hierarchical SRCU implementation.273client # [ 0.000000] Normal empty274worker1 # [ 0.000000] CPU features: detected: Spectre-v4275worker2 # [ 0.004724] rcu: Max phase no-delay instances is 1000.276client # [ 0.000000] Device empty277worker1 # [ 0.000000] CPU features: detected: Spectre-BHB278lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.279client # [ 0.000000] Movable zone start for each node280worker2 # [ 0.006004] fsl-mc MSI: its@8080000 domain created281client # [ 0.000000] Early memory node ranges282worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38283worker2 # [ 0.006099] EFI services will not be available.284lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.285worker2 # [ 0.006178] smp: Bringing up secondary CPUs ...286client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]287worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23288lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0289worker2 # [ 0.006187] smp: Brought up 1 node, 1 CPU290worker1 # [ 0.000000] alternatives: applying boot alternatives291lb # [ 0.000000] GICv3: 256 SPIs implemented292client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]293worker2 # [ 0.006190] SMP: Total of 1 processors activated.294lb # [ 0.000000] GICv3: 0 Extended SPIs implemented295client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000296worker2 # [ 0.006196] CPU: All CPU(s) started at EL1297lb # [ 0.000000] Root IRQ handler: gic_handle_irq298client # [ 0.000000] psci: probing for conduit method from DT.299worker2 # [ 0.006208] CPU features: detected: Branch Target Identification300lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI301client # [ 0.000000] psci: PSCIv1.3 detected in firmware.302worker2 # [ 0.006213] CPU features: detected: ARMv8.4 Translation Table Level303lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0304client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs305client # [ 0.000000] psci: Trusted OS migration not required306lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000307worker2 # [ 0.006216] CPU features: detected: Instruction cache invalidation not required for I/D coherence308lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]309client # [ 0.000000] psci: SMC Calling Convention v1.1310worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/sy9yj3i7c62mz24mqxdkh1ih8mapw4a0-nixos-system-worker1-test/init regInfo=/nix/store/3805d9xfl8jaj50wrikmi307bj04irjb-closure-info/registration console=ttyAMA0,115200n8 console=tty0311worker2 # [ 0.006219] CPU features: detected: Data cache clean to the PoU not required for I/D coherence312client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)313lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)314worker2 # [ 0.006223] CPU features: detected: Common not Private translations315worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/3805d9xfl8jaj50wrikmi307bj04irjb-closure-info/registration", will be passed to user space.316client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296317worker2 # [ 0.006226] CPU features: detected: CRC32 instructions318lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)319client # [ 0.000000] Detected PIPT I-cache on CPU0320worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes321worker2 # [ 0.006229] CPU features: detected: Data cache clean to Point of Deep Persistence322lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000323client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)324worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)325worker2 # [ 0.006233] CPU features: detected: Data cache clean to Point of Persistence326client # [ 0.000000] CPU features: detected: GICv3 CPU interface327lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a30000328client # [ 0.000000] CPU features: detected: Spectre-v4329worker2 # [ 0.006236] CPU features: detected: Data independent timing control (DIT)330worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)331lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.332client # [ 0.000000] CPU features: detected: Spectre-BHB333worker2 # [ 0.006239] CPU features: detected: E0PD334worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB335client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38336lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns337worker1 # [ 0.000000] software IO TLB: area num 1.338worker2 # [ 0.006242] CPU features: detected: Enhanced Counter Virtualization339client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23340lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).341worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB342worker2 # [ 0.006245] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)343client # [ 0.000000] alternatives: applying boot alternatives344worker2 # [ 0.006248] CPU features: detected: Enhanced Virtualization Traps345worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)346lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns347worker2 # [ 0.006252] CPU features: detected: Fine Grained Traps348worker1 # [ 0.000000] Fallback order for Node 0: 0349lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns350worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216351worker2 # [ 0.006256] CPU features: detected: Generic authentication (architected QARMA5 algorithm)352worker1 # [ 0.000000] Policy zone: DMA353lb # [ 0.000039] arm-pv: using stolen time PV354worker2 # [ 0.006261] CPU features: detected: RCpc load-acquire (LDAPR)355worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off356worker2 # [ 0.006264] CPU features: detected: LSE atomic instructions357lb # [ 0.000867] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)358client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zq7rayhbzisnan6cyg9zvazlkxxaccwa-nixos-system-client-test/init regInfo=/nix/store/d16z981kk4sh30bjkhkww9shzwz7llw7-closure-info/registration console=ttyAMA0,115200n8 console=tty0359worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1360worker2 # [ 0.006267] CPU features: detected: Privileged Access Never361lb # [ 0.001070] Console: colour dummy device 80x25362worker1 # [ 0.000000] allocated 3145728 bytes of page_ext363worker2 # [ 0.006270] CPU features: detected: PMUv3364lb # [ 0.001079] printk: legacy console [tty0] enabled365worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages366worker2 # [ 0.006272] CPU features: detected: RAS Extension Support367client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/d16z981kk4sh30bjkhkww9shzwz7llw7-closure-info/registration", will be passed to user space.368worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups369lb # [ 0.001281] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)370worker2 # [ 0.006275] CPU features: detected: RASv1p1 Extension Support371worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.372worker2 # [ 0.006278] CPU features: detected: Random Number Generator373lb # [ 0.001289] pid_max: default: 32768 minimum: 301374client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes375worker1 # [ 0.000000] rcu: RCU event tracing is enabled.376worker2 # [ 0.006281] CPU features: detected: Speculation barrier (SB)377lb # [ 0.001373] LSM: initializing lsm=capability,landlock,yama,bpf,ima378client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)379worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.380lb # [ 0.001585] landlock: Up and running.381worker2 # [ 0.006284] CPU features: detected: Stage-2 Force Write-Back382lb # [ 0.001589] Yama: becoming mindful.383worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.384client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)385lb # [ 0.002279] LSM support for eBPF active386worker2 # [ 0.006286] CPU features: detected: TLB range maintenance instructions387worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.388client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB389worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.390lb # [ 0.002429] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)391worker2 # [ 0.006292] CPU features: detected: Speculative Store Bypassing Safe (SSBS)392client # [ 0.000000] software IO TLB: area num 1.393worker2 # [ 0.006337] alternatives: applying system-wide alternatives394worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.395lb # [ 0.002492] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)396client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB397worker2 # [ 0.009798] CPU features: detected: BBM Level 2 without TLB conflict abort398worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1399lb # [ 0.003753] cacheinfo: Unable to detect cache hierarchy for CPU 0400client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)401lb # [ 0.004561] rcu: Hierarchical SRCU implementation.402client # [ 0.000000] Fallback order for Node 0: 0403worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.404lb # [ 0.004566] rcu: Max phase no-delay instances is 1000.405worker2 # [ 0.010047] Memory: 1406508K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)406client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216407lb # [ 0.005849] fsl-mc MSI: its@8080000 domain created408client # [ 0.000000] Policy zone: DMA409worker2 # [ 0.010504] devtmpfs: initialized410worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.411lb # [ 0.005954] EFI services will not be available.412client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off413worker2 # [ 0.012525] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)414lb # [ 0.006040] smp: Bringing up secondary CPUs ...415worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.416lb # [ 0.006050] smp: Brought up 1 node, 1 CPU417client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1418worker2 # [ 0.012548] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).419worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0420lb # [ 0.006054] SMP: Total of 1 processors activated.421client # [ 0.000000] allocated 3145728 bytes of page_ext422worker1 # [ 0.000000] GICv3: 256 SPIs implemented423lb # [ 0.006059] CPU: All CPU(s) started at EL1424worker2 # [ 0.012743] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL425client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages426worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented427lb # [ 0.006072] CPU features: detected: Branch Target Identification428worker2 # [ 0.012748] 0 pages in range for non-PLT usage429client # [ 0.000000] ftrace: allocated 294 pages with 4 groups430worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq431worker2 # [ 0.012749] 508288 pages in range for PLT usage432client # [ 0.000000] rcu: Hierarchical RCU implementation.433lb # [ 0.006077] CPU features: detected: ARMv8.4 Translation Table Level434worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI435worker2 # [ 0.012869] pinctrl core: initialized pinctrl subsystem436client # [ 0.000000] rcu: RCU event tracing is enabled.437worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0438worker2 # [ 0.013758] DMI not present or invalid.439lb # [ 0.006080] CPU features: detected: Instruction cache invalidation not required for I/D coherence440client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.441worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000442worker2 # [ 0.017917] NET: Registered PF_NETLINK/PF_ROUTE protocol family443client # [ 0.000000] Trampoline variant of Tasks RCU enabled.444worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]445lb # [ 0.006084] CPU features: detected: Data cache clean to the PoU not required for I/D coherence446worker2 # [ 0.020218] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations447client # [ 0.000000] Rude variant of Tasks RCU enabled.448lb # [ 0.006087] CPU features: detected: Common not Private translations449client # [ 0.000000] Tracing variant of Tasks RCU enabled.450worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)451worker2 # [ 0.020420] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations452lb # [ 0.006091] CPU features: detected: CRC32 instructions453client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.454worker2 # [ 0.020636] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations455lb # [ 0.006094] CPU features: detected: Data cache clean to Point of Deep Persistence456client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1457worker2 # [ 0.020667] audit: initializing netlink subsys (disabled)458lb # [ 0.006097] CPU features: detected: Data cache clean to Point of Persistence459worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)460client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.461worker2 # [ 0.021339] thermal_sys: Registered thermal governor 'fair_share'462lb # [ 0.006101] CPU features: detected: Data independent timing control (DIT)463worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000464lb # [ 0.006104] CPU features: detected: E0PD465worker2 # [ 0.021342] thermal_sys: Registered thermal governor 'bang_bang'466worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000467client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.468lb # [ 0.006106] CPU features: detected: Enhanced Counter Virtualization469worker2 # [ 0.021346] thermal_sys: Registered thermal governor 'step_wise'470worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.471client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.472worker2 # [ 0.021351] thermal_sys: Registered thermal governor 'user_space'473lb # [ 0.006110] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)474client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0475lb # [ 0.006113] CPU features: detected: Enhanced Virtualization Traps476worker2 # [ 0.021354] thermal_sys: Registered thermal governor 'power_allocator'477worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns478client # [ 0.000000] GICv3: 256 SPIs implemented479lb # [ 0.006116] CPU features: detected: Fine Grained Traps480worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).481client # [ 0.000000] GICv3: 0 Extended SPIs implemented482worker2 # [ 0.021380] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1483client # [ 0.000000] Root IRQ handler: gic_handle_irq484worker2 # [ 0.021390] cpuidle: using governor ladder485lb # [ 0.006119] CPU features: detected: Generic authentication (architected QARMA5 algorithm)486worker2 # [ 0.021396] cpuidle: using governor menu487client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI488worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns489lb # [ 0.006124] CPU features: detected: RCpc load-acquire (LDAPR)490client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0491lb # [ 0.006127] CPU features: detected: LSE atomic instructions492worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns493worker2 # [ 0.021638] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.494client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000495worker2 # [ 0.021657] ASID allocator initialised with 65536 entries496lb # [ 0.006131] CPU features: detected: Privileged Access Never497worker1 # [ 0.000041] arm-pv: using stolen time PV498client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]499worker2 # [ 0.022973] Serial: AMBA PL011 UART driver500lb # [ 0.006134] CPU features: detected: PMUv3501worker1 # [ 0.000563] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)502lb # [ 0.006136] CPU features: detected: RAS Extension Support503client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)504worker2 # [ 0.028486] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1505worker1 # [ 0.000761] Console: colour dummy device 80x25506worker2 # [ 0.028663] printk: console [ttyAMA0] enabled507lb # [ 0.006139] CPU features: detected: RASv1p1 Extension Support508worker1 # [ 0.000769] printk: legacy console [tty0] enabled509lb # [ 0.006141] CPU features: detected: Random Number Generator510client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)511lb # [ 0.006144] CPU features: detected: Speculation barrier (SB)512client # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000513worker1 # [ 0.000972] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)514lb # [ 0.006147] CPU features: detected: Stage-2 Force Write-Back515client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000516worker1 # [ 0.000980] pid_max: default: 32768 minimum: 301517lb # [ 0.006150] CPU features: detected: TLB range maintenance instructions518worker1 # [ 0.001063] LSM: initializing lsm=capability,landlock,yama,bpf,ima519client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.520worker1 # [ 0.001211] landlock: Up and running.521lb # [ 0.006155] CPU features: detected: Speculative Store Bypassing Safe (SSBS)522worker1 # [ 0.001214] Yama: becoming mindful.523lb # [ 0.006197] alternatives: applying system-wide alternatives524client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns525worker1 # [ 0.001790] LSM support for eBPF active526client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).527lb # [ 0.009482] CPU features: detected: BBM Level 2 without TLB conflict abort528worker1 # [ 0.001943] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)529worker1 # [ 0.001977] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)530client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns531lb # [ 0.009666] Memory: 1406504K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)532worker1 # [ 0.003161] cacheinfo: Unable to detect cache hierarchy for CPU 0533lb # [ 0.010136] devtmpfs: initialized534client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns535worker1 # [ 0.004052] rcu: Hierarchical SRCU implementation.536client # [ 0.000057] arm-pv: using stolen time PV537lb # [ 0.012056] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)538worker1 # [ 0.004057] rcu: Max phase no-delay instances is 1000.539worker1 # [ 0.005361] fsl-mc MSI: its@8080000 domain created540client # [ 0.000508] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)541worker1 # [ 0.005454] EFI services will not be available.542worker2 # [ 0.151414] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages543client # [ 0.000743] Console: colour dummy device 80x25544worker1 # [ 0.005551] smp: Bringing up secondary CPUs ...545lb # [ 0.012083] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).546client # [ 0.000751] printk: legacy console [tty0] enabled547worker1 # [ 0.005562] smp: Brought up 1 node, 1 CPU548worker2 # [ 0.151435] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page549lb # [ 0.012275] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL550worker1 # [ 0.005565] SMP: Total of 1 processors activated.551lb # [ 0.012280] 0 pages in range for non-PLT usage552worker2 # [ 0.151440] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages553worker1 # [ 0.005571] CPU: All CPU(s) started at EL1554client # [ 0.000946] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)555lb # [ 0.012282] 508288 pages in range for PLT usage556client # [ 0.000953] pid_max: default: 32768 minimum: 301557worker2 # [ 0.151445] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page558worker1 # [ 0.005582] CPU features: detected: Branch Target Identification559lb # [ 0.012423] pinctrl core: initialized pinctrl subsystem560client # [ 0.001050] LSM: initializing lsm=capability,landlock,yama,bpf,ima561worker2 # [ 0.151450] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages562lb # [ 0.013242] DMI not present or invalid.563worker1 # [ 0.005588] CPU features: detected: ARMv8.4 Translation Table Level564client # [ 0.001205] landlock: Up and running.565lb # [ 0.017217] NET: Registered PF_NETLINK/PF_ROUTE protocol family566client # [ 0.001208] Yama: becoming mindful.567worker2 # [ 0.151454] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page568worker1 # [ 0.005591] CPU features: detected: Instruction cache invalidation not required for I/D coherence569client # [ 0.001734] LSM support for eBPF active570worker2 # [ 0.151458] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages571lb # [ 0.019599] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations572client # [ 0.001911] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)573worker1 # [ 0.005594] CPU features: detected: Data cache clean to the PoU not required for I/D coherence574worker2 # [ 0.151462] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page575lb # [ 0.019806] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations576worker1 # [ 0.005598] CPU features: detected: Common not Private translations577client # [ 0.001945] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)578lb # [ 0.020029] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations579worker1 # [ 0.005602] CPU features: detected: CRC32 instructions580client # [ 0.003096] cacheinfo: Unable to detect cache hierarchy for CPU 0581lb # [ 0.020060] audit: initializing netlink subsys (disabled)582client # [ 0.003828] rcu: Hierarchical SRCU implementation.583worker1 # [ 0.005604] CPU features: detected: Data cache clean to Point of Deep Persistence584worker2 # [ 0.158903] fbcon: Taking over console585lb # [ 0.020681] thermal_sys: Registered thermal governor 'fair_share'586client # [ 0.003833] rcu: Max phase no-delay instances is 1000.587worker2 # [ 0.158922] ACPI: Interpreter disabled.588worker1 # [ 0.005608] CPU features: detected: Data cache clean to Point of Persistence589client # [ 0.005117] fsl-mc MSI: its@8080000 domain created590lb # [ 0.020684] thermal_sys: Registered thermal governor 'bang_bang'591client # [ 0.005215] EFI services will not be available.592worker1 # [ 0.005611] CPU features: detected: Data independent timing control (DIT)593lb # [ 0.020688] thermal_sys: Registered thermal governor 'step_wise'594worker2 # [ 0.160853] iommu: Default domain type: Translated595worker1 # [ 0.005614] CPU features: detected: E0PD596worker2 # [ 0.160865] iommu: DMA domain TLB invalidation policy: strict mode597client # [ 0.005285] smp: Bringing up secondary CPUs ...598lb # [ 0.020694] thermal_sys: Registered thermal governor 'user_space'599client # [ 0.005294] smp: Brought up 1 node, 1 CPU600worker1 # [ 0.005616] CPU features: detected: Enhanced Counter Virtualization601client # [ 0.005298] SMP: Total of 1 processors activated.602lb # [ 0.020696] thermal_sys: Registered thermal governor 'power_allocator'603client # [ 0.005303] CPU: All CPU(s) started at EL1604worker1 # [ 0.005619] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)605lb # [ 0.020730] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1606client # [ 0.005315] CPU features: detected: Branch Target Identification607worker1 # [ 0.005623] CPU features: detected: Enhanced Virtualization Traps608lb # [ 0.020739] cpuidle: using governor ladder609worker1 # [ 0.005626] CPU features: detected: Fine Grained Traps610client # [ 0.005320] CPU features: detected: ARMv8.4 Translation Table Level611lb # [ 0.020745] cpuidle: using governor menu612worker1 # [ 0.005629] CPU features: detected: Generic authentication (architected QARMA5 algorithm)613lb # [ 0.020949] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.614client # [ 0.005323] CPU features: detected: Instruction cache invalidation not required for I/D coherence615lb # [ 0.020966] ASID allocator initialised with 65536 entries616worker1 # [ 0.005635] CPU features: detected: RCpc load-acquire (LDAPR)617lb # [ 0.022328] Serial: AMBA PL011 UART driver618client # [ 0.005326] CPU features: detected: Data cache clean to the PoU not required for I/D coherence619worker1 # [ 0.005638] CPU features: detected: LSE atomic instructions620client # [ 0.005330] CPU features: detected: Common not Private translations621worker1 # [ 0.005641] CPU features: detected: Privileged Access Never622lb # [ 0.028079] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1623client # [ 0.005333] CPU features: detected: CRC32 instructions624worker1 # [ 0.005643] CPU features: detected: PMUv3625lb # [ 0.028258] printk: console [ttyAMA0] enabled626worker2 # [ 0.167974] SCSI subsystem initialized627worker1 # [ 0.005646] CPU features: detected: RAS Extension Support628client # [ 0.005336] CPU features: detected: Data cache clean to Point of Deep Persistence629worker1 # [ 0.005649] CPU features: detected: RASv1p1 Extension Support630worker2 # [ 0.168717] usbcore: registered new interface driver usbfs631client # [ 0.005340] CPU features: detected: Data cache clean to Point of Persistence632worker1 # [ 0.005652] CPU features: detected: Random Number Generator633worker2 # [ 0.168767] usbcore: registered new interface driver hub634client # [ 0.005343] CPU features: detected: Data independent timing control (DIT)635worker1 # [ 0.005654] CPU features: detected: Speculation barrier (SB)636worker2 # [ 0.168788] usbcore: registered new device driver usb637client # [ 0.005346] CPU features: detected: E0PD638worker1 # [ 0.005657] CPU features: detected: Stage-2 Force Write-Back639worker2 # [ 0.169104] pps_core: LinuxPPS API ver. 1 registered640client # [ 0.005348] CPU features: detected: Enhanced Counter Virtualization641worker1 # [ 0.005660] CPU features: detected: TLB range maintenance instructions642worker2 # [ 0.169110] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>643client # [ 0.005351] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)644worker2 # [ 0.169121] PTP clock support registered645worker1 # [ 0.005665] CPU features: detected: Speculative Store Bypassing Safe (SSBS)646client # [ 0.005354] CPU features: detected: Enhanced Virtualization Traps647worker2 # [ 0.169173] EDAC MC: Ver: 3.0.0648worker1 # [ 0.005704] alternatives: applying system-wide alternatives649client # [ 0.005357] CPU features: detected: Fine Grained Traps650worker2 # [ 0.173751] scmi_core: SCMI protocol bus registered651worker1 # [ 0.008953] CPU features: detected: BBM Level 2 without TLB conflict abort652client # [ 0.005361] CPU features: detected: Generic authentication (architected QARMA5 algorithm)653worker2 # [ 0.174728] FPGA manager framework654client # [ 0.005366] CPU features: detected: RCpc load-acquire (LDAPR)655worker2 # [ 0.175689] vgaarb: loaded656worker1 # [ 0.009202] Memory: 1406504K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)657client # [ 0.005369] CPU features: detected: LSE atomic instructions658worker1 # [ 0.009665] devtmpfs: initialized659client # [ 0.005372] CPU features: detected: Privileged Access Never660worker2 # [ 0.176391] clocksource: Switched to clocksource arch_sys_counter661client # [ 0.005374] CPU features: detected: PMUv3662worker1 # [ 0.011694] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)663lb # [ 0.149861] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages664client # [ 0.005377] CPU features: detected: RAS Extension Support665worker1 # [ 0.011726] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).666lb # [ 0.149882] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page667client # [ 0.005380] CPU features: detected: RASv1p1 Extension Support668worker1 # [ 0.011929] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL669client # [ 0.005382] CPU features: detected: Random Number Generator670lb # [ 0.149887] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages671worker1 # [ 0.011933] 0 pages in range for non-PLT usage672worker2 # [ 0.179615] VFS: Disk quotas dquot_6.6.0673client # [ 0.005385] CPU features: detected: Speculation barrier (SB)674lb # [ 0.149892] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page675worker1 # [ 0.011934] 508288 pages in range for PLT usage676client # [ 0.005388] CPU features: detected: Stage-2 Force Write-Back677worker1 # [ 0.012068] pinctrl core: initialized pinctrl subsystem678worker2 # [ 0.179656] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)679lb # [ 0.149896] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages680worker1 # [ 0.012927] DMI not present or invalid.681client # [ 0.005391] CPU features: detected: TLB range maintenance instructions682lb # [ 0.149901] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page683worker1 # [ 0.016600] NET: Registered PF_NETLINK/PF_ROUTE protocol family684client # [ 0.005395] CPU features: detected: Speculative Store Bypassing Safe (SSBS)685lb # [ 0.149905] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages686worker1 # [ 0.018992] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations687client # [ 0.005436] alternatives: applying system-wide alternatives688lb # [ 0.149909] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page689client # [ 0.008637] CPU features: detected: BBM Level 2 without TLB conflict abort690worker1 # [ 0.019186] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations691worker2 # [ 0.183587] netfs: FS-Cache loaded692worker2 # [ 0.183734] pnp: PnP ACPI: disabled693worker1 # [ 0.019415] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations694worker1 # [ 0.019445] audit: initializing netlink subsys (disabled)695client # [ 0.008798] Memory: 1406768K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)696lb # [ 0.157398] fbcon: Taking over console697client # [ 0.009246] devtmpfs: initialized698lb # [ 0.157418] ACPI: Interpreter disabled.699worker1 # [ 0.020112] thermal_sys: Registered thermal governor 'fair_share'700client # [ 0.011203] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)701worker1 # [ 0.020114] thermal_sys: Registered thermal governor 'bang_bang'702worker1 # [ 0.020118] thermal_sys: Registered thermal governor 'step_wise'703client # [ 0.011233] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).704worker1 # [ 0.020125] thermal_sys: Registered thermal governor 'user_space'705client # [ 0.011434] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL706worker2 # [ 0.187855] NET: Registered PF_INET protocol family707client # [ 0.011439] 0 pages in range for non-PLT usage708worker1 # [ 0.020128] thermal_sys: Registered thermal governor 'power_allocator'709client # [ 0.011440] 508288 pages in range for PLT usage710worker2 # [ 0.188136] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)711worker1 # [ 0.020161] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1712client # [ 0.011560] pinctrl core: initialized pinctrl subsystem713worker1 # [ 0.020171] cpuidle: using governor ladder714client # [ 0.012390] DMI not present or invalid.715worker1 # [ 0.020177] cpuidle: using governor menu716client # [ 0.015737] NET: Registered PF_NETLINK/PF_ROUTE protocol family717worker1 # [ 0.020406] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.718client # [ 0.018164] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations719worker1 # [ 0.020424] ASID allocator initialised with 65536 entries720worker1 # [ 0.021700] Serial: AMBA PL011 UART driver721client # [ 0.018386] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations722worker1 # [ 0.027106] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1723client # [ 0.018601] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations724lb # [ 0.166091] iommu: Default domain type: Translated725worker1 # [ 0.027262] printk: console [ttyAMA0] enabled726client # [ 0.018633] audit: initializing netlink subsys (disabled)727lb # [ 0.166105] iommu: DMA domain TLB invalidation policy: strict mode728lb # [ 0.166548] SCSI subsystem initialized729client # [ 0.019247] thermal_sys: Registered thermal governor 'fair_share'730client # [ 0.019249] thermal_sys: Registered thermal governor 'bang_bang'731lb # [ 0.168633] usbcore: registered new interface driver usbfs732client # [ 0.019253] thermal_sys: Registered thermal governor 'step_wise'733lb # [ 0.168684] usbcore: registered new interface driver hub734client # [ 0.019259] thermal_sys: Registered thermal governor 'user_space'735lb # [ 0.168704] usbcore: registered new device driver usb736client # [ 0.019261] thermal_sys: Registered thermal governor 'power_allocator'737lb # [ 0.168999] pps_core: LinuxPPS API ver. 1 registered738client # [ 0.019288] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1739lb # [ 0.169006] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>740client # [ 0.019297] cpuidle: using governor ladder741lb # [ 0.169026] PTP clock support registered742client # [ 0.019303] cpuidle: using governor menu743lb # [ 0.169087] EDAC MC: Ver: 3.0.0744client # [ 0.019499] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.745lb # [ 0.173795] scmi_core: SCMI protocol bus registered746client # [ 0.019517] ASID allocator initialised with 65536 entries747client # [ 0.020781] Serial: AMBA PL011 UART driver748lb # [ 0.174819] FPGA manager framework749lb # [ 0.175811] vgaarb: loaded750client # [ 0.026454] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1751worker1 # [ 0.148581] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages752client # [ 0.026619] printk: console [ttyAMA0] enabled753lb # [ 0.176478] clocksource: Switched to clocksource arch_sys_counter754worker1 # [ 0.148604] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page755worker1 # [ 0.148610] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages756worker1 # [ 0.148615] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page757worker1 # [ 0.148619] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages758worker1 # [ 0.148623] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page759worker1 # [ 0.148628] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages760lb # [ 0.180896] VFS: Disk quotas dquot_6.6.0761worker1 # [ 0.148632] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page762lb # [ 0.180957] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)763lb # [ 0.182693] netfs: FS-Cache loaded764lb # [ 0.182810] pnp: PnP ACPI: disabled765worker1 # [ 0.156298] fbcon: Taking over console766worker1 # [ 0.156317] ACPI: Interpreter disabled.767worker1 # [ 0.158241] iommu: Default domain type: Translated768client # [ 0.147015] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages769worker1 # [ 0.158251] iommu: DMA domain TLB invalidation policy: strict mode770client # [ 0.147040] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page771worker1 # [ 0.160007] SCSI subsystem initialized772client # [ 0.147045] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages773worker1 # [ 0.160713] usbcore: registered new interface driver usbfs774client # [ 0.147049] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page775lb # [ 0.186890] NET: Registered PF_INET protocol family776worker1 # [ 0.160748] usbcore: registered new interface driver hub777client # [ 0.147054] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages778worker1 # [ 0.160766] usbcore: registered new device driver usb779lb # [ 0.187170] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)780client # [ 0.147058] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page781worker1 # [ 0.162945] pps_core: LinuxPPS API ver. 1 registered782client # [ 0.147062] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages783worker1 # [ 0.162956] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>784client # [ 0.147067] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page785worker1 # [ 0.162966] PTP clock support registered786worker1 # [ 0.163021] EDAC MC: Ver: 3.0.0787client # [ 0.154643] fbcon: Taking over console788client # [ 0.154661] ACPI: Interpreter disabled.789worker1 # [ 0.173544] scmi_core: SCMI protocol bus registered790worker2 # [ 0.219446] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)791worker1 # [ 0.174623] FPGA manager framework792client # [ 0.163255] iommu: Default domain type: Translated793worker1 # [ 0.175695] vgaarb: loaded794worker2 # [ 0.219507] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)795client # [ 0.163269] iommu: DMA domain TLB invalidation policy: strict mode796client # [ 0.163719] SCSI subsystem initialized797worker1 # [ 0.176385] clocksource: Switched to clocksource arch_sys_counter798worker2 # [ 0.219543] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)799worker2 # [ 0.219631] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)800client # [ 0.165729] usbcore: registered new interface driver usbfs801worker1 # [ 0.178099] VFS: Disk quotas dquot_6.6.0802worker2 # [ 0.219775] TCP: Hash tables configured (established 16384 bind 16384)803client # [ 0.165777] usbcore: registered new interface driver hub804worker1 # [ 0.178137] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)805client # [ 0.165796] usbcore: registered new device driver usb806worker2 # [ 0.219874] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)807client # [ 0.166109] pps_core: LinuxPPS API ver. 1 registered808worker2 # [ 0.219917] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)809client # [ 0.166115] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>810worker2 # [ 0.219955] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)811client # [ 0.166125] PTP clock support registered812worker2 # [ 0.220068] NET: Registered PF_UNIX/PF_LOCAL protocol family813client # [ 0.166175] EDAC MC: Ver: 3.0.0814worker1 # [ 0.181969] netfs: FS-Cache loaded815worker2 # [ 0.220093] NET: Registered PF_XDP protocol family816worker1 # [ 0.182109] pnp: PnP ACPI: disabled817client # [ 0.170785] scmi_core: SCMI protocol bus registered818worker2 # [ 0.220112] PCI: CLS 0 bytes, default 64819worker2 # [ 0.220427] Trying to unpack rootfs image as initramfs...820client # [ 0.171790] FPGA manager framework821client # [ 0.172877] vgaarb: loaded822client # [ 0.173547] clocksource: Switched to clocksource arch_sys_counter823client # [ 0.176605] VFS: Disk quotas dquot_6.6.0824worker1 # [ 0.186208] NET: Registered PF_INET protocol family825client # [ 0.176647] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)826worker1 # [ 0.186486] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)827worker2 # [ 0.238124] kvm [1]: HYP mode not available828client # [ 0.180638] netfs: FS-Cache loaded829client # [ 0.180774] pnp: PnP ACPI: disabled830client # [ 0.184986] NET: Registered PF_INET protocol family831client # [ 0.185264] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)832lb # [ 0.218673] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833lb # [ 0.218737] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834lb # [ 0.218778] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835lb # [ 0.218874] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)836lb # [ 0.219020] TCP: Hash tables configured (established 16384 bind 16384)837lb # [ 0.219125] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)838lb # [ 0.219167] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)839lb # [ 0.219205] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)840lb # [ 0.219339] NET: Registered PF_UNIX/PF_LOCAL protocol family841lb # [ 0.219382] NET: Registered PF_XDP protocol family842lb # [ 0.219403] PCI: CLS 0 bytes, default 64843lb # [ 0.219681] Trying to unpack rootfs image as initramfs...844lb # [ 0.234281] kvm [1]: HYP mode not available845worker1 # [ 0.219041] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)846client # [ 0.217302] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)847worker1 # [ 0.219110] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)848client # [ 0.217365] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)849worker1 # [ 0.219148] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)850client # [ 0.217400] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)851worker1 # [ 0.219249] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)852client # [ 0.217497] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)853worker1 # [ 0.219393] TCP: Hash tables configured (established 16384 bind 16384)854worker1 # [ 0.219556] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)855worker1 # [ 0.219611] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)856worker1 # [ 0.219649] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)857worker1 # [ 0.219748] NET: Registered PF_UNIX/PF_LOCAL protocol family858worker1 # [ 0.219784] NET: Registered PF_XDP protocol family859worker1 # [ 0.219807] PCI: CLS 0 bytes, default 64860worker1 # [ 0.220079] Trying to unpack rootfs image as initramfs...861client # [ 0.221727] TCP: Hash tables configured (established 16384 bind 16384)862client # [ 0.221832] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)863client # [ 0.221880] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)864client # [ 0.221919] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)865worker1 # [ 0.238370] kvm [1]: HYP mode not available866client # [ 0.222015] NET: Registered PF_UNIX/PF_LOCAL protocol family867client # [ 0.222044] NET: Registered PF_XDP protocol family868client # [ 0.222065] PCI: CLS 0 bytes, default 64869client # [ 0.222329] Trying to unpack rootfs image as initramfs...870client # [ 0.235510] kvm [1]: HYP mode not available871worker2 # [ 0.416521] Initialise system trusted keyrings872worker2 # [ 0.417312] workingset: timestamp_bits=42 max_order=19 bucket_order=0873worker2 # [ 0.418637] squashfs: version 4.0 (2009/01/31) Phillip Lougher874worker2 # [ 0.419414] 9p: Installing v9fs 9p2000 file system support875worker2 # [ 0.440194] Key type asymmetric registered876worker2 # [ 0.440223] Asymmetric key parser 'x509' registered877worker2 # [ 0.440307] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)878worker2 # [ 0.448494] io scheduler mq-deadline registered879lb # [ 0.421752] Initialise system trusted keyrings880worker2 # [ 0.448522] io scheduler kyber registered881lb # [ 0.422572] workingset: timestamp_bits=42 max_order=19 bucket_order=0882lb # [ 0.423890] squashfs: version 4.0 (2009/01/31) Phillip Lougher883lb # [ 0.424891] 9p: Installing v9fs 9p2000 file system support884worker2 # [ 0.460585] pl061_gpio 9030000.pl061: PL061 GPIO chip registered885worker2 # [ 0.461304] ledtrig-cpu: registered to indicate activity on CPUs886worker2 # [ 0.461757] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:887worker2 # [ 0.461776] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000888worker2 # [ 0.461790] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000889lb # [ 0.445058] Key type asymmetric registered890lb # [ 0.445093] Asymmetric key parser 'x509' registered891worker2 # [ 0.461798] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000892lb # [ 0.445182] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)893worker2 # [ 0.461829] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits894worker2 # [ 0.461858] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]895worker2 # [ 0.461950] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00896worker2 # [ 0.461960] pci_bus 0000:00: root bus resource [bus 00-ff]897worker2 # [ 0.461967] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]898worker2 # [ 0.461973] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]899worker1 # [ 0.425056] Initialise system trusted keyrings900worker2 # [ 0.461978] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]901lb # [ 0.452544] io scheduler mq-deadline registered902lb # [ 0.452570] io scheduler kyber registered903worker1 # [ 0.425874] workingset: timestamp_bits=42 max_order=19 bucket_order=0904worker2 # [ 0.462122] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint905worker2 # [ 0.462569] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint906worker1 # [ 0.427219] squashfs: version 4.0 (2009/01/31) Phillip Lougher907worker2 # [ 0.462757] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]908worker1 # [ 0.428059] 9p: Installing v9fs 9p2000 file system support909worker2 # [ 0.462774] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]910worker2 # [ 0.462803] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]911worker2 # [ 0.462819] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]912worker2 # [ 0.463282] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint913worker2 # [ 0.463466] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]914worker2 # [ 0.463481] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]915worker2 # [ 0.463513] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]916client # [ 0.422239] Initialise system trusted keyrings917worker2 # [ 0.463963] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint918client # [ 0.423037] workingset: timestamp_bits=42 max_order=19 bucket_order=0919worker2 # [ 0.464149] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]920worker2 # [ 0.464165] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]921client # [ 0.424418] squashfs: version 4.0 (2009/01/31) Phillip Lougher922worker2 # [ 0.464195] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]923client # [ 0.425213] 9p: Installing v9fs 9p2000 file system support924worker2 # [ 0.464685] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint925worker2 # [ 0.464872] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]926lb # [ 0.464697] pl061_gpio 9030000.pl061: PL061 GPIO chip registered927worker2 # [ 0.464888] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]928worker2 # [ 0.464922] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]929worker2 # [ 0.465381] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint930worker2 # [ 0.465571] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]931lb # [ 0.466266] ledtrig-cpu: registered to indicate activity on CPUs932worker2 # [ 0.465620] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]933lb # [ 0.466767] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:934worker2 # [ 0.465650] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]935lb # [ 0.466787] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000936worker2 # [ 0.466112] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint937worker2 # [ 0.466296] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]938lb # [ 0.466800] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000939worker2 # [ 0.466311] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]940lb # [ 0.466809] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000941worker2 # [ 0.466340] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]942lb # [ 0.466837] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits943worker2 # [ 0.466790] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint944worker2 # [ 0.466971] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]945lb # [ 0.466879] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]946worker2 # [ 0.466986] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]947lb # [ 0.466962] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00948worker2 # [ 0.467015] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]949lb # [ 0.466973] pci_bus 0000:00: root bus resource [bus 00-ff]950worker2 # [ 0.467032] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]951lb # [ 0.466980] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]952lb # [ 0.466986] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]953worker2 # [ 0.467516] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint954worker2 # [ 0.467701] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]955lb # [ 0.466991] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]956worker2 # [ 0.467730] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]957lb # [ 0.467092] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint958worker2 # [ 0.468173] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint959lb # [ 0.467535] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint960worker2 # [ 0.468356] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]961lb # [ 0.467721] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]962lb # [ 0.467738] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]963worker2 # [ 0.468385] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]964lb # [ 0.467768] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]965lb # [ 0.467804] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]966worker1 # [ 0.456914] Key type asymmetric registered967worker1 # [ 0.456946] Asymmetric key parser 'x509' registered968lb # [ 0.468319] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint969worker1 # [ 0.457044] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)970worker1 # [ 0.459226] io scheduler mq-deadline registered971worker1 # [ 0.459241] io scheduler kyber registered972lb # [ 0.485486] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]973lb # [ 0.485510] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]974lb # [ 0.485539] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]975lb # [ 0.486041] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint976lb # [ 0.486223] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]977lb # [ 0.486239] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]978client # [ 0.454142] Key type asymmetric registered979lb # [ 0.486268] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]980client # [ 0.454174] Asymmetric key parser 'x509' registered981worker2 # [ 0.516975] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint982client # [ 0.454262] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)983lb # [ 0.486752] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint984worker2 # [ 0.517199] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]985lb # [ 0.486936] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]986client # [ 0.456398] io scheduler mq-deadline registered987worker2 # [ 0.517464] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint988client # [ 0.456412] io scheduler kyber registered989lb # [ 0.486951] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]990worker2 # [ 0.517770] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]991lb # [ 0.486984] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]992worker1 # [ 0.468639] pl061_gpio 9030000.pl061: PL061 GPIO chip registered993worker2 # [ 0.517789] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]994lb # [ 0.487437] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint995worker2 # [ 0.517819] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]996lb # [ 0.487616] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]997worker2 # [ 0.518291] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint998lb # [ 0.487631] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]999worker2 # [ 0.518476] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1000lb # [ 0.487660] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1001worker2 # [ 0.518492] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1002lb # [ 0.488098] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1003worker2 # [ 0.518521] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1004lb # [ 0.488276] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1005worker2 # [ 0.519112] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1006lb # [ 0.488292] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1007worker2 # [ 0.519123] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1008lb # [ 0.488322] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1009worker2 # [ 0.519129] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1010worker1 # [ 0.470141] ledtrig-cpu: registered to indicate activity on CPUs1011worker2 # [ 0.519175] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1012worker1 # [ 0.470588] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1013client # [ 0.465725] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1014worker2 # [ 0.519223] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1015worker1 # [ 0.470606] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001016worker2 # [ 0.519272] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1017worker1 # [ 0.470619] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001018worker2 # [ 0.519320] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1019worker1 # [ 0.470627] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001020client # [ 0.467203] ledtrig-cpu: registered to indicate activity on CPUs1021worker2 # [ 0.519368] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1022worker1 # [ 0.470654] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1023client # [ 0.467636] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1024worker2 # [ 0.519416] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1025worker1 # [ 0.470683] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1026client # [ 0.467655] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001027worker2 # [ 0.519464] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1028worker1 # [ 0.470774] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001029client # [ 0.467667] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001030worker2 # [ 0.519512] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1031worker1 # [ 0.470783] pci_bus 0000:00: root bus resource [bus 00-ff]1032worker2 # [ 0.519561] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1033worker1 # [ 0.470789] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1034client # [ 0.467676] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001035lb # [ 0.508922] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1036worker1 # [ 0.470794] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1037worker2 # [ 0.519633] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1038client # [ 0.467715] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1039lb # [ 0.509135] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1040worker1 # [ 0.470800] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1041worker2 # [ 0.519680] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1042lb # [ 0.509153] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1043client # [ 0.467741] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1044worker2 # [ 0.519702] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1045worker1 # [ 0.470891] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1046lb # [ 0.509183] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1047client # [ 0.467823] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001048worker2 # [ 0.519723] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1049lb # [ 0.509199] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1050client # [ 0.467832] pci_bus 0000:00: root bus resource [bus 00-ff]1051worker1 # [ 0.471334] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1052worker2 # [ 0.519745] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1053worker1 # [ 0.471553] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1054client # [ 0.467838] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1055lb # [ 0.509718] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1056worker2 # [ 0.519770] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1057worker1 # [ 0.471572] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1058client # [ 0.467844] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1059lb # [ 0.509914] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1060worker2 # [ 0.519792] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1061worker1 # [ 0.471602] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1062client # [ 0.467849] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1063lb # [ 0.509943] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1064worker2 # [ 0.519813] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1065worker1 # [ 0.471618] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1066client # [ 0.467908] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1067lb # [ 0.510431] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1068worker2 # [ 0.519835] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1069worker1 # [ 0.472085] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1070lb # [ 0.510642] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1071client # [ 0.468394] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1072worker2 # [ 0.519857] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1073worker1 # [ 0.472268] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1074lb # [ 0.510672] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1075client # [ 0.468584] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1076worker2 # [ 0.519879] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1077worker1 # [ 0.472283] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1078client # [ 0.468601] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1079lb # [ 0.511077] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1080worker2 # [ 0.519902] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1081worker1 # [ 0.472313] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1082client # [ 0.468631] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1083lb # [ 0.511266] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1084worker2 # [ 0.519924] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1085worker1 # [ 0.472787] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1086client # [ 0.468648] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1087worker2 # [ 0.519946] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1088lb # [ 0.511519] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1089worker1 # [ 0.472969] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1090client # [ 0.469111] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1091lb # [ 0.511814] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1092worker2 # [ 0.519967] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1093worker1 # [ 0.472985] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1094client # [ 0.469298] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1095worker2 # [ 0.519988] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1096lb # [ 0.511836] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1097worker1 # [ 0.473014] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1098client # [ 0.469314] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1099worker2 # [ 0.520010] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1100lb # [ 0.511868] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1101worker1 # [ 0.473464] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1102client # [ 0.469344] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1103worker2 # [ 0.520031] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1104lb # [ 0.512333] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1105worker1 # [ 0.473649] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1106worker2 # [ 0.520053] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1107worker1 # [ 0.473664] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1108worker2 # [ 0.520074] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1109worker1 # [ 0.473697] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1110worker2 # [ 0.520096] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1111worker2 # [ 0.520117] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1112worker1 # [ 0.474173] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1113worker1 # [ 0.474356] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1114worker2 # [ 0.520144] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1115worker1 # [ 0.474372] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1116worker2 # [ 0.520154] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1117worker1 # [ 0.474410] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1118worker2 # [ 0.520159] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1119worker1 # [ 0.474868] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1120worker1 # [ 0.475053] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1121worker1 # [ 0.475069] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1122worker2 # [ 0.559905] pci 0000:00:0a.0: enabling device (0000 -> 0002)1123worker1 # [ 0.475098] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1124worker1 # [ 0.475579] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1125worker1 # [ 0.475764] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1126lb # [ 0.532617] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1127worker1 # [ 0.475780] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1128lb # [ 0.532659] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1129worker1 # [ 0.475809] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1130lb # [ 0.532689] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1131worker1 # [ 0.475825] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1132lb # [ 0.533372] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1133worker1 # [ 0.476310] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1134lb # [ 0.533385] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1135client # [ 0.493958] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1136lb # [ 0.533391] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1137client # [ 0.494181] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1138client # [ 0.494205] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1139lb # [ 0.533439] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1140client # [ 0.494236] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1141lb # [ 0.533487] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1142client # [ 0.494709] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1143lb # [ 0.533541] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1144client # [ 0.494896] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1145lb # [ 0.533590] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1146client # [ 0.494912] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1147client # [ 0.494946] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1148lb # [ 0.533639] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1149client # [ 0.495434] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1150lb # [ 0.533692] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1151client # [ 0.495621] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1152lb # [ 0.533745] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1153client # [ 0.495637] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1154lb # [ 0.533796] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1155client # [ 0.495668] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1156lb # [ 0.533845] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1157client # [ 0.496271] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1158client # [ 0.496462] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1159lb # [ 0.533999] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1160client # [ 0.496477] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1161lb # [ 0.534048] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1162client # [ 0.496508] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1163lb # [ 0.534070] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1164client # [ 0.496975] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1165lb # [ 0.534093] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1166client # [ 0.497165] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1167lb # [ 0.534115] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1168client # [ 0.497181] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1169lb # [ 0.534142] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1170client # [ 0.497211] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1171lb # [ 0.534165] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1172client # [ 0.497227] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1173lb # [ 0.534187] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1174client # [ 0.497773] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1175lb # [ 0.534209] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1176client # [ 0.497978] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1177lb # [ 0.534232] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1178client # [ 0.498008] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1179lb # [ 0.534255] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1180worker1 # [ 0.524663] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1181client # [ 0.498468] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1182lb # [ 0.534279] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1183worker1 # [ 0.524720] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1184client # [ 0.498668] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1185lb # [ 0.534307] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1186worker1 # [ 0.525279] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1187client # [ 0.498697] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1188worker2 # [ 0.584811] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1189lb # [ 0.534329] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1190worker1 # [ 0.525477] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1191worker2 # [ 0.587164] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1192client # [ 0.499091] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1193lb # [ 0.534351] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1194worker1 # [ 0.525507] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1195lb # [ 0.534373] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1196client # [ 0.499274] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1197worker1 # [ 0.525913] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1198lb # [ 0.534395] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1199client # [ 0.499527] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1200lb # [ 0.534417] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1201worker1 # [ 0.526099] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1202client # [ 0.499819] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1203lb # [ 0.534439] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1204client # [ 0.499837] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1205worker1 # [ 0.526374] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1206lb # [ 0.534491] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1207worker1 # [ 0.526667] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1208client # [ 0.499866] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1209lb # [ 0.534515] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1210worker1 # [ 0.526687] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1211client # [ 0.500337] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1212lb # [ 0.534538] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1213worker1 # [ 0.526720] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1214client # [ 0.500521] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1215lb # [ 0.534568] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1216client # [ 0.500537] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1217worker1 # [ 0.527194] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1218lb # [ 0.534577] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1219worker1 # [ 0.527384] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1220client # [ 0.500567] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1221lb # [ 0.534583] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1222worker1 # [ 0.527400] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1223client # [ 0.501183] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1224lb # [ 0.535763] pci 0000:00:0a.0: enabling device (0000 -> 0002)1225worker1 # [ 0.527431] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1226client # [ 0.501195] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1227worker1 # [ 0.528073] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1228client # [ 0.501201] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1229worker1 # [ 0.528085] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1230client # [ 0.501247] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1231worker1 # [ 0.528091] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1232worker2 # [ 0.598670] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1233client # [ 0.501294] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1234worker1 # [ 0.528140] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1235client # [ 0.501344] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1236worker1 # [ 0.528188] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1237client # [ 0.501392] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1238worker1 # [ 0.528236] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1239client # [ 0.501442] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1240worker1 # [ 0.528284] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1241client # [ 0.501492] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1242worker1 # [ 0.528332] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1243client # [ 0.501543] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1244worker1 # [ 0.528381] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1245worker1 # [ 0.528460] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1246worker1 # [ 0.528509] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1247worker1 # [ 0.528555] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1248worker1 # [ 0.528637] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1249worker1 # [ 0.528684] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1250worker1 # [ 0.528706] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1251worker1 # [ 0.528727] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1252worker1 # [ 0.528750] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1253worker1 # [ 0.528776] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1254client # [ 0.545688] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1255worker1 # [ 0.528798] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1256client # [ 0.545742] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1257worker1 # [ 0.528820] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1258worker2 # [ 0.613156] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1259worker1 # [ 0.528842] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1260client # [ 0.545836] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1261worker2 # [ 0.615409] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1262worker1 # [ 0.528863] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1263client # [ 0.545938] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1264worker1 # [ 0.528886] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1265client # [ 0.545963] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1266worker1 # [ 0.528909] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1267client # [ 0.545987] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1268worker2 # [ 0.619228] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1269worker1 # [ 0.528931] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1270client # [ 0.546011] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1271worker1 # [ 0.528953] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1272client # [ 0.546037] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1273worker1 # [ 0.528974] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1274client # [ 0.546060] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1275worker1 # [ 0.528995] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1276client # [ 0.546084] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1277worker1 # [ 0.529017] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1278lb # [ 0.595625] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1279client # [ 0.546108] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1280worker1 # [ 0.529038] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1281client # [ 0.546130] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1282worker1 # [ 0.529060] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1283worker2 # [ 0.622381] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1284client # [ 0.546153] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1285worker1 # [ 0.529081] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1286client # [ 0.546185] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1287worker1 # [ 0.529103] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1288worker1 # [ 0.529125] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1289client # [ 0.546208] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1290worker1 # [ 0.529153] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1291client # [ 0.546230] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1292lb # [ 0.598852] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1293worker1 # [ 0.529163] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1294client # [ 0.546251] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1295worker1 # [ 0.529168] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1296client # [ 0.546273] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1297worker1 # [ 0.530357] pci 0000:00:0a.0: enabling device (0000 -> 0002)1298client # [ 0.546294] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1299client # [ 0.546316] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1300client # [ 0.546337] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1301client # [ 0.546359] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1302client # [ 0.546382] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1303client # [ 0.546404] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1304client # [ 0.546438] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1305client # [ 0.546448] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1306client # [ 0.546452] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1307worker2 # [ 0.634105] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1308client # [ 0.547659] pci 0000:00:0a.0: enabling device (0000 -> 0002)1309lb # [ 0.608808] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1310lb # [ 0.611288] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1311worker2 # [ 0.640670] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1312worker2 # [ 0.642766] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1313lb # [ 0.622373] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1314lb # [ 0.625432] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1315worker2 # [ 0.653351] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1316lb # [ 0.627758] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1317worker1 # [ 0.603328] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1318worker1 # [ 0.606528] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1319client # [ 0.596348] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1320worker2 # [ 0.665845] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1321lb # [ 0.638217] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1322lb # [ 0.641470] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1323worker2 # [ 0.668744] msm_serial: driver initialized1324lb # [ 0.643535] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1325worker2 # [ 0.668895] SuperH (H)SCI(F) driver initialized1326client # [ 0.602999] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1327worker2 # [ 0.668951] STM32 USART driver initialized1328client # [ 0.605249] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1329worker1 # [ 0.616724] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1330worker1 # [ 0.618957] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1331worker1 # [ 0.621250] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1332worker1 # [ 0.623572] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1333lb # [ 0.654253] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1334client # [ 0.615139] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1335client # [ 0.617372] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1336worker1 # [ 0.634007] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1337client # [ 0.628834] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1338lb # [ 0.669226] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1339lb # [ 0.672194] msm_serial: driver initialized1340lb # [ 0.672390] SuperH (H)SCI(F) driver initialized1341worker1 # [ 0.640591] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1342lb # [ 0.672448] STM32 USART driver initialized1343worker1 # [ 0.642995] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1344client # [ 0.639174] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1345worker2 # [ 0.708734] loop: module loaded1346worker2 # [ 0.708973] virtio_blk virtio5: 1/0/0 default/read/poll queues1347worker1 # [ 0.653082] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1348worker1 # [ 0.655819] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1349worker2 # [ 0.709968] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1350client # [ 0.650358] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1351client # [ 0.652987] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1352client # [ 0.657084] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1353worker2 # [ 0.721263] megasas: 07.734.00.00-rc11354worker2 # [ 0.722092] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1355worker2 # [ 0.724169] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001356client # [ 0.664404] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1357worker2 # [ 0.724207] Intel/Sharp Extended Query Table at 0x00311358worker2 # [ 0.725902] Using buffer write method1359worker2 # [ 0.725995] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1360worker2 # [ 0.727910] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001361worker2 # [ 0.727948] Intel/Sharp Extended Query Table at 0x00311362worker1 # [ 0.680678] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1363worker1 # [ 0.683439] msm_serial: driver initialized1364lb # [ 0.709819] loop: module loaded1365worker1 # [ 0.683643] SuperH (H)SCI(F) driver initialized1366lb # [ 0.710040] virtio_blk virtio5: 1/0/0 default/read/poll queues1367worker1 # [ 0.683696] STM32 USART driver initialized1368lb # [ 0.710941] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1369client # [ 0.682302] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1370worker2 # [ 0.749636] Using buffer write method1371worker2 # [ 0.749681] Concatenating MTD devices:1372worker2 # [ 0.749685] (0): "0.flash"1373worker2 # [ 0.749689] (1): "0.flash"1374client # [ 0.685265] msm_serial: driver initialized1375worker2 # [ 0.749692] into device "0.flash"1376client # [ 0.685415] SuperH (H)SCI(F) driver initialized1377client # [ 0.685469] STM32 USART driver initialized1378lb # [ 0.725370] megasas: 07.734.00.00-rc11379lb # [ 0.726170] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1380lb # [ 0.728301] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001381lb # [ 0.728378] Intel/Sharp Extended Query Table at 0x00311382lb # [ 0.730228] Using buffer write method1383lb # [ 0.730334] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1384lb # [ 0.732229] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001385lb # [ 0.732267] Intel/Sharp Extended Query Table at 0x00311386lb # [ 0.741291] Using buffer write method1387lb # [ 0.741333] Concatenating MTD devices:1388lb # [ 0.741337] (0): "0.flash"1389lb # [ 0.741342] (1): "0.flash"1390lb # [ 0.741345] into device "0.flash"1391worker1 # [ 0.714750] loop: module loaded1392worker1 # [ 0.714974] virtio_blk virtio5: 1/0/0 default/read/poll queues1393worker1 # [ 0.715779] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1394worker1 # [ 0.729246] megasas: 07.734.00.00-rc11395worker1 # [ 0.730013] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1396worker1 # [ 0.732179] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001397client # [ 0.725912] loop: module loaded1398worker1 # [ 0.732217] Intel/Sharp Extended Query Table at 0x00311399client # [ 0.726162] virtio_blk virtio5: 1/0/0 default/read/poll queues1400client # [ 0.727059] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1401worker1 # [ 0.734040] Using buffer write method1402worker1 # [ 0.734148] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1403worker1 # [ 0.736160] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001404worker1 # [ 0.736205] Intel/Sharp Extended Query Table at 0x00311405client # [ 0.738448] megasas: 07.734.00.00-rc11406worker1 # [ 0.756944] Using buffer write method1407worker1 # [ 0.756994] Concatenating MTD devices:1408worker1 # [ 0.756998] (0): "0.flash"1409client # [ 0.739251] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1410worker1 # [ 0.757002] (1): "0.flash"1411worker1 # [ 0.757006] into device "0.flash"1412client # [ 0.741421] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001413client # [ 0.741466] Intel/Sharp Extended Query Table at 0x00311414client # [ 0.743427] Using buffer write method1415client # [ 0.743528] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1416client # [ 0.757603] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001417client # [ 0.757653] Intel/Sharp Extended Query Table at 0x00311418client # [ 0.759433] Using buffer write method1419client # [ 0.759484] Concatenating MTD devices:1420client # [ 0.759488] (0): "0.flash"1421client # [ 0.759492] (1): "0.flash"1422client # [ 0.759496] into device "0.flash"1423worker2 # [ 1.025692] Freeing initrd memory: 26148K1424worker2 # [ 1.032034] tun: Universal TUN/TAP device driver, 1.61425worker2 # [ 1.036174] thunder_xcv, ver 1.01426worker2 # [ 1.036228] thunder_bgx, ver 1.01427worker2 # [ 1.036251] nicpf, ver 1.01428worker2 # [ 1.038156] e1000: Intel(R) PRO/1000 Network Driver1429worker2 # [ 1.038169] e1000: Copyright (c) 1999-2006 Intel Corporation.1430worker2 # [ 1.038194] e1000e: Intel(R) PRO/1000 Network Driver1431worker2 # [ 1.038205] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1432worker2 # [ 1.038234] igb: Intel(R) Gigabit Ethernet Network Driver1433worker2 # [ 1.038239] igb: Copyright (c) 2007-2014 Intel Corporation.1434worker2 # [ 1.038262] igbvf: Intel(R) Gigabit Virtual Function Network Driver1435worker2 # [ 1.038268] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1436worker2 # [ 1.038402] sky2: driver version 1.301437worker2 # [ 1.040022] usbcore: registered new interface driver usb-storage1438worker2 # [ 1.040106] usbcore: registered new interface driver usbserial_generic1439worker2 # [ 1.040122] usbserial: USB Serial support registered for generic1440worker2 # [ 1.041197] ehci-pci 0000:00:0a.0: EHCI Host Controller1441lb # [ 1.023493] Freeing initrd memory: 26140K1442worker2 # [ 1.041227] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11443worker2 # [ 1.041472] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001444worker2 # [ 1.052535] hv_vmbus: registering driver hyperv_keyboard1445worker2 # [ 1.053959] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001446worker2 # [ 1.055021] hub 1-0:1.0: USB hub found1447worker2 # [ 1.055503] hub 1-0:1.0: 6 ports detected1448lb # [ 1.029955] tun: Universal TUN/TAP device driver, 1.61449worker2 # [ 1.056656] rtc-pl031 9010000.pl031: registered as rtc01450worker2 # [ 1.056687] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:06:12 UTC (1789891572)1451worker2 # [ 1.057041] i2c_dev: i2c /dev entries driver1452worker2 # [ 1.062119] sdhci: Secure Digital Host Controller Interface driver1453lb # [ 1.034138] thunder_xcv, ver 1.01454worker2 # [ 1.062130] sdhci: Copyright(c) Pierre Ossman1455lb # [ 1.034193] thunder_bgx, ver 1.01456lb # [ 1.034217] nicpf, ver 1.01457worker2 # [ 1.062404] Synopsys Designware Multimedia Card Interface Driver1458lb # [ 1.034815] e1000: Intel(R) PRO/1000 Network Driver1459worker2 # [ 1.062789] sdhci-pltfm: SDHCI platform and OF driver helper1460lb # [ 1.034823] e1000: Copyright (c) 1999-2006 Intel Corporation.1461lb # [ 1.034848] e1000e: Intel(R) PRO/1000 Network Driver1462lb # [ 1.034860] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1463worker2 # [ 1.067307] hid: raw HID events driver (C) Jiri Kosina1464lb # [ 1.034891] igb: Intel(R) Gigabit Ethernet Network Driver1465worker2 # [ 1.067576] usbcore: registered new interface driver usbhid1466lb # [ 1.034897] igb: Copyright (c) 2007-2014 Intel Corporation.1467worker2 # [ 1.067582] usbhid: USB HID core driver1468lb # [ 1.034922] igbvf: Intel(R) Gigabit Virtual Function Network Driver1469lb # [ 1.034929] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1470lb # [ 1.035063] sky2: driver version 1.301471lb # [ 1.037311] ehci-pci 0000:00:0a.0: EHCI Host Controller1472worker2 # [ 1.070513] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1473lb # [ 1.037371] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11474worker2 # [ 1.072071] drop_monitor: Initializing network drop monitor service1475lb # [ 1.037680] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001476worker2 # [ 1.072233] NET: Registered PF_INET6 protocol family1477worker2 # [ 1.075324] Segment Routing with IPv61478worker2 # [ 1.075343] In-situ OAM (IOAM) with IPv61479lb # [ 1.047596] usbcore: registered new interface driver usb-storage1480worker2 # [ 1.075384] NET: Registered PF_PACKET protocol family1481lb # [ 1.047701] usbcore: registered new interface driver usbserial_generic1482lb # [ 1.047717] usbserial: USB Serial support registered for generic1483lb # [ 1.048321] hv_vmbus: registering driver hyperv_keyboard1484lb # [ 1.048545] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001485lb # [ 1.052795] hub 1-0:1.0: USB hub found1486lb # [ 1.053290] hub 1-0:1.0: 6 ports detected1487worker2 # [ 1.077242] 9pnet: Installing 9P2000 support1488worker2 # [ 1.079554] Key type dns_resolver registered1489lb # [ 1.054777] rtc-pl031 9010000.pl031: registered as rtc01490lb # [ 1.054811] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:06:12 UTC (1789891572)1491lb # [ 1.055158] i2c_dev: i2c /dev entries driver1492worker1 # [ 1.032785] Freeing initrd memory: 26148K1493lb # [ 1.060154] sdhci: Secure Digital Host Controller Interface driver1494lb # [ 1.060167] sdhci: Copyright(c) Pierre Ossman1495worker2 # [ 1.086581] registered taskstats version 11496worker2 # [ 1.086737] Loading compiled-in X.509 certificates1497lb # [ 1.060442] Synopsys Designware Multimedia Card Interface Driver1498lb # [ 1.062900] sdhci-pltfm: SDHCI platform and OF driver helper1499worker1 # [ 1.039152] tun: Universal TUN/TAP device driver, 1.61500lb # [ 1.065426] hid: raw HID events driver (C) Jiri Kosina1501lb # [ 1.065684] usbcore: registered new interface driver usbhid1502lb # [ 1.065692] usbhid: USB HID core driver1503worker2 # [ 1.095526] Demotion targets for Node 0: null1504worker2 # [ 1.095665] Key type .fscrypt registered1505worker2 # [ 1.095671] Key type fscrypt-provisioning registered1506worker2 # [ 1.095779] ima: No TPM chip found, activating TPM-bypass!1507lb # [ 1.068743] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1508worker2 # [ 1.095798] ima: Allocated hash algorithm: sha11509worker1 # [ 1.043431] thunder_xcv, ver 1.01510worker1 # [ 1.043513] thunder_bgx, ver 1.01511worker2 # [ 1.095823] ima: No architecture policies found1512lb # [ 1.070314] drop_monitor: Initializing network drop monitor service1513worker1 # [ 1.043537] nicpf, ver 1.01514lb # [ 1.070502] NET: Registered PF_INET6 protocol family1515worker1 # [ 1.044117] e1000: Intel(R) PRO/1000 Network Driver1516worker2 # [ 1.099992] input: gpio-keys as /devices/platform/gpio-keys/input/input01517worker1 # [ 1.044124] e1000: Copyright (c) 1999-2006 Intel Corporation.1518lb # [ 1.073597] Segment Routing with IPv61519worker1 # [ 1.044149] e1000e: Intel(R) PRO/1000 Network Driver1520lb # [ 1.073630] In-situ OAM (IOAM) with IPv61521worker1 # [ 1.044158] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1522lb # [ 1.073663] NET: Registered PF_PACKET protocol family1523worker1 # [ 1.044188] igb: Intel(R) Gigabit Ethernet Network Driver1524worker1 # [ 1.044194] igb: Copyright (c) 2007-2014 Intel Corporation.1525lb # [ 1.075371] 9pnet: Installing 9P2000 support1526worker1 # [ 1.044222] igbvf: Intel(R) Gigabit Virtual Function Network Driver1527worker1 # [ 1.044228] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1528worker1 # [ 1.044368] sky2: driver version 1.301529lb # [ 1.078470] Key type dns_resolver registered1530worker1 # [ 1.053416] usbcore: registered new interface driver usb-storage1531worker1 # [ 1.053540] usbcore: registered new interface driver usbserial_generic1532worker1 # [ 1.053556] usbserial: USB Serial support registered for generic1533client # [ 1.042981] Freeing initrd memory: 26160K1534worker1 # [ 1.054168] hv_vmbus: registering driver hyperv_keyboard1535worker1 # [ 1.058587] ehci-pci 0000:00:0a.0: EHCI Host Controller1536worker1 # [ 1.058629] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11537worker1 # [ 1.058812] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001538client # [ 1.049418] tun: Universal TUN/TAP device driver, 1.61539lb # [ 1.085295] registered taskstats version 11540lb # [ 1.085469] Loading compiled-in X.509 certificates1541worker1 # [ 1.061448] rtc-pl031 9010000.pl031: registered as rtc01542worker1 # [ 1.061481] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:06:12 UTC (1789891572)1543worker1 # [ 1.061918] i2c_dev: i2c /dev entries driver1544client # [ 1.053474] thunder_xcv, ver 1.01545client # [ 1.053528] thunder_bgx, ver 1.01546worker2 # [ 1.120353] clk: Disabling unused clocks1547lb # [ 1.094364] Demotion targets for Node 0: null1548lb # [ 1.094546] Key type .fscrypt registered1549lb # [ 1.094552] Key type fscrypt-provisioning registered1550worker2 # [ 1.120951] PM: genpd: Disabling unused power domains1551worker1 # [ 1.067074] sdhci: Secure Digital Host Controller Interface driver1552lb # [ 1.094656] ima: No TPM chip found, activating TPM-bypass!1553worker1 # [ 1.067089] sdhci: Copyright(c) Pierre Ossman1554client # [ 1.054473] nicpf, ver 1.01555lb # [ 1.094675] ima: Allocated hash algorithm: sha11556client # [ 1.055063] e1000: Intel(R) PRO/1000 Network Driver1557worker1 # [ 1.067363] Synopsys Designware Multimedia Card Interface Driver1558lb # [ 1.094700] ima: No architecture policies found1559client # [ 1.055071] e1000: Copyright (c) 1999-2006 Intel Corporation.1560worker2 # [ 1.124789] Freeing unused kernel memory: 4736K1561worker1 # [ 1.067773] sdhci-pltfm: SDHCI platform and OF driver helper1562worker2 # [ 1.124994] Run /init as init process1563client # [ 1.055095] e1000e: Intel(R) PRO/1000 Network Driver1564worker1 # [ 1.068454] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001565lb # [ 1.098886] input: gpio-keys as /devices/platform/gpio-keys/input/input01566client # [ 1.055105] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1567worker1 # [ 1.068796] hub 1-0:1.0: USB hub found1568worker1 # [ 1.068818] hub 1-0:1.0: 6 ports detected1569client # [ 1.055134] igb: Intel(R) Gigabit Ethernet Network Driver1570client # [ 1.055139] igb: Copyright (c) 2007-2014 Intel Corporation.1571client # [ 1.055163] igbvf: Intel(R) Gigabit Virtual Function Network Driver1572client # [ 1.055169] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1573client # [ 1.055305] sky2: driver version 1.301574worker1 # [ 1.074762] hid: raw HID events driver (C) Jiri Kosina1575client # [ 1.057035] usbcore: registered new interface driver usb-storage1576worker1 # [ 1.075036] usbcore: registered new interface driver usbhid1577client # [ 1.057156] usbcore: registered new interface driver usbserial_generic1578worker1 # [ 1.075042] usbhid: USB HID core driver1579client # [ 1.057171] usbserial: USB Serial support registered for generic1580client # [ 1.058300] ehci-pci 0000:00:0a.0: EHCI Host Controller1581client # [ 1.058333] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11582client # [ 1.058551] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001583worker1 # [ 1.078125] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1584worker1 # [ 1.079740] drop_monitor: Initializing network drop monitor service1585worker1 # [ 1.079958] NET: Registered PF_INET6 protocol family1586client # [ 1.069819] hv_vmbus: registering driver hyperv_keyboard1587client # [ 1.071228] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001588worker1 # [ 1.083111] Segment Routing with IPv61589worker1 # [ 1.083135] In-situ OAM (IOAM) with IPv61590client # [ 1.072371] hub 1-0:1.0: USB hub found1591client # [ 1.072870] hub 1-0:1.0: 6 ports detected1592worker1 # [ 1.083168] NET: Registered PF_PACKET protocol family1593client # [ 1.074039] rtc-pl031 9010000.pl031: registered as rtc01594client # [ 1.074075] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:06:12 UTC (1789891572)1595client # [ 1.074442] i2c_dev: i2c /dev entries driver1596worker1 # [ 1.085032] 9pnet: Installing 9P2000 support1597worker1 # [ 1.087317] Key type dns_resolver registered1598worker2 # [ 1.143028] systemd[1]: Successfully made /usr/ read-only.1599client # [ 1.079506] sdhci: Secure Digital Host Controller Interface driver1600lb # [ 1.119523] clk: Disabling unused clocks1601client # [ 1.079520] sdhci: Copyright(c) Pierre Ossman1602lb # [ 1.119571] PM: genpd: Disabling unused power domains1603client # [ 1.079790] Synopsys Designware Multimedia Card Interface Driver1604client # [ 1.080189] sdhci-pltfm: SDHCI platform and OF driver helper1605worker1 # [ 1.094964] registered taskstats version 11606client # [ 1.084832] hid: raw HID events driver (C) Jiri Kosina1607worker1 # [ 1.095149] Loading compiled-in X.509 certificates1608lb # [ 1.124003] Freeing unused kernel memory: 4736K1609client # [ 1.085096] usbcore: registered new interface driver usbhid1610lb # [ 1.124231] Run /init as init process1611client # [ 1.085103] usbhid: USB HID core driver1612client # [ 1.088087] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1613client # [ 1.090789] drop_monitor: Initializing network drop monitor service1614client # [ 1.090947] NET: Registered PF_INET6 protocol family1615worker1 # [ 1.104130] Demotion targets for Node 0: null1616client # [ 1.092954] Segment Routing with IPv61617worker1 # [ 1.104268] Key type .fscrypt registered1618client # [ 1.092975] In-situ OAM (IOAM) with IPv61619worker1 # [ 1.104275] Key type fscrypt-provisioning registered1620client # [ 1.093011] NET: Registered PF_PACKET protocol family1621worker1 # [ 1.104382] ima: No TPM chip found, activating TPM-bypass!1622worker1 # [ 1.106817] ima: Allocated hash algorithm: sha11623worker1 # [ 1.106846] ima: No architecture policies found1624worker1 # [ 1.108780] input: gpio-keys as /devices/platform/gpio-keys/input/input01625client # [ 1.094685] 9pnet: Installing 9P2000 support1626client # [ 1.096915] Key type dns_resolver registered1627lb # [ 1.139117] systemd[1]: Successfully made /usr/ read-only.1628client # [ 1.104151] registered taskstats version 11629client # [ 1.104321] Loading compiled-in X.509 certificates1630client # [ 1.113143] Demotion targets for Node 0: null1631client # [ 1.113282] Key type .fscrypt registered1632client # [ 1.113290] Key type fscrypt-provisioning registered1633client # [ 1.113402] ima: No TPM chip found, activating TPM-bypass!1634client # [ 1.113423] ima: Allocated hash algorithm: sha11635client # [ 1.113447] ima: No architecture policies found1636client # [ 1.117746] input: gpio-keys as /devices/platform/gpio-keys/input/input01637worker1 # [ 1.130913] clk: Disabling unused clocks1638worker1 # [ 1.130951] PM: genpd: Disabling unused power domains1639worker1 # [ 1.135411] Freeing unused kernel memory: 4736K1640worker1 # [ 1.135638] Run /init as init process1641worker1 # [ 1.150992] systemd[1]: Successfully made /usr/ read-only.1642client # [ 1.139829] clk: Disabling unused clocks1643client # [ 1.139878] PM: genpd: Disabling unused power domains1644client # [ 1.144423] Freeing unused kernel memory: 4736K1645client # [ 1.144642] Run /init as init process1646client # [ 1.160127] systemd[1]: Successfully made /usr/ read-only.1647worker2 # [ 1.300502] usb 1-1: new high-speed USB device number 2 using ehci-pci1648lb # [ 1.300588] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker1 # [ 1.316490] usb 1-1: new high-speed USB device number 2 using ehci-pci1650client # [ 1.321603] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker2 # [ 1.454937] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652lb # [ 1.455773] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653worker2 # [ 1.478062] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1654worker2 # [ 1.490629] systemd[1]: Detected virtualization qemu.1655worker2 # [ 1.492769] systemd[1]: Detected architecture arm64.1656worker2 # [ 1.494776] systemd[1]: Running in initrd.1657worker2 # [ 1.497537] systemd[1]: Initializing machine ID from random generator.1658worker2 # [ 1.500739] systemd[1]: Hostname set to <worker2>.1659lb # [ 1.474149] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1660lb # [ 1.486732] systemd[1]: Detected virtualization qemu.1661lb # [ 1.488894] systemd[1]: Detected architecture arm64.1662lb # [ 1.490819] systemd[1]: Running in initrd.1663lb # [ 1.493545] systemd[1]: Initializing machine ID from random generator.1664lb # [ 1.496660] systemd[1]: Hostname set to <lb>.1665worker1 # [ 1.468811] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11666client # [ 1.475455] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11667worker1 # [ 1.486203] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1668worker2 # [ 1.552746] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01669worker1 # [ 1.486282] systemd[1]: Detected virtualization qemu.1670worker1 # [ 1.486370] systemd[1]: Detected architecture arm64.1671worker1 # [ 1.486395] systemd[1]: Running in initrd.1672worker1 # [ 1.487441] systemd[1]: Initializing machine ID from random generator.1673worker1 # [ 1.487758] systemd[1]: Hostname set to <worker1>.1674lb # [ 1.540757] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01675client # [ 1.495217] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1676client # [ 1.507919] systemd[1]: Detected virtualization qemu.1677client # [ 1.510159] systemd[1]: Detected architecture arm64.1678client # [ 1.512130] systemd[1]: Running in initrd.1679client # [ 1.514897] systemd[1]: Initializing machine ID from random generator.1680client # [ 1.518073] systemd[1]: Hostname set to <client>.1681worker1 # [ 1.552686] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682client # [ 1.569924] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker2 # [ 1.676443] usb 1-2: new high-speed USB device number 3 using ehci-pci1684lb # [ 1.660527] usb 1-2: new high-speed USB device number 3 using ehci-pci1685worker1 # [ 1.672453] usb 1-2: new high-speed USB device number 3 using ehci-pci1686client # [ 1.689705] usb 1-2: new high-speed USB device number 3 using ehci-pci1687lb # [ 1.785908] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688worker2 # [ 1.830430] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689worker2 # [ 1.841937] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21690lb # [ 1.815109] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21691worker2 # [ 1.846852] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01692lb # [ 1.821246] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01693worker1 # [ 1.818096] systemd[1]: bpf-restrict-fs: LSM BPF program attached1694client # [ 1.809502] systemd[1]: bpf-restrict-fs: LSM BPF program attached1695worker1 # [ 1.835332] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21696worker1 # [ 1.840862] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01697client # [ 1.845695] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21698client # [ 1.849687] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01699lb # [ 1.898583] systemd[1]: Queued start job for default target Initrd Default Target.1700lb # [ 1.907056] systemd[1]: Created slice Slice /system/modprobe.1701lb # [ 1.908248] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1702lb # [ 1.909743] systemd[1]: Expecting device /dev/disk/by-label/nixos...1703lb # [ 1.910781] systemd[1]: Reached target Path Units.1704lb # [ 1.911542] systemd[1]: Reached target Slice Units.1705lb # [ 1.912331] systemd[1]: Reached target Swaps.1706lb # [ 1.913105] systemd[1]: Reached target Timer Units.1707worker2 # [ 1.940335] systemd[1]: Queued start job for default target Initrd Default Target.1708lb # [ 1.914120] systemd[1]: Listening on D-Bus System Message Bus Socket.1709lb # [ 1.915335] systemd[1]: Listening on Journal Socket (/dev/log).1710client # [ 1.877110] systemd[1]: Queued start job for default target Initrd Default Target.1711lb # [ 1.916418] systemd[1]: Listening on Journal Sockets.1712lb # [ 1.917442] systemd[1]: Listening on udev Control Socket.1713lb # [ 1.918416] systemd[1]: Listening on udev Kernel Socket.1714lb # [ 1.919303] systemd[1]: Reached target Socket Units.1715worker2 # [ 1.946768] systemd[1]: Created slice Slice /system/modprobe.1716worker2 # [ 1.947942] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1717worker2 # [ 1.949130] systemd[1]: Expecting device /dev/disk/by-label/nixos...1718lb # [ 1.921945] systemd[1]: Starting Create List of Static Device Nodes...1719worker2 # [ 1.950072] systemd[1]: Reached target Path Units.1720worker2 # [ 1.950781] systemd[1]: Reached target Slice Units.1721worker2 # [ 1.951481] systemd[1]: Reached target Swaps.1722worker2 # [ 1.952198] systemd[1]: Reached target Timer Units.1723worker2 # [ 1.953184] systemd[1]: Listening on D-Bus System Message Bus Socket.1724client # [ 1.887954] systemd[1]: Created slice Slice /system/modprobe.1725worker2 # [ 1.954317] systemd[1]: Listening on Journal Socket (/dev/log).1726client # [ 1.889079] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1727worker2 # [ 1.955284] systemd[1]: Listening on Journal Sockets.1728client # [ 1.890244] systemd[1]: Expecting device /dev/disk/by-label/nixos...1729worker2 # [ 1.956140] systemd[1]: Listening on udev Control Socket.1730client # [ 1.891101] systemd[1]: Reached target Path Units.1731worker2 # [ 1.957128] systemd[1]: Listening on udev Kernel Socket.1732client # [ 1.891751] systemd[1]: Reached target Slice Units.1733worker2 # [ 1.957947] systemd[1]: Reached target Socket Units.1734client # [ 1.892444] systemd[1]: Reached target Swaps.1735client # [ 1.893131] systemd[1]: Reached target Timer Units.1736client # [ 1.894028] systemd[1]: Listening on D-Bus System Message Bus Socket.1737lb # [ 1.932812] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1738client # [ 1.895008] systemd[1]: Listening on Journal Socket (/dev/log).1739worker2 # [ 1.960344] systemd[1]: Starting Create List of Static Device Nodes...1740client # [ 1.895910] systemd[1]: Listening on Journal Sockets.1741lb # [ 1.934108] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1742client # [ 1.896734] systemd[1]: Listening on udev Control Socket.1743client # [ 1.897577] systemd[1]: Listening on udev Kernel Socket.1744client # [ 1.898286] systemd[1]: Reached target Socket Units.1745client # [ 1.900561] systemd[1]: Starting Create List of Static Device Nodes...1746lb # [ 1.941697] systemd[1]: Mounting Kernel Configuration File System...1747worker2 # [ 1.968700] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1748worker2 # [ 1.968830] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1749client # [ 1.909838] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1750client # [ 1.910850] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1751worker2 # [ 1.980675] systemd[1]: Mounting Kernel Configuration File System...1752client # [ 1.917945] systemd[1]: Mounting Kernel Configuration File System...1753lb # [ 1.956994] systemd[1]: Starting Journal Service...1754worker1 # [ 1.934669] systemd[1]: Queued start job for default target Initrd Default Target.1755worker1 # [ 1.944016] systemd[1]: Created slice Slice /system/modprobe.1756worker1 # [ 1.945217] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1757worker1 # [ 1.946354] systemd[1]: Expecting device /dev/disk/by-label/nixos...1758worker1 # [ 1.947259] systemd[1]: Reached target Path Units.1759worker1 # [ 1.947991] systemd[1]: Reached target Slice Units.1760worker1 # [ 1.948754] systemd[1]: Reached target Swaps.1761worker1 # [ 1.949401] systemd[1]: Reached target Timer Units.1762lb # [ 1.976915] systemd[1]: Starting Load Kernel Modules...1763worker1 # [ 1.950300] systemd[1]: Listening on D-Bus System Message Bus Socket.1764worker1 # [ 1.951385] systemd[1]: Listening on Journal Socket (/dev/log).1765lb # [ 1.977887] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1766worker1 # [ 1.952427] systemd[1]: Listening on Journal Sockets.1767worker1 # [ 1.953299] systemd[1]: Listening on udev Control Socket.1768worker1 # [ 1.954171] systemd[1]: Listening on udev Kernel Socket.1769worker2 # [ 2.008815] systemd[1]: Starting Journal Service...1770worker1 # [ 1.954931] systemd[1]: Reached target Socket Units.1771client # [ 1.945861] systemd[1]: Starting Journal Service...1772worker1 # [ 1.957502] systemd[1]: Starting Create List of Static Device Nodes...1773lb # [ 1.990753] systemd[1]: Starting Coldplug All udev Devices...1774worker2 # [ 2.019563] systemd[1]: Starting Load Kernel Modules...1775client # [ 1.953836] systemd[1]: Starting Load Kernel Modules...1776worker2 # [ 2.020649] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1777client # [ 1.953995] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1778worker1 # [ 1.968189] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1779worker1 # [ 1.969594] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1780client # [ 1.961936] systemd[1]: Starting Coldplug All udev Devices...1781worker2 # [ 2.034149] systemd[1]: Starting Coldplug All udev Devices...1782worker1 # [ 1.982257] systemd[1]: Mounting Kernel Configuration File System...1783lb # [ 2.008791] systemd[1]: Finished Create List of Static Device Nodes.1784lb # [ 2.010092] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1785lb # [ 2.010433] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1786lb # [ 2.010757] systemd[1]: Mounted Kernel Configuration File System.1787client # [ 1.978248] systemd[1]: Finished Create List of Static Device Nodes.1788client # [ 1.980278] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1789lb # [ 2.025043] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1790worker2 # [ 2.052934] systemd[1]: Finished Create List of Static Device Nodes.1791worker2 # [ 2.054048] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1792worker1 # [ 2.001271] systemd[1]: Starting Journal Service...1793client # [ 1.990231] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1794client # [ 1.990689] systemd[1]: Mounted Kernel Configuration File System.1795client # [ 1.995740] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1796worker2 # [ 2.061295] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1797worker2 # [ 2.061864] systemd[1]: Mounted Kernel Configuration File System.1798worker1 # [ 2.012698] systemd[1]: Starting Load Kernel Modules...1799worker1 # [ 2.013616] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1800worker1 # [ 2.017843] systemd[1]: Starting Coldplug All udev Devices...1801client # [ 2.012719] systemd-journald[73]: Collecting audit messages is disabled.1802lb # [ 2.051896] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1803worker1 # [ 2.028731] systemd[1]: Finished Create List of Static Device Nodes.1804worker2 # [ 2.075783] systemd-journald[73]: Collecting audit messages is disabled.1805worker2 # [ 2.082767] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1806worker1 # [ 2.030691] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1807worker2 # [ 2.088737] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1808lb # [ 2.069973] systemd-journald[73]: Collecting audit messages is disabled.1809worker1 # [ 2.045091] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1810lb # [ 2.080584] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1811worker2 # [ 2.109031] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1812worker1 # [ 2.057145] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1813client # [ 2.051382] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1814lb # [ 2.089299] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1815worker2 # [ 2.116860] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01816worker2 # [ 2.117127] [drm] features: -virgl +edid -resource_blob -host_visible1817lb # [ 2.092142] systemd[1]: Starting Create Static Device Nodes in /dev...1818worker2 # [ 2.117140] [drm] features: -context_init1819worker2 # [ 2.117943] [drm] number of scanouts: 11820worker2 # [ 2.117962] [drm] number of cap sets: 01821client # [ 2.062136] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1822client # [ 2.064559] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1823lb # [ 2.106743] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01824lb # [ 2.107009] [drm] features: -virgl +edid -resource_blob -host_visible1825lb # [ 2.107021] [drm] features: -context_init1826lb # [ 2.107770] [drm] number of scanouts: 11827lb # [ 2.107790] [drm] number of cap sets: 01828worker2 # [ 2.138912] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1829worker2 # [ 2.138952] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01830worker1 # [ 2.088298] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1831client # [ 2.078089] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01832worker1 # [ 2.091283] systemd[1]: Mounted Kernel Configuration File System.1833worker2 # [ 2.145258] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1834client # [ 2.078358] [drm] features: -virgl +edid -resource_blob -host_visible1835client # [ 2.078370] [drm] features: -context_init1836client # [ 2.079133] [drm] number of scanouts: 11837client # [ 2.079153] [drm] number of cap sets: 01838worker1 # [ 2.099926] systemd-journald[73]: Collecting audit messages is disabled.1839client # [ 2.083066] systemd[1]: Starting Create Static Device Nodes in /dev...1840worker1 # [ 2.102052] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1841lb # [ 2.124664] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1842lb # [ 2.124692] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01843worker2 # [ 2.160980] systemd[1]: Starting Create Static Device Nodes in /dev...1844worker1 # [ 2.113195] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01845worker1 # [ 2.113454] [drm] features: -virgl +edid -resource_blob -host_visible1846worker1 # [ 2.113467] [drm] features: -context_init1847worker1 # [ 2.114216] [drm] number of scanouts: 11848worker1 # [ 2.114238] [drm] number of cap sets: 01849client # [ 2.102109] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1850client # [ 2.102142] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01851worker2 # [ 2.176833] Console: switching to colour frame buffer device 160x501852worker2 # [ 2.183778] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1853lb # [ 2.161313] Console: switching to colour frame buffer device 160x501854lb # [ 2.168382] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1855worker1 # [ 2.136838] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1856worker1 # [ 2.136870] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01857lb # [ 2.172839] systemd[1]: Finished Create Static Device Nodes in /dev.1858lb # [ 2.173122] systemd[1]: Reached target Preparation for Local File Systems.1859lb # [ 2.173167] systemd[1]: Reached target Local File Systems.1860worker1 # [ 2.156655] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1861client # [ 2.138836] Console: switching to colour frame buffer device 160x501862worker1 # [ 2.159417] systemd[1]: Starting Create Static Device Nodes in /dev...1863client # [ 2.149412] systemd[1]: Finished Create Static Device Nodes in /dev.1864lb # [ 2.185207] systemd[1]: Starting Rule-based Manager for Device Events and Files...1865worker2 # [ 2.217204] systemd[1]: Finished Load Kernel Modules.1866client # [ 2.150816] systemd[1]: Reached target Preparation for Local File Systems.1867client # [ 2.150848] systemd[1]: Reached target Local File Systems.1868worker2 # [ 2.219805] systemd[1]: Starting Apply Kernel Variables...1869client # [ 2.162056] systemd[1]: Starting Rule-based Manager for Device Events and Files...1870worker1 # [ 2.173013] Console: switching to colour frame buffer device 160x501871worker1 # [ 2.179984] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1872client # [ 2.170190] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1873lb # [ 2.212836] systemd[1]: Finished Load Kernel Modules.1874worker2 # [ 2.244751] systemd[1]: Finished Create Static Device Nodes in /dev.1875worker2 # [ 2.245400] systemd[1]: Reached target Preparation for Local File Systems.1876client # [ 2.186662] systemd[1]: Finished Load Kernel Modules.1877worker2 # [ 2.245465] systemd[1]: Reached target Local File Systems.1878worker2 # [ 2.256324] systemd[1]: Starting Rule-based Manager for Device Events and Files...1879worker1 # [ 2.205343] systemd[1]: Finished Load Kernel Modules.1880lb # [ 2.232739] systemd[1]: Starting Apply Kernel Variables...1881client # [ 2.202249] systemd[1]: Starting Apply Kernel Variables...1882worker1 # [ 2.216732] systemd[1]: Starting Apply Kernel Variables...1883client # [ 2.202295] systemd-modules-load[74]: Inserted module 'dm_mod'1884client # [ 2.217173] systemd[1]: Started Journal Service.1885client # [ 2.210953] systemd-modules-load[74]: Module 'virtio_balloon' is built in1886worker2 # [ 2.284497] systemd-modules-load[74]: Inserted module 'dm_mod'1887lb # [ 2.272900] systemd[1]: Started Journal Service.1888lb # [ 2.260885] systemd-modules-load[74]: Inserted module 'dm_mod'1889client # [ 2.225436] systemd-modules-load[74]: Module 'virtio_console' is built in1890worker2 # [ 2.288499] systemd-modules-load[74]: Module 'virtio_balloon' is built in1891client # [ 2.226758] systemd-modules-load[74]: Inserted module 'virtio_gpu'1892lb # [ 2.262298] systemd-modules-load[74]: Module 'virtio_balloon' is built in1893worker2 # [ 2.289845] systemd-modules-load[74]: Module 'virtio_console' is built in1894client # [ 2.227827] systemd-modules-load[74]: Module 'virtio_rng' is built in1895worker2 # [ 2.291039] systemd-modules-load[74]: Inserted module 'virtio_gpu'1896worker1 # [ 2.252644] systemd[1]: Finished Create Static Device Nodes in /dev.1897worker1 # [ 2.252964] systemd[1]: Reached target Preparation for Local File Systems.1898worker1 # [ 2.253009] systemd[1]: Reached target Local File Systems.1899worker1 # [ 2.259303] systemd[1]: Starting Rule-based Manager for Device Events and Files...1900worker2 # [ 2.316631] systemd[1]: Finished Apply Kernel Variables.1901lb # [ 2.275591] systemd-modules-load[74]: Module 'virtio_console' is built in1902worker2 # [ 2.317035] systemd[1]: Started Journal Service.1903worker2 # [ 2.304775] systemd-modules-load[74]: Module 'virtio_rng' is built in1904lb # [ 2.280765] systemd-modules-load[74]: Inserted module 'virtio_gpu'1905client # [ 2.246192] systemd[1]: Starting Create System Files and Directories...1906lb # [ 2.281919] systemd-modules-load[74]: Module 'virtio_rng' is built in1907lb # [ 2.283075] systemd[1]: Starting Create System Files and Directories...1908lb # [ 2.293539] systemd[1]: Finished Apply Kernel Variables.1909client # [ 2.268537] systemd[1]: Finished Apply Kernel Variables.1910lb # [ 2.304900] systemd-udevd[79]: Using default interface naming scheme 'v261'.1911worker2 # [ 2.333759] systemd[1]: Starting Create System Files and Directories...1912worker1 # [ 2.296867] systemd[1]: Finished Apply Kernel Variables.1913worker1 # [ 2.302479] systemd[1]: Started Journal Service.1914worker2 # [ 2.349342] systemd-udevd[81]: Using default interface naming scheme 'v261'.1915worker1 # [ 2.298163] systemd-modules-load[74]: Inserted module 'dm_mod'1916client # [ 2.289699] systemd-udevd[79]: Using default interface naming scheme 'v261'.1917worker1 # [ 2.304314] systemd-modules-load[74]: Module 'virtio_balloon' is built in1918worker1 # [ 2.305541] systemd-modules-load[74]: Module 'virtio_console' is built in1919worker1 # [ 2.306660] systemd-modules-load[74]: Inserted module 'virtio_gpu'1920worker1 # [ 2.307726] systemd-modules-load[74]: Module 'virtio_rng' is built in1921client # [ 2.308201] systemd[1]: Finished Create System Files and Directories.1922worker1 # [ 2.324636] systemd[1]: Starting Create System Files and Directories...1923worker2 # [ 2.380988] systemd[1]: Finished Create System Files and Directories.1924lb # [ 2.354880] systemd[1]: Started Rule-based Manager for Device Events and Files.1925lb # [ 2.359433] systemd[1]: Finished Create System Files and Directories.1926client # [ 2.334621] systemd[1]: Started Rule-based Manager for Device Events and Files.1927worker2 # [ 2.400521] systemd[1]: Started Rule-based Manager for Device Events and Files.1928worker1 # [ 2.360774] systemd[1]: Finished Create System Files and Directories.1929worker1 # [ 2.365764] systemd-udevd[80]: Using default interface naming scheme 'v261'.1930worker1 # [ 2.398335] systemd[1]: Started Rule-based Manager for Device Events and Files.1931lb # [ 2.434608] systemd[1]: Starting Virtual Console Setup...1932client # [ 2.400922] systemd[1]: Starting Virtual Console Setup...1933worker2 # [ 2.464991] systemd[1]: Starting Virtual Console Setup...1934lb # [ 2.488596] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1935lb # [ 2.492626] systemd[1]: Finished Virtual Console Setup.1936worker1 # [ 2.472187] systemd[1]: Starting Virtual Console Setup...1937client # [ 2.464595] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1938worker2 # [ 2.532684] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1939client # [ 2.472225] systemd[1]: Finished Virtual Console Setup.1940worker2 # [ 2.536730] systemd[1]: Finished Virtual Console Setup.1941worker1 # [ 2.520571] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1942worker1 # [ 2.524664] systemd[1]: Finished Virtual Console Setup.1943client # [ 3.058040] systemd[1]: Finished Coldplug All udev Devices.1944client # [ 3.061509] systemd[1]: Reached target System Initialization.1945client # [ 3.064548] systemd[1]: Reached target Basic System.1946lb # [ 3.101737] systemd[1]: Finished Coldplug All udev Devices.1947lb # [ 3.102821] systemd[1]: Reached target System Initialization.1948lb # [ 3.103657] systemd[1]: Reached target Basic System.1949worker1 # [ 3.126384] systemd[1]: Finished Coldplug All udev Devices.1950worker1 # [ 3.127467] systemd[1]: Reached target System Initialization.1951worker1 # [ 3.128562] systemd[1]: Reached target Basic System.1952worker2 # [ 3.201756] systemd[1]: Finished Coldplug All udev Devices.1953worker2 # [ 3.202751] systemd[1]: Reached target System Initialization.1954worker2 # [ 3.203573] systemd[1]: Reached target Basic System.1955lb # [ 3.268556] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1956client # [ 3.235909] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1957client # [ 3.252822] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1958client # [ 3.257523] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1959lb # [ 3.300456] (udev-worker)[105]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1960lb # [ 3.305547] (udev-worker)[105]: Network interface NamePolicy= disabled on kernel command line.1961worker1 # [ 3.300090] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1962worker1 # [ 3.321843] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1963worker1 # [ 3.328493] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1964worker2 # [ 3.397858] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1965worker2 # [ 3.407314] (udev-worker)[97]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1966worker2 # [ 3.412809] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1967client # [ 3.356173] systemd[1]: Found device /dev/disk/by-label/nixos.1968client # [ 3.360265] systemd[1]: Reached target Initrd Root Device.1969client # [ 3.364979] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1970lb # [ 3.409226] systemd[1]: Found device /dev/disk/by-label/nixos.1971lb # [ 3.413575] systemd[1]: Reached target Initrd Root Device.1972lb # [ 3.415061] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1973worker1 # [ 3.417881] systemd[1]: Found device /dev/disk/by-label/nixos.1974worker1 # [ 3.420179] systemd[1]: Reached target Initrd Root Device.1975worker1 # [ 3.423011] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1976client # [ 3.419196] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1977client # [ 3.427726] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1978worker2 # [ 3.493846] systemd[1]: Found device /dev/disk/by-label/nixos.1979lb # [ 3.468601] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1980worker2 # [ 3.496903] systemd[1]: Reached target Initrd Root Device.1981client # [ 3.436375] systemd[1]: Mounting /sysroot...1982worker2 # [ 3.504174] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1983lb # [ 3.477170] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1984lb # [ 3.480159] systemd[1]: Mounting /sysroot...1985worker1 # [ 3.482365] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1986worker2 # [ 3.552590] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1987client # [ 3.549003] EXT4-fs (vda): mounted filesystem e46af822-8676-42cf-92d1-abbb401c86ab r/w with ordered data mode. Quota mode: none.1988lb # [ 3.587560] EXT4-fs (vda): mounted filesystem 5c53f899-0f12-423c-bc60-77ca397d49f7 r/w with ordered data mode. Quota mode: none.1989client # [ 3.541180] systemd[1]: Mounted /sysroot.1990lb # [ 3.577392] systemd[1]: Mounted /sysroot.1991worker2 # [ 3.607660] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1992worker1 # [ 3.554281] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1993client # [ 3.545970] systemd[1]: Reached target Initrd Root File System.1994lb # [ 3.581614] systemd[1]: Reached target Initrd Root File System.1995worker2 # [ 3.611080] systemd[1]: Mounting /sysroot...1996lb # [ 3.583772] systemd[1]: Starting Mountpoints Configured in the Real Root...1997client # [ 3.550196] systemd[1]: Starting Mountpoints Configured in the Real Root...1998worker1 # [ 3.560382] systemd[1]: Mounting /sysroot...1999lb # [ 3.615229] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload.2000client # [ 3.583530] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.3216worker2 # [ 13.710873] systemd[1]: Started Getty on tty1.3217client # [ 13.649786] systemd[1]: Starting Permit User Sessions...3218worker2 # [ 13.713834] systemd[1]: Reached target Login Prompts.3219lb # [ 13.707316] cfg80211: Loading compiled-in X.509 certificates for regulatory database3220worker2 # [ 13.753508] systemd-logind[521]: Watching system buttons on /dev/input/event0 (gpio-keys)3221lb # [ 13.759807] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3222lb # [ 13.760319] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3223worker1 # [ 13.724423] dbus-broker-launch[575]: Looking up NSS user entry for 'systemd-timesync'...3224client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.08 seconds)3225lb # [ 13.766880] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23226lb: waiting for unit network-addresses-eth1.service3227lb # [ 13.767252] cfg80211: failed to load regulatory.db3228lb: waiting for the VM to finish booting3229lb: Guest shell says: b'Spawning backdoor root shell...\n'3230lb: connected to guest root shell3231lb: (connecting took 0.00 seconds)3232lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3233client # [ 13.718968] systemd[1]: Finished Permit User Sessions.3234lb # [ 13.756700] dhcpcd[673]: no valid interfaces found3235lb # [ 13.757769] dhcpcd[673]: no valid interfaces found3236client # [ 13.728888] dhcpcd[548]: eth0: soliciting a DHCP lease3237client # [ 13.731261] systemd[1]: Started Getty on tty1.3238client # [ 13.734484] systemd[1]: Reached target Login Prompts.3239client # [ 13.735614] dhcpcd[548]: eth0: offered 10.0.2.15 from 10.0.2.23240worker2 # [ 13.816256] 8021q: adding VLAN 0 to HW filter on device eth03241client # [ 13.741074] dhcpcd[548]: eth0: probing address 10.0.2.15/243242worker2 # [ 13.803924] dhcpcd[652]: eth0: waiting for carrier3243worker2 # [ 13.806555] dhcpcd[652]: eth0: carrier acquired3244worker1 # [ 13.746705] dbus-broker-launch[575]: NSS returned no entry for 'systemd-timesync'3245worker1 # [ 13.755064] dbus-broker-launch[575]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3246worker2 # [ 13.822981] dhcpcd[652]: DUID 00:01:00:01:32:42:50:81:52:54:00:12:34:563247worker2 # [ 13.826159] dhcpcd[652]: eth0: IAID 00:12:34:563248worker2 # [ 13.826915] dhcpcd[652]: eth0: adding address fe80::5054:ff:fe12:34563249worker1 # [ 13.797294] systemd[1]: Started D-Bus System Message Bus.3250worker1 # [ 13.849090] systemd-logind[596]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3251worker2 # [ 13.920662] mousedev: PS/2 mouse device common for all mice3252worker1 # [ 13.860174] systemd-logind[596]: Watching system buttons on /dev/input/event0 (gpio-keys)3253worker1 # [ 13.862284] systemd-logind[596]: New seat seat0.3254worker1 # [ 13.863337] dbus-broker-launch[575]: Ready3255worker1 # [ 13.872259] systemd[1]: Started User Login Management.3256worker1 # [ 13.878860] systemd[1]: Starting linger-users.service...3257worker1 # [ 13.890853] systemd[1]: Stopped target Host and Network Name Lookups.3258worker1 # [ 13.891952] systemd[1]: Stopping Host and Network Name Lookups...3259lb # [ 13.925242] (udev-worker)[686]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3260worker1 # [ 13.901576] systemd[1]: Stopped target User and Group Name Lookups.3261worker1 # [ 13.902678] systemd[1]: Stopping User and Group Name Lookups...3262worker1 # [ 13.903536] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3263worker1 # [ 13.919571] systemd[1]: nscd.service: Deactivated successfully.3264worker1 # [ 13.929822] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3265worker1 # [ 13.930771] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3266lb # [ 13.964232] (udev-worker)[686]: Network interface NamePolicy= disabled on kernel command line.3267lb # [ 13.984175] (udev-worker)[681]: Network interface NamePolicy= disabled on kernel command line.3268worker2 # [ 14.024492] systemd-logind[521]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3269lb # [ 14.023892] postgresql-pre-start[706]: The files belonging to this database system will be owned by user "postgres".3270worker1 # [ 14.000228] systemd[1]: linger-users.service: Deactivated successfully.3271lb # [ 14.028674] postgresql-pre-start[706]: This user must also own the server process.3272worker1 # [ 14.004590] systemd[1]: Finished linger-users.service.3273lb # [ 14.043014] postgresql-pre-start[706]: The database cluster will be initialized with locale "en_US.UTF-8".3274lb # [ 14.045845] postgresql-pre-start[706]: The default database encoding has accordingly been set to "UTF8".3275lb # [ 14.050170] postgresql-pre-start[706]: The default text search configuration will be set to "english".3276worker1 # [ 14.026351] systemd[1]: Started Name Service Cache Daemon (nsncd).3277lb # [ 14.054395] postgresql-pre-start[706]: Data page checksums are enabled.3278lb # [ 14.057091] postgresql-pre-start[706]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3279worker1 # [ 14.030829] nsncd[642]: Sep 20 08:06:25.481 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3280lb # [ 14.062984] postgresql-pre-start[706]: creating subdirectories ... ok3281worker1 # [ 14.037266] systemd[1]: Reached target Host and Network Name Lookups.3282lb # [ 14.063992] postgresql-pre-start[706]: selecting dynamic shared memory implementation ... posix3283worker1 # [ 14.041211] systemd[1]: Reached target User and Group Name Lookups.3284worker1 # [ 14.071869] systemd[1]: Finished resolvconf update.3285worker1 # [ 14.074069] systemd[1]: Reached target Preparation for Network.3286worker1 # [ 14.079097] systemd[1]: Starting DHCP Client...3287worker1 # [ 14.083977] systemd[1]: Starting Address configuration of eth1...3288worker1 # [ 14.091285] systemd[1]: Starting Extra networking commands....3289lb # [ 14.275630] postgresql-pre-start[706]: selecting default "max_connections" ... 1003290worker1 # [ 14.273904] network-addresses-eth1-start[671]: adding address 192.168.1.3/24... done3291worker1 # [ 14.308124] network-addresses-eth1-start[671]: adding address 2001:db8:1::3/64... done3292worker1 # [ 14.349453] systemd[1]: Finished Address configuration of eth1.3293lb # [ 14.392701] systemd[1]: Condition check resulted in Virtio network device being skipped.3294lb # [ 14.402586] systemd[1]: Starting Address configuration of eth1...3295lb # [ 14.412726] systemd-logind[527]: Watching system buttons on /dev/input/event0 (gpio-keys)3296worker1 # [ 14.402627] dhcpcd[679]: dhcpcd-10.3.2 starting3297worker1 # [ 14.425205] dhcpcd[718]: dev: loaded udev3298worker1 # [ 14.480744] 8021q: 802.1Q VLAN Support v1.83299worker1 # [ 14.481205] 8021q: adding VLAN 0 to HW filter on device eth13300client # [ 14.503707] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33301lb # [ 14.532232] postgresql-pre-start[706]: selecting default "shared_buffers" ... 128MB3302worker1 # [ 14.532346] systemd[1]: Finished Extra networking commands..3303worker1 # [ 14.533311] systemd[1]: Reached target Network.3304worker1 # [ 14.544108] systemd[1]: Starting Permit User Sessions...3305lb # [ 14.593567] 8021q: adding VLAN 0 to HW filter on device eth13306worker1 # [ 14.585866] cfg80211: Loading compiled-in X.509 certificates for regulatory database3307lb # [ 14.622820] 8021q: adding VLAN 0 to HW filter on device eth03308lb # [ 14.609597] dhcpcd[673]: eth0: waiting for carrier3309lb # [ 14.614972] dhcpcd[673]: eth0: carrier acquired3310lb # [ 14.621909] network-addresses-eth1-start[731]: adding address 192.168.1.2/24... done3311worker1 # [ 14.624821] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3312worker1 # [ 14.625354] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3313lb # [ 14.638120] dhcpcd[673]: DUID 00:01:00:01:32:42:50:82:52:54:00:12:34:563314worker1 # [ 14.630832] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23315worker1 # [ 14.631215] cfg80211: failed to load regulatory.db3316lb # [ 14.643468] dhcpcd[673]: eth0: IAID 00:12:34:563317lb # [ 14.647483] dhcpcd[673]: eth0: adding address fe80::5054:ff:fe12:34563318lb # [ 14.652359] network-addresses-eth1-start[731]: adding address 2001:db8:1::2/64... done3319worker1 # [ 14.647788] systemd[1]: Finished Permit User Sessions.3320worker1 # [ 14.653452] systemd[1]: Started Getty on tty1.3321lb # [ 14.680835] systemd[1]: Finished Address configuration of eth1.3322worker1 # [ 14.655259] systemd[1]: Reached target Login Prompts.3323worker2 # [ 14.727210] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33324lb # [ 14.737863] mousedev: PS/2 mouse device common for all mice3325worker1 # [ 14.744774] 8021q: adding VLAN 0 to HW filter on device eth03326worker1 # [ 14.731112] dhcpcd[718]: eth0: waiting for carrier3327worker1 # [ 14.733736] dhcpcd[718]: libudev: received NULL device3328worker1 # [ 14.735930] dhcpcd[718]: libudev: received NULL device3329worker1 # [ 14.738479] dhcpcd[718]: eth0: carrier acquired3330worker1 # [ 14.754073] dhcpcd[718]: DUID 00:01:00:01:32:42:50:82:52:54:00:12:34:563331worker1 # [ 14.755140] dhcpcd[718]: eth0: IAID 00:12:34:563332worker1 # [ 14.755794] dhcpcd[718]: eth0: adding address fe80::5054:ff:fe12:34563333client # [ 14.826489] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3334client # [ 14.835873] systemd[1]: Starting Virtual Console Setup...3335client # [ 14.866753] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3336client # [ 14.869590] systemd[1]: Stopped Virtual Console Setup.3337client # [ 14.879034] systemd[1]: Starting Virtual Console Setup...3338lb # [ 14.939603] systemd-logind[527]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3339client # [ 14.927090] systemd-logind[433]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3340worker2 # [ 15.048907] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3341worker2 # [ 15.062184] systemd[1]: Starting Virtual Console Setup...3342worker2 # [ 15.094768] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3343worker1 # [ 15.054903] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33344worker2 # [ 15.095926] systemd[1]: Stopped Virtual Console Setup.3345lb: (finished: waiting for unit network-addresses-eth1.service, in 1.32 seconds)3346worker2 # [ 15.101290] systemd[1]: Starting Virtual Console Setup...3347lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3348worker2 # [ 15.159324] systemd-logind[521]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3349lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.06 seconds)3350worker1: waiting for unit network-addresses-eth1.service3351worker1: waiting for the VM to finish booting3352worker1: Guest shell says: b'Spawning backdoor root shell...\n'3353worker1: connected to guest root shell3354worker1: (connecting took 0.00 seconds)3355worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3356worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds)3357worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3358worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.06 seconds)3359worker2: waiting for unit network-addresses-eth1.service3360worker2: waiting for the VM to finish booting3361worker2: Guest shell says: b'Spawning backdoor root shell...\n'3362worker2: connected to guest root shell3363worker2: (connecting took 0.00 seconds)3364worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3365client # [ 15.341696] systemd-vconsole-setup[649]: Configuration of first virtual console was skipped, ignoring remaining ones.3366client # [ 15.345338] systemd[1]: Finished Virtual Console Setup.3367worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds)3368worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3369worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3370lb: waiting for unit niks3.service3371worker1 # [ 15.452851] systemd[1]: Starting Virtual Console Setup...3372worker1 # [ 15.481791] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3373worker1 # [ 15.482999] systemd[1]: Stopped Virtual Console Setup.3374worker1 # [ 15.490134] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3375worker1 # [ 15.491367] systemd[1]: Starting Virtual Console Setup...3376client # [ 15.491058] dhcpcd[548]: eth0: soliciting an IPv6 router3377client # [ 15.495040] dhcpcd[548]: eth0: Router Advertisement from fe80::23378client # [ 15.497779] dhcpcd[548]: eth0: adding address fec0::5054:ff:fe12:3456/643379client # [ 15.500653] dhcpcd[548]: eth0: adding route to fec0::/643380client # [ 15.502902] dhcpcd[548]: eth0: adding default route via fe80::23381worker2 # [ 15.594736] systemd-vconsole-setup[700]: Configuration of first virtual console was skipped, ignoring remaining ones.3382worker2 # [ 15.600273] systemd[1]: Finished Virtual Console Setup.3383worker1 # [ 15.551013] systemd-logind[596]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3384lb # [ 15.686402] dhcpcd[673]: eth0: soliciting a DHCP lease3385lb # [ 15.692594] dhcpcd[673]: eth0: offered 10.0.2.15 from 10.0.2.23386lb # [ 15.700292] dhcpcd[673]: eth0: probing address 10.0.2.15/243387worker2 # [ 15.780589] dhcpcd[652]: eth0: soliciting a DHCP lease3388worker2 # [ 15.784213] dhcpcd[652]: eth0: offered 10.0.2.15 from 10.0.2.23389worker2 # [ 15.792602] dhcpcd[652]: eth0: probing address 10.0.2.15/243390worker2 # [ 15.800224] dhcpcd[652]: eth0: soliciting an IPv6 router3391worker2 # [ 15.803886] dhcpcd[652]: eth0: Router Advertisement from fe80::23392worker2 # [ 15.806758] dhcpcd[652]: eth0: adding address fec0::5054:ff:fe12:3456/643393worker2 # [ 15.809670] dhcpcd[652]: eth0: adding route to fec0::/643394worker2 # [ 15.811913] dhcpcd[652]: eth0: adding default route via fe80::23395worker1 # [ 15.803090] dhcpcd[718]: eth0: soliciting a DHCP lease3396worker1 # [ 15.808618] dhcpcd[718]: eth0: offered 10.0.2.15 from 10.0.2.23397worker1 # [ 15.816339] dhcpcd[718]: eth0: probing address 10.0.2.15/243398worker1 # [ 15.965361] systemd-vconsole-setup[768]: Configuration of first virtual console was skipped, ignoring remaining ones.3399worker1 # [ 15.970845] systemd[1]: Finished Virtual Console Setup.3400lb # [ 16.150551] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33401worker1 # [ 16.416833] dhcpcd[718]: eth0: soliciting an IPv6 router3402worker1 # [ 16.420951] dhcpcd[718]: eth0: Router Advertisement from fe80::23403worker1 # [ 16.423729] dhcpcd[718]: eth0: adding address fec0::5054:ff:fe12:3456/643404worker1 # [ 16.426726] dhcpcd[718]: eth0: adding route to fec0::/643405worker1 # [ 16.429162] dhcpcd[718]: eth0: adding default route via fe80::23406lb # [ 16.597098] dhcpcd[673]: eth0: soliciting an IPv6 router3407lb # [ 16.598802] dhcpcd[673]: eth0: Router Advertisement from fe80::23408lb # [ 16.604247] dhcpcd[673]: eth0: adding address fec0::5054:ff:fe12:3456/643409lb # [ 16.605381] dhcpcd[673]: eth0: adding route to fec0::/643410lb # [ 16.606120] dhcpcd[673]: eth0: adding default route via fe80::23411lb # [ 16.847425] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3412lb # [ 16.869089] systemd[1]: Starting Virtual Console Setup...3413lb # [ 16.903748] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3414lb # [ 16.907126] systemd[1]: Stopped Virtual Console Setup.3415lb # [ 16.920204] systemd[1]: Starting Virtual Console Setup...3416lb # [ 16.990915] systemd-logind[527]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3417lb # [ 17.377158] systemd-vconsole-setup[794]: Configuration of first virtual console was skipped, ignoring remaining ones.3418lb # [ 17.382314] systemd[1]: Finished Virtual Console Setup.3419lb # [ 17.426098] postgresql-pre-start[706]: selecting default time zone ... UTC3420lb # [ 17.431072] postgresql-pre-start[706]: creating configuration files ... ok3421lb # [ 17.747411] postgresql-pre-start[706]: running bootstrap script ... ok3422lb # [ 18.554021] postgresql-pre-start[706]: performing post-bootstrap initialization ... ok3423lb # [ 18.741229] postgresql-pre-start[706]: syncing data to disk ... ok3424client # [ 18.705524] dhcpcd[548]: eth0: leased 10.0.2.15 for 86400 seconds3425lb # [ 18.743557] postgresql-pre-start[706]: initdb: warning: enabling "trust" authentication for local connections3426client # [ 18.705974] dhcpcd[548]: eth0: adding route to 10.0.2.0/243427lb # [ 18.746780] postgresql-pre-start[706]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3428client # [ 18.706125] dhcpcd[548]: eth0: adding default route via 10.0.2.23429lb # [ 18.749170] postgresql-pre-start[706]: Success. You can now start the database server using:3430lb # [ 18.750366] postgresql-pre-start[706]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3431lb # [ 18.898590] postgres[818]: [818] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3432lb # [ 18.903694] postgres[818]: [818] LOG: listening on IPv6 address "::1", port 54323433lb # [ 18.905373] postgres[818]: [818] LOG: listening on IPv4 address "127.0.0.1", port 54323434lb # [ 18.907560] postgres[818]: [818] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3435lb # [ 18.927967] postgres[831]: [831] LOG: database system was shut down at 2026-09-20 08:06:29 GMT3436lb # [ 18.939485] postgres[818]: [818] LOG: database system is ready to accept connections3437lb # [ 18.947769] systemd[1]: Started PostgreSQL Server.3438lb # [ 18.955882] systemd[1]: Starting PostgreSQL Setup Scripts...3439client # [ 18.936306] systemd[1]: Started DHCP Client.3440client # [ 18.938494] systemd[1]: Reached target Multi-User System.3441client # [ 18.939618] systemd[1]: Startup finished in 1.135s (kernel) + 5.487s (initrd) + 12.316s (userspace) = 18.939s.3442lb # [ 19.234616] postgresql-setup-start[847]: CREATE DATABASE3443lb # [ 19.294669] postgresql-setup-start[852]: CREATE ROLE3444lb # [ 19.324385] postgresql-setup-start[854]: ALTER DATABASE3445lb # [ 19.333404] systemd[1]: Finished PostgreSQL Setup Scripts.3446lb # [ 19.335606] systemd[1]: Reached target PostgreSQL.3447lb # [ 20.432397] dhcpcd[673]: eth0: leased 10.0.2.15 for 86400 seconds3448lb # [ 20.433053] dhcpcd[673]: eth0: adding route to 10.0.2.0/243449lb # [ 20.433115] dhcpcd[673]: eth0: adding default route via 10.0.2.23450lb # [ 20.618761] systemd[1]: Started DHCP Client.3451lb # [ 20.622185] systemd[1]: Reached target Network is Online.3452lb # [ 20.628554] systemd[1]: Started Envoy reverse proxy.3453lb # [ 20.633110] systemd[1]: Started mock-oidc.service.3454lb # [ 20.746126] mock-oidc-server[923]: Mock OIDC Server running3455lb # [ 20.747072] mock-oidc-server[923]: OIDC Address: 192.168.1.2:80803456lb # [ 20.747922] mock-oidc-server[923]: Issue Address: 0.0.0.0:80813457lb # [ 20.749421] mock-oidc-server[923]: Issuer: http://192.168.1.2:8080/oidc3458lb # [ 20.750580] mock-oidc-server[923]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3459lb # [ 20.752163] mock-oidc-server[923]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3460lb # [ 20.753669] mock-oidc-server[923]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3461worker2 # [ 21.094446] dhcpcd[652]: eth0: leased 10.0.2.15 for 86400 seconds3462worker2 # [ 21.099432] dhcpcd[652]: eth0: adding route to 10.0.2.0/243463worker2 # [ 21.102967] dhcpcd[652]: eth0: adding default route via 10.0.2.23464worker1 # [ 21.186515] dhcpcd[718]: eth0: leased 10.0.2.15 for 86400 seconds3465worker1 # [ 21.191337] dhcpcd[718]: eth0: adding route to 10.0.2.0/243466worker1 # [ 21.195443] dhcpcd[718]: eth0: adding default route via 10.0.2.23467worker2 # [ 21.291219] systemd[1]: Started DHCP Client.3468worker2 # [ 21.293553] systemd[1]: Reached target Multi-User System.3469worker2 # [ 21.294510] systemd[1]: Startup finished in 1.113s (kernel) + 5.649s (initrd) + 14.529s (userspace) = 21.293s.3470lb # [ 21.431445] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3471lb # [ 21.431628] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:469] statically linked extensions:3472lb # [ 21.431668] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3473worker1 # [ 21.429024] systemd[1]: Started DHCP Client.3474worker1 # [ 21.430860] systemd[1]: Reached target Multi-User System.3475worker1 # [ 21.431728] systemd[1]: Startup finished in 1.124s (kernel) + 5.505s (initrd) + 14.800s (userspace) = 21.430s.3476lb # [ 21.431762] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3477lb # [ 21.481245] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3478lb # [ 21.488503] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13479lb # [ 21.490666] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3480lb # [ 21.492947] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3481lb # [ 21.495099] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3482lb # [ 21.497713] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3483lb # [ 21.501752] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3484lb # [ 21.504216] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3485lb # [ 21.506731] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3486lb # [ 21.510961] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3487lb # [ 21.513438] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3488lb # [ 21.517044] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3489lb # [ 21.519295] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3490lb # [ 21.522177] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3491lb # [ 21.523918] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83492lb # [ 21.526254] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3493lb # [ 21.530797] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3494lb # [ 21.535261] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3495lb # [ 21.537223] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3496lb # [ 21.540432] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3497lb # [ 21.544115] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3498lb # [ 21.546422] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3499lb # [ 21.550574] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3500lb # [ 21.553388] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3501lb # [ 21.555642] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3502lb # [ 21.559022] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3503lb # [ 21.563835] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3504lb # [ 21.567868] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3505lb # [ 21.570907] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3506lb # [ 21.575499] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3507lb # [ 21.578074] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3508lb # [ 21.583534] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3509lb # [ 21.587392] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3510lb # [ 21.590345] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3511lb # [ 21.598934] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3512lb # [ 21.606015] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3513lb # [ 21.608360] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3514lb # [ 21.610315] envoy[922]: [2026-09-20 08:06:32.891][922][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3515lb # [ 21.612817] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3516lb # [ 21.614685] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3517lb # [ 21.619954] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3518lb # [ 21.623260] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3519lb # [ 21.626634] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23520lb # [ 21.629542] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3521lb # [ 21.632057] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3522lb # [ 21.636852] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23523lb # [ 21.638955] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3524lb # [ 21.645461] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3525lb # [ 21.647392] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3526lb # [ 21.650973] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3527lb # [ 21.654715] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3528lb # [ 21.657535] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3529lb # [ 21.660366] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3530lb # [ 21.663005] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3531lb # [ 21.664931] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3532lb # [ 21.667191] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3533lb # [ 21.670057] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3534lb # [ 21.673313] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3535lb # [ 21.675191] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3536lb # [ 21.677527] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3537lb # [ 21.680368] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3538lb # [ 21.682473] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3539lb # [ 21.685176] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3540lb # [ 21.687199] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23541lb # [ 21.689180] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3542lb # [ 21.692842] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3543lb # [ 21.694764] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3544lb # [ 21.702591] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3545lb # [ 21.710113] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3546lb # [ 21.713207] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3547lb # [ 21.718557] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3548lb # [ 21.720438] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3549lb # [ 21.723011] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3550lb # [ 21.725397] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3551lb # [ 21.727364] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3552lb # [ 21.730066] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3553lb # [ 21.742794] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3554lb # [ 21.746286] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3555lb # [ 21.751995] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3556lb # [ 21.757687] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3557lb # [ 21.760999] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3558lb # [ 21.764130] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3559lb # [ 21.766328] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3560lb # [ 21.768255] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3561lb # [ 21.776197] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3562lb # [ 21.778224] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3563lb # [ 21.783245] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3564lb # [ 21.792468] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3565lb # [ 21.795212] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3566lb # [ 21.798580] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3567lb # [ 21.812962] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3568lb # [ 21.814848] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3569lb # [ 21.817303] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3570lb # [ 21.819293] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3571lb # [ 21.821534] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3572lb # [ 21.823309] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3573lb # [ 21.825960] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3574lb # [ 21.827960] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3575lb # [ 21.829855] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3576lb # [ 21.831898] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3577lb # [ 21.834515] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3578lb # [ 21.840170] envoy[922]: [2026-09-20 08:06:32.892][922][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3579lb # [ 21.841971] envoy[922]: [2026-09-20 08:06:32.940][922][info][main] [source/server/server.cc:531] HTTP header map info:3580lb # [ 21.843631] envoy[922]: [2026-09-20 08:06:32.949][922][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3581lb # [ 21.860065] envoy[922]: [2026-09-20 08:06:32.949][922][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3582lb # [ 21.861782] envoy[922]: [2026-09-20 08:06:32.949][922][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3583lb # [ 21.871237] envoy[922]: [2026-09-20 08:06:32.949][922][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3584lb # [ 21.873295] envoy[922]: [2026-09-20 08:06:33.184][922][info][main] [source/server/server.cc:968] runtime: {}3585lb # [ 21.874664] envoy[922]: [2026-09-20 08:06:33.213][922][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3586lb # [ 21.876510] envoy[922]: [2026-09-20 08:06:33.213][922][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013587lb # [ 21.878622] envoy[922]: [2026-09-20 08:06:33.213][922][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013588lb # [ 21.880517] envoy[922]: [2026-09-20 08:06:33.225][922][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3589lb # [ 21.882251] envoy[922]: [2026-09-20 08:06:33.225][922][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3590lb # [ 21.883955] envoy[922]: [2026-09-20 08:06:33.225][922][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3591lb # [ 21.914309] envoy[922]: [2026-09-20 08:06:33.375][922][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3592lb # [ 21.924954] envoy[922]: [2026-09-20 08:06:33.386][922][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3593worker1 # [ 21.898253] systemd[1]: Starting Nix worker-protocol over gRPC...3594lb # [ 21.927936] envoy[922]: [2026-09-20 08:06:33.389][922][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3595worker2 # [ 21.957225] systemd[1]: Starting Nix worker-protocol over gRPC...3596lb # [ 21.931621] envoy[922]: [2026-09-20 08:06:33.389][922][info][main] [source/server/server.cc:1077] starting main dispatch loop3597worker1 # [ 22.188243] nix-grpc-daemon[833]: ts=2026-09-20T08:06:33Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3598worker2 # [ 22.254129] nix-grpc-daemon[774]: ts=2026-09-20T08:06:33Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3599worker1 # [ 22.200986] nix-grpc-daemon[833]: ts=2026-09-20T08:06:33Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13600worker2 # [ 22.266847] nix-grpc-daemon[774]: ts=2026-09-20T08:06:33Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13601worker1 # [ 22.253713] nix-grpc-daemon[833]: ts=2026-09-20T08:06:33Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3602worker1 # [ 22.255605] systemd[1]: Started Nix worker-protocol over gRPC.3603worker2 # [ 22.315666] nix-grpc-daemon[774]: ts=2026-09-20T08:06:33Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3604worker2 # [ 22.325234] systemd[1]: Started Nix worker-protocol over gRPC.3605worker1 # [ 22.279438] nix-grpc-daemon[833]: ts=2026-09-20T08:06:33Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3606worker2 # [ 22.341430] nix-grpc-daemon[774]: ts=2026-09-20T08:06:33Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3607lb # [ 22.338717] envoy[922]: [2026-09-20 08:06:33.799][922][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3608lb # [ 22.348549] envoy[922]: [2026-09-20 08:06:33.799][922][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3609lb # [ 22.351539] envoy[922]: [2026-09-20 08:06:33.799][922][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3610lb # [ 22.355056] envoy[922]: [2026-09-20 08:06:33.799][922][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3611worker1 # [ 22.480909] nix-grpc-daemon[833]: ts=2026-09-20T08:06:33Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3612worker2 # [ 22.542510] nix-grpc-daemon[774]: ts=2026-09-20T08:06:34Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3613worker1 # [ 22.880695] nix-grpc-daemon[833]: ts=2026-09-20T08:06:34Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3614worker2 # [ 22.943302] nix-grpc-daemon[774]: ts=2026-09-20T08:06:34Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3615worker1 # [ 23.683400] nix-grpc-daemon[833]: ts=2026-09-20T08:06:35Z level=info event=scheduler_connected addr=lb:500513616worker2 # [ 23.749768] nix-grpc-daemon[774]: ts=2026-09-20T08:06:35Z level=info event=scheduler_connected addr=lb:500513617worker2 # [ 23.761645] nix-grpc-daemon[774]: ts=2026-09-20T08:06:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3618worker1 # [ 23.710804] nix-grpc-daemon[833]: ts=2026-09-20T08:06:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3619worker2 # [ 23.963460] nix-grpc-daemon[774]: ts=2026-09-20T08:06:35Z level=info event=scheduler_connected addr=lb:500513620worker1 # [ 23.914267] nix-grpc-daemon[833]: ts=2026-09-20T08:06:35Z level=info event=scheduler_connected addr=lb:500513621worker2 # [ 23.971298] nix-grpc-daemon[774]: ts=2026-09-20T08:06:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3622worker1 # [ 23.920692] nix-grpc-daemon[833]: ts=2026-09-20T08:06:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3623worker2 # [ 24.172274] nix-grpc-daemon[774]: ts=2026-09-20T08:06:35Z level=info event=scheduler_connected addr=lb:500513624worker1 # [ 24.130526] nix-grpc-daemon[833]: ts=2026-09-20T08:06:35Z level=info event=scheduler_connected addr=lb:500513625worker2 # [ 24.185486] nix-grpc-daemon[774]: ts=2026-09-20T08:06:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3626worker1 # [ 24.145516] nix-grpc-daemon[833]: ts=2026-09-20T08:06:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3627worker1 # [ 24.395436] nix-grpc-daemon[833]: ts=2026-09-20T08:06:35Z level=info event=scheduler_connected addr=lb:500513628worker2 # [ 24.406656] nix-grpc-daemon[774]: ts=2026-09-20T08:06:35Z level=info event=scheduler_connected addr=lb:500513629worker1 # [ 24.409862] nix-grpc-daemon[833]: ts=2026-09-20T08:06:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3630worker2 # [ 24.465730] nix-grpc-daemon[774]: ts=2026-09-20T08:06:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3631worker1 # [ 24.611309] nix-grpc-daemon[833]: ts=2026-09-20T08:06:36Z level=info event=scheduler_connected addr=lb:500513632worker1 # [ 24.615524] nix-grpc-daemon[833]: ts=2026-09-20T08:06:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3633worker2 # [ 24.667325] nix-grpc-daemon[774]: ts=2026-09-20T08:06:36Z level=info event=scheduler_connected addr=lb:500513634worker2 # [ 24.674731] nix-grpc-daemon[774]: ts=2026-09-20T08:06:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3635worker1 # [ 24.820429] nix-grpc-daemon[833]: ts=2026-09-20T08:06:36Z level=info event=scheduler_connected addr=lb:500513636worker2 # [ 24.879751] nix-grpc-daemon[774]: ts=2026-09-20T08:06:36Z level=info event=scheduler_connected addr=lb:500513637worker1 # [ 24.827507] nix-grpc-daemon[833]: ts=2026-09-20T08:06:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3638worker2 # [ 24.884429] nix-grpc-daemon[774]: ts=2026-09-20T08:06:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3639worker2 # [ 25.080700] nix-grpc-daemon[774]: ts=2026-09-20T08:06:36Z level=info event=scheduler_connected addr=lb:500513640worker1 # [ 25.028774] nix-grpc-daemon[833]: ts=2026-09-20T08:06:36Z level=info event=scheduler_connected addr=lb:500513641worker2 # [ 25.090237] nix-grpc-daemon[774]: ts=2026-09-20T08:06:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3642worker1 # [ 25.036413] nix-grpc-daemon[833]: ts=2026-09-20T08:06:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3643worker1 # [ 25.237089] nix-grpc-daemon[833]: ts=2026-09-20T08:06:36Z level=info event=scheduler_connected addr=lb:500513644worker2 # [ 25.291867] nix-grpc-daemon[774]: ts=2026-09-20T08:06:36Z level=info event=scheduler_connected addr=lb:500513645worker1 # [ 25.245047] nix-grpc-daemon[833]: ts=2026-09-20T08:06:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3646worker2 # [ 25.299367] nix-grpc-daemon[774]: ts=2026-09-20T08:06:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3647worker1 # [ 25.446933] nix-grpc-daemon[833]: ts=2026-09-20T08:06:36Z level=info event=scheduler_connected addr=lb:500513648worker2 # [ 25.501103] nix-grpc-daemon[774]: ts=2026-09-20T08:06:36Z level=info event=scheduler_connected addr=lb:500513649worker2 # [ 25.509183] nix-grpc-daemon[774]: ts=2026-09-20T08:06:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3650worker1 # [ 25.455100] nix-grpc-daemon[833]: ts=2026-09-20T08:06:36Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3651worker1 # [ 25.656868] nix-grpc-daemon[833]: ts=2026-09-20T08:06:37Z level=info event=scheduler_connected addr=lb:500513652worker2 # [ 25.710908] nix-grpc-daemon[774]: ts=2026-09-20T08:06:37Z level=info event=scheduler_connected addr=lb:500513653worker2 # [ 25.719218] nix-grpc-daemon[774]: ts=2026-09-20T08:06:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3654worker1 # [ 25.665175] nix-grpc-daemon[833]: ts=2026-09-20T08:06:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3655worker1 # [ 25.868363] nix-grpc-daemon[833]: ts=2026-09-20T08:06:37Z level=info event=scheduler_connected addr=lb:500513656worker2 # [ 25.922092] nix-grpc-daemon[774]: ts=2026-09-20T08:06:37Z level=info event=scheduler_connected addr=lb:500513657worker2 # [ 25.929604] nix-grpc-daemon[774]: ts=2026-09-20T08:06:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3658worker1 # [ 25.875441] nix-grpc-daemon[833]: ts=2026-09-20T08:06:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3659worker1 # [ 26.076982] nix-grpc-daemon[833]: ts=2026-09-20T08:06:37Z level=info event=scheduler_connected addr=lb:500513660worker2 # [ 26.131228] nix-grpc-daemon[774]: ts=2026-09-20T08:06:37Z level=info event=scheduler_connected addr=lb:500513661worker2 # [ 26.139247] nix-grpc-daemon[774]: ts=2026-09-20T08:06:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3662worker1 # [ 26.085256] nix-grpc-daemon[833]: ts=2026-09-20T08:06:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3663worker1 # [ 26.286952] nix-grpc-daemon[833]: ts=2026-09-20T08:06:37Z level=info event=scheduler_connected addr=lb:500513664worker2 # [ 26.340674] nix-grpc-daemon[774]: ts=2026-09-20T08:06:37Z level=info event=scheduler_connected addr=lb:500513665worker1 # [ 26.294339] nix-grpc-daemon[833]: ts=2026-09-20T08:06:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3666worker2 # [ 26.348812] nix-grpc-daemon[774]: ts=2026-09-20T08:06:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3667worker2 # [ 26.550393] nix-grpc-daemon[774]: ts=2026-09-20T08:06:38Z level=info event=scheduler_connected addr=lb:500513668worker1 # [ 26.495211] nix-grpc-daemon[833]: ts=2026-09-20T08:06:37Z level=info event=scheduler_connected addr=lb:500513669worker1 # [ 26.503347] nix-grpc-daemon[833]: ts=2026-09-20T08:06:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3670worker2 # [ 26.558010] nix-grpc-daemon[774]: ts=2026-09-20T08:06:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3671worker1 # [ 26.704840] nix-grpc-daemon[833]: ts=2026-09-20T08:06:38Z level=info event=scheduler_connected addr=lb:500513672worker2 # [ 26.759449] nix-grpc-daemon[774]: ts=2026-09-20T08:06:38Z level=info event=scheduler_connected addr=lb:500513673worker2 # [ 26.766768] nix-grpc-daemon[774]: ts=2026-09-20T08:06:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3674worker1 # [ 26.712896] nix-grpc-daemon[833]: ts=2026-09-20T08:06:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3675worker2 # [ 26.968659] nix-grpc-daemon[774]: ts=2026-09-20T08:06:38Z level=info event=scheduler_connected addr=lb:500513676worker2 # [ 26.972734] nix-grpc-daemon[774]: ts=2026-09-20T08:06:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3677worker1 # [ 26.917424] nix-grpc-daemon[833]: ts=2026-09-20T08:06:38Z level=info event=scheduler_connected addr=lb:500513678worker1 # [ 26.923271] nix-grpc-daemon[833]: ts=2026-09-20T08:06:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3679worker2 # [ 27.173482] nix-grpc-daemon[774]: ts=2026-09-20T08:06:38Z level=info event=scheduler_connected addr=lb:500513680worker1 # [ 27.124585] nix-grpc-daemon[833]: ts=2026-09-20T08:06:38Z level=info event=scheduler_connected addr=lb:500513681worker1 # [ 27.131611] nix-grpc-daemon[833]: ts=2026-09-20T08:06:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3682worker2 # [ 27.187052] nix-grpc-daemon[774]: ts=2026-09-20T08:06:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3683lb # [ 27.339762] rustfs-bucket-start[994]: mb s3://farm3684lb # [ 27.351650] systemd[1]: Finished rustfs-bucket.service.3685worker1 # [ 27.332699] nix-grpc-daemon[833]: ts=2026-09-20T08:06:38Z level=info event=scheduler_connected addr=lb:500513686worker2 # [ 27.390109] nix-grpc-daemon[774]: ts=2026-09-20T08:06:38Z level=info event=scheduler_connected addr=lb:500513687worker1 # [ 27.338936] nix-grpc-daemon[833]: ts=2026-09-20T08:06:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3688lb # [ 27.371139] systemd[1]: Starting niks3 server...3689worker2 # [ 27.397777] nix-grpc-daemon[774]: ts=2026-09-20T08:06:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3690worker1 # [ 27.540406] nix-grpc-daemon[833]: ts=2026-09-20T08:06:38Z level=info event=scheduler_connected addr=lb:500513691worker2 # [ 27.598988] nix-grpc-daemon[774]: ts=2026-09-20T08:06:39Z level=info event=scheduler_connected addr=lb:500513692worker1 # [ 27.548209] nix-grpc-daemon[833]: ts=2026-09-20T08:06:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3693worker2 # [ 27.606259] nix-grpc-daemon[774]: ts=2026-09-20T08:06:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3694lb # [ 27.636375] postgres[1009]: [1009] ERROR: relation "goose_db_version" does not exist at character 363695lb # [ 27.637802] postgres[1009]: [1009] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3696lb # [ 27.679809] niks3-server[1004]: 2026/09/20 08:06:39 OK 20241026095416_initial_model.sql (27.3ms)3697lb # [ 27.683722] niks3-server[1004]: 2026/09/20 08:06:39 OK 20251210153512_drop_unused_gin_index.sql (4.31ms)3698lb # [ 27.690558] niks3-server[1004]: 2026/09/20 08:06:39 OK 20251218171726_add_pins.sql (6.73ms)3699lb # [ 27.696584] niks3-server[1004]: 2026/09/20 08:06:39 OK 20260628120000_add_object_size_and_stats.sql (5.99ms)3700lb # [ 27.703451] niks3-server[1004]: 2026/09/20 08:06:39 OK 20260905000000_add_claims.sql (6.82ms)3701lb # [ 27.709006] niks3-server[1004]: 2026/09/20 08:06:39 OK 20260920000000_drop_claims.sql (5.39ms)3702lb # [ 27.710369] niks3-server[1004]: 2026/09/20 08:06:39 goose: successfully migrated database to version: 202609200000003703lb # [ 27.716365] niks3-server[1004]: 2026/09/20 08:06:39 OK 1_commit_pending_closure.sql (7.32ms)3704lb # [ 27.719776] niks3-server[1004]: 2026/09/20 08:06:39 OK 2_object_stats_trigger.sql (3.24ms)3705lb # [ 27.721464] niks3-server[1004]: 2026/09/20 08:06:39 goose: up to current file version: 23706lb # [ 27.725726] niks3-server[1004]: 2026/09/20 08:06:39 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3707worker1 # [ 27.749655] nix-grpc-daemon[833]: ts=2026-09-20T08:06:39Z level=info event=scheduler_connected addr=lb:500513708lb # [ 27.781023] niks3-server[1004]: 2026/09/20 08:06:39 INFO Read proxy enabled — serving cache objects from S33709worker2 # [ 27.807357] nix-grpc-daemon[774]: ts=2026-09-20T08:06:39Z level=info event=scheduler_connected addr=lb:500513710lb # [ 27.785860] niks3-server[1004]: 2026/09/20 08:06:39 INFO Using socket-activated listener address=0.0.0.0:57513711worker1 # [ 27.757317] nix-grpc-daemon[833]: ts=2026-09-20T08:06:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3712worker2 # [ 27.816683] nix-grpc-daemon[774]: ts=2026-09-20T08:06:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3713lb # [ 27.790974] niks3-server[1004]: 2026/09/20 08:06:39 INFO systemd watchdog enabled interval=15s3714lb # [ 27.795467] systemd[1]: Started niks3 server.3715lb # [ 27.798696] niks3-server[1004]: 2026/09/20 08:06:39 INFO Starting HTTP server address=0.0.0.0:57513716lb # [ 27.804238] systemd[1]: Reached target Multi-User System.3717lb # [ 27.805397] niks3-server[1004]: 2026/09/20 08:06:39 INFO lead: acquired remote=192.168.1.4:455083718worker2 # [ 27.835604] nix-grpc-daemon[774]: ts=2026-09-20T08:06:39Z level=info event=scheduler_take_over3719lb # [ 27.811910] systemd[1]: Startup finished in 1.112s (kernel) + 5.579s (initrd) + 21.102s (userspace) = 27.794s.3720worker1 # [ 27.963302] nix-grpc-daemon[833]: ts=2026-09-20T08:06:39Z level=info event=scheduler_connected addr=lb:500513721worker2 # [ 28.022206] nix-grpc-daemon[774]: ts=2026-09-20T08:06:39Z level=info event=scheduler_connected addr=lb:500513722worker1 # [ 27.967972] nix-grpc-daemon[833]: ts=2026-09-20T08:06:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3723worker2 # [ 28.026716] nix-grpc-daemon[774]: ts=2026-09-20T08:06:39Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03724lb: (finished: waiting for unit niks3.service, in 12.65 seconds)3725lb: waiting for TCP port 5751 on localhost3726lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3727lb: (finished: waiting for TCP port 5751 on localhost, in 0.10 seconds)3728lb: waiting for unit envoy.service3729worker1 # [ 28.164960] nix-grpc-daemon[833]: ts=2026-09-20T08:06:39Z level=info event=scheduler_connected addr=lb:500513730worker1 # [ 28.173233] nix-grpc-daemon[833]: ts=2026-09-20T08:06:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3731lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3732lb: waiting for TCP port 50051 on localhost3733lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3734lb # [ 28.293475] envoy[922]: conn peer=[::1]:58412 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33735lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds)3736worker1 # [ 28.374215] nix-grpc-daemon[833]: ts=2026-09-20T08:06:39Z level=info event=scheduler_connected addr=lb:500513737worker2 # [ 28.432634] nix-grpc-daemon[774]: ts=2026-09-20T08:06:39Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03738lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3739??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3740 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283741lb: must succeed: curl -sf localhost:9901/clusters3742lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)3743lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds)3744subtest: one node schedules and both builders hold a WorkerSession on it3745lb: must succeed: curl -sf localhost:9901/clusters3746lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3747worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true3748worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.11 seconds)3749(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.17 seconds)3750subtest: balancer auth: client cert, bearer token, nothing, unknown CN3751worker1 # [ 29.167594] nix-grpc-daemon[833]: ts=2026-09-20T08:06:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:561743752worker1 # [ 29.185549] systemd[1]: Started Nix Daemon.3753worker1 # [ 29.520746] nix-daemon[889]: accepted connection from pid 833, user nix-grpc-daemon (trusted)3754worker1 # [ 29.561398] nix-grpc-daemon[833]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 1/5)3755worker1 # [ 29.568107] nix-grpc-daemon[833]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 2/5)3756worker1 # [ 29.584262] nix-grpc-daemon[833]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 211 ms (attempt 3/5)3757worker1 # [ 29.799969] nix-grpc-daemon[833]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 281 ms (attempt 4/5)3758worker1 # [ 30.091688] nix-grpc-daemon[833]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3759worker2 # [ 30.198147] nix-grpc-daemon[774]: ts=2026-09-20T08:06:41Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:347763760worker2 # [ 30.221879] systemd[1]: Started Nix Daemon.3761worker2 # [ 30.553791] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3762worker2 # [ 30.584524] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5)3763worker2 # [ 30.639692] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 49 ms (attempt 2/5)3764worker2 # [ 30.692756] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 149 ms (attempt 3/5)3765worker2 # [ 30.847962] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 250 ms (attempt 4/5)3766worker2 # [ 31.108406] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3767worker2 # [ 31.119803] nix-grpc-daemon[774]: ts=2026-09-20T08:06:42Z level=debug event=path_info_miss path=zq7rayhbzisnan6cyg9zvazlkxxaccwa-nixos-system-client-test error="error: path '/nix/store/zq7rayhbzisnan6cyg9zvazlkxxaccwa-nixos-system-client-test' is required, but there is no substituter that can build it"3768worker1 # [ 31.083018] nix-grpc-daemon[833]: ts=2026-09-20T08:06:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:561743769worker1 # [ 31.104284] nix-grpc-daemon[833]: ts=2026-09-20T08:06:42Z level=debug event=path_info_miss path=zq7rayhbzisnan6cyg9zvazlkxxaccwa-nixos-system-client-test error="error: path '/nix/store/zq7rayhbzisnan6cyg9zvazlkxxaccwa-nixos-system-client-test' is required, but there is no substituter that can build it"3770client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3771client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.13 seconds)3772client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3773client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.06 seconds)3774worker2 # [ 31.675986] nix-grpc-daemon[774]: ts=2026-09-20T08:06:43Z level=info event=oidc_jwks provider=mock keys=13775worker2 # [ 31.683568] nix-grpc-daemon[774]: ts=2026-09-20T08:06:43Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:347763776worker1 # [ 31.666704] nix-grpc-daemon[833]: ts=2026-09-20T08:06:43Z level=info event=oidc_jwks provider=mock keys=13777worker1 # [ 31.673669] nix-grpc-daemon[833]: ts=2026-09-20T08:06:43Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:561743778worker1 # [ 31.683185] nix-grpc-daemon[833]: ts=2026-09-20T08:06:43Z level=debug event=path_info_miss path=zq7rayhbzisnan6cyg9zvazlkxxaccwa-nixos-system-client-test error="error: path '/nix/store/zq7rayhbzisnan6cyg9zvazlkxxaccwa-nixos-system-client-test' is required, but there is no substituter that can build it"3779worker1 # [ 31.699847] nix-grpc-daemon[833]: ts=2026-09-20T08:06:43Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:561743780worker1 # [ 31.709179] nix-grpc-daemon[833]: ts=2026-09-20T08:06:43Z level=debug event=path_info_miss path=zq7rayhbzisnan6cyg9zvazlkxxaccwa-nixos-system-client-test error="error: path '/nix/store/zq7rayhbzisnan6cyg9zvazlkxxaccwa-nixos-system-client-test' is required, but there is no substituter that can build it"3781client: must succeed: rm -r /var/lib/nix-grpc-store3782client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds)3783lb # [ 31.916426] envoy[922]: conn peer=[2001:db8:1::1]:57410 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=20033784lb # [ 31.916887] envoy[922]: conn peer=[2001:db8:1::1]:34816 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=1203785worker2 # [ 32.121958] nix-grpc-daemon[774]: ts=2026-09-20T08:06:43Z level=info event=denied method=QueryMissing cn=- role=none3786worker2 # [ 32.410423] nix-grpc-daemon[774]: ts=2026-09-20T08:06:43Z level=info event=denied method=QueryMissing cn=stranger role=none3787(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.63 seconds)3788subtest: DAG build is scheduled across workers and lands in the cache3789client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&23790client # don't know how to build these paths:3791client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3792worker1 # [ 32.643110] nix-grpc-daemon[833]: ts=2026-09-20T08:06:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:561743793worker2 # [ 32.734787] nix-grpc-daemon[774]: ts=2026-09-20T08:06:44Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03794worker2 # [ 32.740760] nix-grpc-daemon[774]: ts=2026-09-20T08:06:44Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=13795worker2 # [ 32.780085] nix-grpc-daemon[774]: ts=2026-09-20T08:06:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347763796worker2 # [ 32.808694] nix-grpc-daemon[774]: ts=2026-09-20T08:06:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347763797client # copying 1 paths to 'lb:50051'...3798worker2 # [ 32.834842] nix-grpc-daemon[774]: ts=2026-09-20T08:06:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347763799client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3800worker2 # [ 32.874586] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3801worker2 # [ 32.919183] nix-grpc-daemon[774]: ts=2026-09-20T08:06:44Z level=info event=niks3_push_started pid=8473802worker2 # [ 33.498573] nix-daemon[835]: accepted connection from pid 860, user nix-grpc-daemon (trusted)3803worker2 # [ 33.523255] nix-daemon[835]: reaped child process 863, status = succeeded3804worker2 # [ 33.748323] nix-daemon[835]: accepted connection from pid 865, user nix-grpc-daemon (trusted)3805worker2 # [ 33.770981] nix-daemon[835]: reaped child process 869, status = succeeded3806lb # [ 33.758936] niks3-server[1004]: 2026/09/20 08:06:45 INFO Received uploads request method=POST path=/api/pending_closures3807worker2 # [ 33.845550] nix-grpc-daemon[847]: time=2026-09-20T08:06:45.301Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3808worker2 # [ 33.847850] nix-grpc-daemon[847]: time=2026-09-20T08:06:45.302Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3809lb # [ 33.890689] niks3-server[1004]: 2026/09/20 08:06:45 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3810lb # [ 33.897423] niks3-server[1004]: 2026/09/20 08:06:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3811lb # [ 33.914041] niks3-server[1004]: 2026/09/20 08:06:45 INFO Signed narinfos id=1 count=13812worker2 # [ 33.944846] nix-grpc-daemon[847]: time=2026-09-20T08:06:45.403Z level=INFO msg="Uploading 1 narinfos"3813lb # [ 33.950452] niks3-server[1004]: 2026/09/20 08:06:45 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3814lb # [ 33.972080] niks3-server[1004]: 2026/09/20 08:06:45 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3815lb # [ 33.980003] niks3-server[1004]: 2026/09/20 08:06:45 INFO Completed upload id=13816worker2 # [ 34.007652] nix-grpc-daemon[847]: time=2026-09-20T08:06:45.467Z level=INFO msg="Upload complete. (739ms)"3817worker2 # [ 34.021309] nix-grpc-daemon[774]: ts=2026-09-20T08:06:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=1 paths=1 nar_bytes_in=5043818worker2 # [ 34.037285] nix-grpc-daemon[847]: time=2026-09-20T08:06:45.473Z level=WARN msg="Failed to register uploaded object" key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo error="server returned 404: object is not pending upload\n"3819worker2 # [ 34.060804] nix-grpc-daemon[774]: ts=2026-09-20T08:06:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347763820worker2 # [ 34.073146] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3821client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3822client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3823worker2 # [ 34.080138] nix-daemon[835]: reaped child process 845, status = succeeded3824worker2 # [ 34.088786] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3825client # farm-a> LOG-farm-a-t13826worker2 # [ 35.718393] nix-daemon[835]: reaped child process 873, status = succeeded3827worker2 # [ 35.913955] nix-daemon[835]: accepted connection from pid 888, user nix-grpc-daemon (trusted)3828worker2 # [ 35.937129] nix-daemon[835]: reaped child process 891, status = succeeded3829lb # [ 35.927905] niks3-server[1004]: 2026/09/20 08:06:47 INFO Received uploads request method=POST path=/api/pending_closures3830worker2 # [ 35.975421] nix-grpc-daemon[847]: time=2026-09-20T08:06:47.434Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3831worker2 # [ 35.978519] nix-grpc-daemon[847]: time=2026-09-20T08:06:47.437Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3832lb # [ 36.020622] niks3-server[1004]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3833lb # [ 36.034461] niks3-server[1004]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3834lb # [ 36.045423] niks3-server[1004]: 2026/09/20 08:06:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3835worker2 # [ 36.072221] nix-grpc-daemon[847]: time=2026-09-20T08:06:47.530Z level=INFO msg="Uploading 1 narinfos"3836lb # [ 36.048552] niks3-server[1004]: 2026/09/20 08:06:47 INFO Signed narinfos id=2 count=13837lb # [ 36.052735] niks3-server[1004]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3838lb # [ 36.063153] niks3-server[1004]: 2026/09/20 08:06:47 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3839lb # [ 36.078676] niks3-server[1004]: 2026/09/20 08:06:47 INFO Completed upload id=23840worker2 # [ 36.106358] nix-grpc-daemon[847]: time=2026-09-20T08:06:47.565Z level=INFO msg="Upload complete. (403ms)"3841lb # [ 36.082325] niks3-server[1004]: 2026/09/20 08:06:47 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3842worker2 # [ 36.137440] nix-grpc-daemon[774]: ts=2026-09-20T08:06:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13843worker2 # [ 36.158674] nix-grpc-daemon[774]: ts=2026-09-20T08:06:47Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03844worker2 # [ 36.163460] nix-grpc-daemon[774]: ts=2026-09-20T08:06:47Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=13845worker2 # [ 36.169026] nix-daemon[835]: reaped child process 871, status = succeeded3846worker2 # [ 36.183909] nix-grpc-daemon[774]: ts=2026-09-20T08:06:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347763847worker2 # [ 36.203833] nix-grpc-daemon[774]: ts=2026-09-20T08:06:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347763848worker2 # [ 36.224509] nix-grpc-daemon[847]: time=2026-09-20T08:06:47.683Z level=INFO msg="All 1 paths already cached"3849client # copying 1 paths to 'lb:50051'...3850worker2 # [ 36.236258] nix-grpc-daemon[774]: ts=2026-09-20T08:06:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347763851client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3852worker2 # [ 36.263211] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3853worker2 # [ 36.511276] nix-daemon[835]: accepted connection from pid 897, user nix-grpc-daemon (trusted)3854worker2 # [ 36.531833] nix-daemon[835]: reaped child process 900, status = succeeded3855worker2 # [ 36.734942] nix-daemon[835]: accepted connection from pid 902, user nix-grpc-daemon (trusted)3856worker2 # [ 36.754544] nix-daemon[835]: reaped child process 905, status = succeeded3857lb # [ 36.741389] niks3-server[1004]: 2026/09/20 08:06:48 INFO Received uploads request method=POST path=/api/pending_closures3858worker2 # [ 36.781473] nix-grpc-daemon[847]: time=2026-09-20T08:06:48.240Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3859worker2 # [ 36.783039] nix-grpc-daemon[847]: time=2026-09-20T08:06:48.240Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3860lb # [ 36.780382] niks3-server[1004]: 2026/09/20 08:06:48 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3861lb # [ 36.798806] niks3-server[1004]: 2026/09/20 08:06:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3862worker2 # [ 36.832826] nix-grpc-daemon[847]: time=2026-09-20T08:06:48.292Z level=INFO msg="Uploading 1 narinfos"3863lb # [ 36.812379] niks3-server[1004]: 2026/09/20 08:06:48 INFO Signed narinfos id=3 count=13864lb # [ 36.818874] niks3-server[1004]: 2026/09/20 08:06:48 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3865lb # [ 36.830992] niks3-server[1004]: 2026/09/20 08:06:48 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3866lb # [ 36.839193] niks3-server[1004]: 2026/09/20 08:06:48 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3867lb # [ 36.846540] niks3-server[1004]: 2026/09/20 08:06:48 INFO Completed upload id=33868worker2 # [ 36.876998] nix-grpc-daemon[847]: time=2026-09-20T08:06:48.333Z level=INFO msg="Upload complete. (590ms)"3869worker2 # [ 36.878597] nix-grpc-daemon[774]: ts=2026-09-20T08:06:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=0 paths=1 nar_bytes_in=6243870worker2 # [ 36.889637] nix-grpc-daemon[774]: ts=2026-09-20T08:06:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347763871worker2 # [ 36.901377] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3872worker2 # [ 36.911228] nix-daemon[835]: reaped child process 895, status = succeeded3873client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3874worker2 # [ 36.930314] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3875client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3876worker2 # [ 38.555149] nix-daemon[835]: reaped child process 909, status = succeeded3877client # farm-b> LOG-farm-b-t13878worker2 # [ 38.722014] nix-daemon[835]: accepted connection from pid 925, user nix-grpc-daemon (trusted)3879worker2 # [ 38.741584] nix-daemon[835]: reaped child process 928, status = succeeded3880lb # [ 38.727448] niks3-server[1004]: 2026/09/20 08:06:50 INFO Received uploads request method=POST path=/api/pending_closures3881worker2 # [ 38.766859] nix-grpc-daemon[847]: time=2026-09-20T08:06:50.225Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3882worker2 # [ 38.768472] nix-grpc-daemon[847]: time=2026-09-20T08:06:50.225Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3883lb # [ 38.768529] niks3-server[1004]: 2026/09/20 08:06:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3884worker2 # [ 38.810145] nix-grpc-daemon[847]: time=2026-09-20T08:06:50.269Z level=INFO msg="Uploading 1 narinfos"3885lb # [ 38.784314] niks3-server[1004]: 2026/09/20 08:06:50 INFO Signed narinfos id=4 count=13886lb # [ 38.796302] niks3-server[1004]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3887lb # [ 38.806009] niks3-server[1004]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3888lb # [ 38.815399] niks3-server[1004]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3889lb # [ 38.819729] niks3-server[1004]: 2026/09/20 08:06:50 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3890worker2 # [ 38.851491] nix-grpc-daemon[847]: time=2026-09-20T08:06:50.311Z level=INFO msg="Upload complete. (308ms)"3891lb # [ 38.824732] niks3-server[1004]: 2026/09/20 08:06:50 INFO Completed upload id=43892lb # [ 38.828930] niks3-server[1004]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3893worker2 # [ 38.863086] nix-grpc-daemon[774]: ts=2026-09-20T08:06:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13894worker2 # [ 38.866979] nix-daemon[835]: reaped child process 907, status = succeeded3895worker2 # [ 38.871825] nix-grpc-daemon[774]: ts=2026-09-20T08:06:50Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03896worker2 # [ 38.875728] nix-grpc-daemon[774]: ts=2026-09-20T08:06:50Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=13897worker2 # [ 38.924168] nix-grpc-daemon[774]: ts=2026-09-20T08:06:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347763898worker2 # [ 38.934052] nix-grpc-daemon[774]: ts=2026-09-20T08:06:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347763899worker2 # [ 38.946947] nix-grpc-daemon[847]: time=2026-09-20T08:06:50.406Z level=INFO msg="All 2 paths already cached"3900client # copying 1 paths to 'lb:50051'...3901client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3902worker2 # [ 38.958253] nix-grpc-daemon[774]: ts=2026-09-20T08:06:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347763903worker2 # [ 38.974354] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3904worker2 # [ 39.174591] nix-daemon[835]: accepted connection from pid 934, user nix-grpc-daemon (trusted)3905worker2 # [ 39.193874] nix-daemon[835]: reaped child process 937, status = succeeded3906worker2 # [ 39.374810] nix-daemon[835]: accepted connection from pid 939, user nix-grpc-daemon (trusted)3907worker2 # [ 39.392576] nix-daemon[835]: reaped child process 942, status = succeeded3908lb # [ 39.377131] niks3-server[1004]: 2026/09/20 08:06:50 INFO Received uploads request method=POST path=/api/pending_closures3909worker2 # [ 39.414954] nix-grpc-daemon[847]: time=2026-09-20T08:06:50.874Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3910worker2 # [ 39.416712] nix-grpc-daemon[847]: time=2026-09-20T08:06:50.874Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3911lb # [ 39.411669] niks3-server[1004]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3912lb # [ 39.430070] niks3-server[1004]: 2026/09/20 08:06:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3913worker2 # [ 39.467457] nix-grpc-daemon[847]: time=2026-09-20T08:06:50.926Z level=INFO msg="Uploading 1 narinfos"3914lb # [ 39.441576] niks3-server[1004]: 2026/09/20 08:06:50 INFO Signed narinfos id=5 count=13915lb # [ 39.447715] niks3-server[1004]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3916lb # [ 39.460450] niks3-server[1004]: 2026/09/20 08:06:50 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3917lb # [ 39.469364] niks3-server[1004]: 2026/09/20 08:06:50 INFO Completed upload id=53918worker2 # [ 39.495903] nix-grpc-daemon[847]: time=2026-09-20T08:06:50.955Z level=INFO msg="Upload complete. (508ms)"3919lb # [ 39.473632] niks3-server[1004]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3920worker2 # [ 39.508167] nix-grpc-daemon[774]: ts=2026-09-20T08:06:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=0 paths=1 nar_bytes_in=7523921worker2 # [ 39.523823] nix-grpc-daemon[774]: ts=2026-09-20T08:06:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347763922worker2 # [ 39.534647] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3923worker2 # [ 39.538265] nix-daemon[835]: reaped child process 932, status = succeeded3924client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3925client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3926worker2 # [ 39.556171] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3927client # farm-top> LOG-farm-top-t13928worker2 # [ 40.381606] nix-daemon[835]: reaped child process 946, status = succeeded3929worker2 # [ 40.552286] nix-daemon[835]: accepted connection from pid 962, user nix-grpc-daemon (trusted)3930worker2 # [ 40.573397] nix-daemon[835]: reaped child process 965, status = succeeded3931lb # [ 40.557445] niks3-server[1004]: 2026/09/20 08:06:52 INFO Received uploads request method=POST path=/api/pending_closures3932worker2 # [ 40.592410] nix-grpc-daemon[847]: time=2026-09-20T08:06:52.050Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3933worker2 # [ 40.593895] nix-grpc-daemon[847]: time=2026-09-20T08:06:52.050Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"3934lb # [ 40.576133] niks3-server[1004]: 2026/09/20 08:06:52 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst3935lb # [ 40.591906] niks3-server[1004]: 2026/09/20 08:06:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign3936worker2 # [ 40.623635] nix-grpc-daemon[847]: time=2026-09-20T08:06:52.083Z level=INFO msg="Uploading 1 narinfos"3937lb # [ 40.598666] niks3-server[1004]: 2026/09/20 08:06:52 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3938lb # [ 40.603847] niks3-server[1004]: 2026/09/20 08:06:52 INFO Signed narinfos id=6 count=13939lb # [ 40.606511] niks3-server[1004]: 2026/09/20 08:06:52 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls3940lb # [ 40.611882] niks3-server[1004]: 2026/09/20 08:06:52 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete3941lb # [ 40.615053] niks3-server[1004]: 2026/09/20 08:06:52 INFO Completed upload id=63942worker2 # [ 40.642612] nix-grpc-daemon[847]: time=2026-09-20T08:06:52.102Z level=INFO msg="Upload complete. (276ms)"3943lb # [ 40.616948] niks3-server[1004]: 2026/09/20 08:06:52 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo3944worker2 # [ 40.649806] nix-grpc-daemon[774]: ts=2026-09-20T08:06:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=13945worker2 # [ 40.661552] nix-daemon[835]: reaped child process 944, status = succeeded3946client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 8.26 seconds)3947client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath3948client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.25 seconds)3949client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3950client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)3951client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3952client # copying 3 paths...3953client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...3954client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...3955client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...3956client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)3957(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.97 seconds)3958subtest: repeat is answered Cached by the scheduler without building3959worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3960worker1 # finding garbage collector roots...3961worker1 # deleting specified paths...3962worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3963worker1 # deleting unused links...3964worker1 # note: hard linking is currently saving 0.0 KiB3965worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds)3966worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3967worker2 # finding garbage collector roots...3968lb # [ 41.914722] envoy[922]: conn peer=[2001:db8:1::1]:34832 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=213969lb # [ 41.919822] envoy[922]: conn peer=[2001:db8:1::1]:34844 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=213970lb # [ 41.925013] envoy[922]: conn peer=[2001:db8:1::1]:34850 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9384 tx=3802 ms=79893971worker2 # deleting specified paths...3972worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3973worker2 # deleting unused links...3974worker2 # note: hard linking is currently saving 0.0 KiB3975worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds)3976client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&23977worker1 # [ 42.192902] nix-grpc-daemon[833]: ts=2026-09-20T08:06:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:561743978client # don't know how to build these paths:3979client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3980worker2 # [ 42.272543] nix-grpc-daemon[774]: ts=2026-09-20T08:06:53Z level=debug event=want client=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=13981worker2 # [ 42.285595] nix-grpc-daemon[774]: ts=2026-09-20T08:06:53Z level=debug event=want client=2 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=13982worker2 # [ 42.293165] nix-grpc-daemon[774]: ts=2026-09-20T08:06:53Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=13983client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 0.34 seconds)3984client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath3985client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.22 seconds)3986lb: must succeed: curl -sf localhost:9901/clusters3987lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)3988lb: must succeed: curl -sf localhost:9901/clusters3989lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3990worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true3991worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.05 seconds)3992(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.44 seconds)3993subtest: two clients wanting the same drv build it once3994client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup3995client # [ 42.857022] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.3996client # Running as unit: dedup1.service; invocation ID: c23fbb85a17e41829127bb2f9c31b3383997client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.08 seconds)3998client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup3999worker2 # [ 43.162037] nix-grpc-daemon[774]: ts=2026-09-20T08:06:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:347764000client # [ 43.107836] nix[862]: don't know how to build these paths:4001client # [ 43.108886] nix[862]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4002worker2 # [ 43.182663] nix-grpc-daemon[774]: ts=2026-09-20T08:06:54Z level=debug event=want client=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04003worker2 # [ 43.189800] nix-grpc-daemon[774]: ts=2026-09-20T08:06:54Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=14004worker1 # [ 43.182551] nix-grpc-daemon[833]: ts=2026-09-20T08:06:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561744005worker1 # [ 43.205691] nix-grpc-daemon[833]: ts=2026-09-20T08:06:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:561744006client # [ 43.212159] nix[862]: copying 1 paths to 'lb:50051'...4007worker1 # [ 43.221457] nix-grpc-daemon[833]: ts=2026-09-20T08:06:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:561744008client # [ 43.215234] nix[862]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4009worker1 # [ 43.241816] nix-daemon[889]: accepted connection from pid 833, user nix-grpc-daemon (trusted)4010worker1 # [ 43.271582] nix-grpc-daemon[833]: ts=2026-09-20T08:06:54Z level=info event=niks3_push_started pid=9154011worker1 # [ 43.728063] nix-daemon[889]: accepted connection from pid 928, user nix-grpc-daemon (trusted)4012worker1 # [ 43.747481] nix-daemon[889]: reaped child process 931, status = succeeded4013worker1 # [ 43.927346] nix-daemon[889]: accepted connection from pid 933, user nix-grpc-daemon (trusted)4014worker1 # [ 43.945456] nix-daemon[889]: reaped child process 936, status = succeeded4015lb # [ 43.985305] niks3-server[1004]: 2026/09/20 08:06:55 INFO Received uploads request method=POST path=/api/pending_closures4016worker1 # [ 43.980968] nix-grpc-daemon[915]: time=2026-09-20T08:06:55.433Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4017worker1 # [ 43.982541] nix-grpc-daemon[915]: time=2026-09-20T08:06:55.433Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4018client # [ 43.968613] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4019client # Running as unit: dedup2.service; invocation ID: 85aebdd260604069889750b9c3fe1b684020lb # [ 44.035770] niks3-server[1004]: 2026/09/20 08:06:55 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4021client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds)4022worker1 # [ 44.022002] nix-grpc-daemon[915]: time=2026-09-20T08:06:55.476Z level=INFO msg="Uploading 1 narinfos"4023lb # [ 44.047519] niks3-server[1004]: 2026/09/20 08:06:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4024lb # [ 44.056571] niks3-server[1004]: 2026/09/20 08:06:55 INFO Signed narinfos id=7 count=14025lb # [ 44.067579] niks3-server[1004]: 2026/09/20 08:06:55 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4026lb # [ 44.076000] niks3-server[1004]: 2026/09/20 08:06:55 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4027worker1 # [ 44.061931] nix-grpc-daemon[915]: time=2026-09-20T08:06:55.516Z level=INFO msg="Upload complete. (523ms)"4028lb # [ 44.088477] niks3-server[1004]: 2026/09/20 08:06:55 INFO Completed upload id=74029lb # [ 44.092173] niks3-server[1004]: 2026/09/20 08:06:55 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4030worker1 # [ 44.068514] nix-grpc-daemon[833]: ts=2026-09-20T08:06:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56174 duration_s=0 paths=1 nar_bytes_in=4324031worker1 # [ 44.073896] nix-grpc-daemon[833]: ts=2026-09-20T08:06:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561744032worker1 # [ 44.082660] nix-daemon[889]: accepted connection from pid 833, user nix-grpc-daemon (trusted)4033worker1 # [ 44.087472] nix-daemon[889]: reaped child process 913, status = succeeded4034worker1 # [ 44.104857] nix-daemon[889]: accepted connection from pid 833, user nix-grpc-daemon (trusted)4035client # [ 44.096488] nix[862]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4036worker1 # [ 44.322623] nix-grpc-daemon[833]: ts=2026-09-20T08:06:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:561744037client # [ 44.329497] nix[878]: this derivation will be built:4038worker2 # [ 44.398690] nix-grpc-daemon[774]: ts=2026-09-20T08:06:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:347764039worker2 # [ 44.411975] nix-grpc-daemon[774]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' from 'http://lb:5751'...4040client # [ 44.378490] nix[878]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4041worker2 # [ 44.455848] nix-grpc-daemon[774]: ts=2026-09-20T08:06:55Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04042worker1 # [ 44.412139] nix-grpc-daemon[833]: ts=2026-09-20T08:06:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561744043client # [ 44.411942] nix[878]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4044client: must succeed: sleep 24045client: (finished: must succeed: sleep 2, in 2.07 seconds)4046??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4047 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394048client: waiting for success: ! systemctl is-active dedup1 dedup24049??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4050 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394051worker1 # [ 47.745432] nix-daemon[889]: reaped child process 944, status = succeeded4052worker1 # [ 47.944073] nix-daemon[889]: accepted connection from pid 970, user nix-grpc-daemon (trusted)4053worker1 # [ 47.968543] nix-daemon[889]: reaped child process 973, status = succeeded4054lb # [ 48.007268] niks3-server[1004]: 2026/09/20 08:06:59 INFO Received uploads request method=POST path=/api/pending_closures4055worker1 # [ 47.991498] nix-grpc-daemon[915]: time=2026-09-20T08:06:59.445Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4056worker1 # [ 47.994920] nix-grpc-daemon[915]: time=2026-09-20T08:06:59.445Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4057lb # [ 48.051206] niks3-server[1004]: 2026/09/20 08:06:59 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4058lb # [ 48.067735] niks3-server[1004]: 2026/09/20 08:06:59 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4059lb # [ 48.080712] niks3-server[1004]: 2026/09/20 08:06:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4060worker1 # [ 48.060661] nix-grpc-daemon[915]: time=2026-09-20T08:06:59.514Z level=INFO msg="Uploading 1 narinfos"4061lb # [ 48.088775] niks3-server[1004]: 2026/09/20 08:06:59 INFO Signed narinfos id=8 count=14062lb # [ 48.093954] niks3-server[1004]: 2026/09/20 08:06:59 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4063lb # [ 48.107569] niks3-server[1004]: 2026/09/20 08:06:59 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4064lb # [ 48.114831] niks3-server[1004]: 2026/09/20 08:06:59 INFO Completed upload id=84065lb # [ 48.118352] niks3-server[1004]: 2026/09/20 08:06:59 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4066worker1 # [ 48.088768] nix-grpc-daemon[915]: time=2026-09-20T08:06:59.543Z level=INFO msg="Upload complete. (370ms)"4067worker1 # [ 48.101349] nix-grpc-daemon[833]: ts=2026-09-20T08:06:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56174 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14068worker1 # [ 48.116382] nix-grpc-daemon[833]: ts=2026-09-20T08:06:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56174 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14069worker1 # [ 48.123210] nix-daemon[889]: reaped child process 942, status = succeeded4070client # [ 48.152738] systemd[1]: dedup2.service: Deactivated successfully.4071client # [ 48.157535] systemd[1]: dedup2.service: Consumed 198ms CPU time over 4.188s wall clock time, 31M memory peak, 7.9K incoming IP traffic, 6.4K outgoing IP traffic.4072client # [ 48.170975] systemd[1]: dedup1.service: Deactivated successfully.4073client # [ 48.174391] systemd[1]: dedup1.service: Consumed 155ms CPU time over 5.309s wall clock time, 37.2M memory peak, 8.7K incoming IP traffic, 9K outgoing IP traffic.4074client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.10 seconds)4075client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4076client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.05 seconds)4077worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4078worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.04 seconds)4079worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4080worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4081worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4082worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4083worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4084worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.08 seconds)4085(finished: subtest: two clients wanting the same drv build it once, in 6.22 seconds)4086subtest: build hook: nix-daemon with builders = grpc://lb4087client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log4088client # [ 49.247814] systemd[1]: Started Nix Daemon.4089client # [ 49.441380] nix-daemon[920]: accepted connection from pid 917, user root (trusted)4090worker2 # [ 49.705730] nix-grpc-daemon[774]: ts=2026-09-20T08:07:01Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:347764091worker2 # [ 49.717903] nix-grpc-daemon[774]: ts=2026-09-20T08:07:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347764092worker2 # [ 49.740235] nix-grpc-daemon[774]: ts=2026-09-20T08:07:01Z level=debug event=want client=5 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04093worker2 # [ 49.747521] nix-grpc-daemon[774]: ts=2026-09-20T08:07:01Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14094worker2 # [ 49.757020] nix-grpc-daemon[774]: ts=2026-09-20T08:07:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347764095worker2 # [ 49.769530] nix-grpc-daemon[774]: ts=2026-09-20T08:07:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347764096worker2 # [ 49.785721] nix-grpc-daemon[774]: ts=2026-09-20T08:07:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347764097worker2 # [ 49.803202] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4098worker2 # [ 50.013661] nix-daemon[835]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4099worker2 # [ 50.035089] nix-daemon[835]: reaped child process 1028, status = succeeded4100worker2 # [ 50.198827] nix-daemon[835]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)4101worker2 # [ 50.218615] nix-daemon[835]: reaped child process 1033, status = succeeded4102lb # [ 50.203509] niks3-server[1004]: 2026/09/20 08:07:01 INFO Received uploads request method=POST path=/api/pending_closures4103worker2 # [ 50.244333] nix-grpc-daemon[847]: time=2026-09-20T08:07:01.703Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4104worker2 # [ 50.245938] nix-grpc-daemon[847]: time=2026-09-20T08:07:01.703Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4105lb # [ 50.237929] niks3-server[1004]: 2026/09/20 08:07:01 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4106worker2 # [ 50.278051] nix-grpc-daemon[847]: time=2026-09-20T08:07:01.737Z level=INFO msg="Uploading 1 narinfos"4107lb # [ 50.252202] niks3-server[1004]: 2026/09/20 08:07:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4108lb # [ 50.262829] niks3-server[1004]: 2026/09/20 08:07:01 INFO Signed narinfos id=9 count=14109lb # [ 50.269958] niks3-server[1004]: 2026/09/20 08:07:01 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4110lb # [ 50.277774] niks3-server[1004]: 2026/09/20 08:07:01 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4111lb # [ 50.284961] niks3-server[1004]: 2026/09/20 08:07:01 INFO Completed upload id=94112worker2 # [ 50.312528] nix-grpc-daemon[847]: time=2026-09-20T08:07:01.772Z level=INFO msg="Upload complete. (493ms)"4113lb # [ 50.287810] niks3-server[1004]: 2026/09/20 08:07:01 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4114worker2 # [ 50.323922] nix-grpc-daemon[774]: ts=2026-09-20T08:07:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=0 paths=1 nar_bytes_in=5124115worker2 # [ 50.335664] nix-grpc-daemon[774]: ts=2026-09-20T08:07:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347764116worker2 # [ 50.343376] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4117worker2 # [ 50.349434] nix-daemon[835]: reaped child process 1023, status = succeeded4118worker2 # [ 50.363847] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4119worker2 # [ 51.815669] nix-daemon[835]: reaped child process 1037, status = succeeded4120lb # [ 51.914505] envoy[922]: conn peer=[2001:db8:1::1]:40246 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1162 tx=482 ms=634121lb # [ 51.919976] envoy[922]: conn peer=[2001:db8:1::1]:40250 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1579 tx=1487 ms=37984122lb # [ 51.925660] envoy[922]: conn peer=[2001:db8:1::1]:40248 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1372 ms=50094123worker2 # [ 52.008301] nix-daemon[835]: accepted connection from pid 1052, user nix-grpc-daemon (trusted)4124worker2 # [ 52.027819] nix-daemon[835]: reaped child process 1055, status = succeeded4125lb # [ 52.017605] niks3-server[1004]: 2026/09/20 08:07:03 INFO Received uploads request method=POST path=/api/pending_closures4126worker2 # [ 52.056475] nix-grpc-daemon[847]: time=2026-09-20T08:07:03.514Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4127worker2 # [ 52.060519] nix-grpc-daemon[847]: time=2026-09-20T08:07:03.514Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4128lb # [ 52.056773] niks3-server[1004]: 2026/09/20 08:07:03 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4129lb # [ 52.072096] niks3-server[1004]: 2026/09/20 08:07:03 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4130lb # [ 52.086198] niks3-server[1004]: 2026/09/20 08:07:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4131worker2 # [ 52.118549] nix-grpc-daemon[847]: time=2026-09-20T08:07:03.577Z level=INFO msg="Uploading 1 narinfos"4132lb # [ 52.096623] niks3-server[1004]: 2026/09/20 08:07:03 INFO Signed narinfos id=10 count=14133lb # [ 52.099095] niks3-server[1004]: 2026/09/20 08:07:03 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4134lb # [ 52.109252] niks3-server[1004]: 2026/09/20 08:07:03 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4135lb # [ 52.116966] niks3-server[1004]: 2026/09/20 08:07:03 INFO Completed upload id=104136worker2 # [ 52.144502] nix-grpc-daemon[847]: time=2026-09-20T08:07:03.604Z level=INFO msg="Upload complete. (367ms)"4137lb # [ 52.119906] niks3-server[1004]: 2026/09/20 08:07:03 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4138worker2 # [ 52.155545] nix-grpc-daemon[774]: ts=2026-09-20T08:07:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=5 outputs=14139worker2 # [ 52.170673] nix-grpc-daemon[774]: ts=2026-09-20T08:07:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:347764140worker2 # [ 52.174009] nix-daemon[835]: reaped child process 1035, status = succeeded4141worker2 # [ 52.192177] nix-grpc-daemon[774]: ts=2026-09-20T08:07:03Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:347764142worker2 # [ 52.195177] nix-grpc-daemon[774]: ts=2026-09-20T08:07:03Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=0 paths=1 nar_bytes_out=1284143worker2 # [ 52.512234] nix-grpc-daemon[774]: ts=2026-09-20T08:07:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:347764144worker1 # [ 52.465870] nix-grpc-daemon[833]: ts=2026-09-20T08:07:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:561744145worker2 # [ 52.551007] nix-grpc-daemon[774]: ts=2026-09-20T08:07:04Z level=debug event=want client=6 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04146worker2 # [ 52.558560] nix-grpc-daemon[774]: ts=2026-09-20T08:07:04Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14147worker2 # [ 52.568594] nix-grpc-daemon[774]: ts=2026-09-20T08:07:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347764148worker2 # [ 52.581749] nix-grpc-daemon[774]: ts=2026-09-20T08:07:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347764149worker2 # [ 52.593862] nix-grpc-daemon[847]: time=2026-09-20T08:07:04.053Z level=INFO msg="All 1 paths already cached"4150worker2 # [ 52.601815] nix-grpc-daemon[774]: ts=2026-09-20T08:07:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347764151worker2 # [ 52.616108] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4152worker2 # [ 52.822710] nix-daemon[835]: accepted connection from pid 1061, user nix-grpc-daemon (trusted)4153worker2 # [ 52.844330] nix-daemon[835]: reaped child process 1064, status = succeeded4154worker2 # [ 53.034879] nix-daemon[835]: accepted connection from pid 1066, user nix-grpc-daemon (trusted)4155worker2 # [ 53.054729] nix-daemon[835]: reaped child process 1069, status = succeeded4156lb # [ 53.043146] niks3-server[1004]: 2026/09/20 08:07:04 INFO Received uploads request method=POST path=/api/pending_closures4157worker2 # [ 53.081564] nix-grpc-daemon[847]: time=2026-09-20T08:07:04.540Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4158worker2 # [ 53.083222] nix-grpc-daemon[847]: time=2026-09-20T08:07:04.540Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4159lb # [ 53.073438] niks3-server[1004]: 2026/09/20 08:07:04 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4160lb # [ 53.090889] niks3-server[1004]: 2026/09/20 08:07:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4161worker2 # [ 53.125112] nix-grpc-daemon[847]: time=2026-09-20T08:07:04.584Z level=INFO msg="Uploading 1 narinfos"4162lb # [ 53.105426] niks3-server[1004]: 2026/09/20 08:07:04 INFO Signed narinfos id=11 count=14163lb # [ 53.112386] niks3-server[1004]: 2026/09/20 08:07:04 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4164lb # [ 53.122402] niks3-server[1004]: 2026/09/20 08:07:04 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4165lb # [ 53.130679] niks3-server[1004]: 2026/09/20 08:07:04 INFO Completed upload id=114166worker2 # [ 53.158384] nix-grpc-daemon[847]: time=2026-09-20T08:07:04.617Z level=INFO msg="Upload complete. (526ms)"4167lb # [ 53.133702] niks3-server[1004]: 2026/09/20 08:07:04 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4168worker2 # [ 53.176157] nix-grpc-daemon[774]: ts=2026-09-20T08:07:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=0 paths=1 nar_bytes_in=6244169worker2 # [ 53.187620] nix-grpc-daemon[774]: ts=2026-09-20T08:07:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347764170worker2 # [ 53.196413] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4171worker2 # [ 53.205610] nix-daemon[835]: reaped child process 1059, status = succeeded4172worker2 # [ 53.215623] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4173worker2 # [ 54.444845] nix-daemon[835]: reaped child process 1073, status = succeeded4174worker2 # [ 54.610068] nix-daemon[835]: accepted connection from pid 1088, user nix-grpc-daemon (trusted)4175worker2 # [ 54.632158] nix-daemon[835]: reaped child process 1091, status = succeeded4176lb # [ 54.617705] niks3-server[1004]: 2026/09/20 08:07:06 INFO Received uploads request method=POST path=/api/pending_closures4177worker2 # [ 54.656506] nix-grpc-daemon[847]: time=2026-09-20T08:07:06.115Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4178worker2 # [ 54.658090] nix-grpc-daemon[847]: time=2026-09-20T08:07:06.115Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4179lb # [ 54.668531] niks3-server[1004]: 2026/09/20 08:07:06 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4180lb # [ 54.685173] niks3-server[1004]: 2026/09/20 08:07:06 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4181worker2 # [ 54.721432] nix-grpc-daemon[847]: time=2026-09-20T08:07:06.180Z level=INFO msg="Uploading 1 narinfos"4182lb # [ 54.697233] niks3-server[1004]: 2026/09/20 08:07:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4183lb # [ 54.705068] niks3-server[1004]: 2026/09/20 08:07:06 INFO Signed narinfos id=12 count=14184lb # [ 54.708420] niks3-server[1004]: 2026/09/20 08:07:06 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4185lb # [ 54.716097] niks3-server[1004]: 2026/09/20 08:07:06 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4186lb # [ 54.720810] niks3-server[1004]: 2026/09/20 08:07:06 INFO Completed upload id=124187worker2 # [ 54.747987] nix-grpc-daemon[847]: time=2026-09-20T08:07:06.207Z level=INFO msg="Upload complete. (320ms)"4188lb # [ 54.723825] niks3-server[1004]: 2026/09/20 08:07:06 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4189worker2 # [ 54.761324] nix-grpc-daemon[774]: ts=2026-09-20T08:07:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=6 outputs=14190worker2 # [ 54.780448] nix-grpc-daemon[774]: ts=2026-09-20T08:07:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:347764191worker2 # [ 54.785556] nix-daemon[835]: reaped child process 1071, status = succeeded4192worker1 # [ 54.734035] nix-grpc-daemon[833]: ts=2026-09-20T08:07:06Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:561744193worker1 # [ 54.750544] nix-grpc-daemon[833]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4194worker1 # [ 54.772612] nix-grpc-daemon[833]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4195worker1 # [ 54.791546] nix-grpc-daemon[833]: ts=2026-09-20T08:07:06Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56174 duration_s=0 paths=1 nar_bytes_out=1764196worker1 # [ 55.106874] nix-grpc-daemon[833]: ts=2026-09-20T08:07:06Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:561744197worker1 # [ 55.112440] nix-grpc-daemon[833]: ts=2026-09-20T08:07:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:561744198worker1 # [ 55.123427] nix-grpc-daemon[915]: time=2026-09-20T08:07:06.577Z level=INFO msg="All 2 paths already cached"4199worker2 # [ 55.194267] nix-grpc-daemon[774]: ts=2026-09-20T08:07:06Z level=debug event=want client=7 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04200worker2 # [ 55.202704] nix-grpc-daemon[774]: ts=2026-09-20T08:07:06Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14201worker2 # [ 55.212517] nix-grpc-daemon[774]: ts=2026-09-20T08:07:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347764202worker2 # [ 55.224167] nix-grpc-daemon[774]: ts=2026-09-20T08:07:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347764203worker2 # [ 55.241257] nix-grpc-daemon[847]: time=2026-09-20T08:07:06.700Z level=INFO msg="All 2 paths already cached"4204worker2 # [ 55.251602] nix-grpc-daemon[774]: ts=2026-09-20T08:07:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347764205worker2 # [ 55.266671] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4206worker2 # [ 55.487398] nix-daemon[835]: accepted connection from pid 1097, user nix-grpc-daemon (trusted)4207worker2 # [ 55.512553] nix-daemon[835]: reaped child process 1100, status = succeeded4208worker2 # [ 55.704095] nix-daemon[835]: accepted connection from pid 1102, user nix-grpc-daemon (trusted)4209worker2 # [ 55.723784] nix-daemon[835]: reaped child process 1105, status = succeeded4210lb # [ 55.710072] niks3-server[1004]: 2026/09/20 08:07:07 INFO Received uploads request method=POST path=/api/pending_closures4211worker2 # [ 55.751329] nix-grpc-daemon[847]: time=2026-09-20T08:07:07.210Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4212worker2 # [ 55.753130] nix-grpc-daemon[847]: time=2026-09-20T08:07:07.210Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4213lb # [ 55.744591] niks3-server[1004]: 2026/09/20 08:07:07 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4214lb # [ 55.763460] niks3-server[1004]: 2026/09/20 08:07:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4215worker2 # [ 55.797106] nix-grpc-daemon[847]: time=2026-09-20T08:07:07.256Z level=INFO msg="Uploading 1 narinfos"4216lb # [ 55.776777] niks3-server[1004]: 2026/09/20 08:07:07 INFO Signed narinfos id=13 count=14217lb # [ 55.780000] niks3-server[1004]: 2026/09/20 08:07:07 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4218lb # [ 55.795579] niks3-server[1004]: 2026/09/20 08:07:07 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4219worker2 # [ 55.828608] nix-grpc-daemon[847]: time=2026-09-20T08:07:07.288Z level=INFO msg="Upload complete. (544ms)"4220lb # [ 55.801921] niks3-server[1004]: 2026/09/20 08:07:07 INFO Completed upload id=134221lb # [ 55.806029] niks3-server[1004]: 2026/09/20 08:07:07 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4222worker2 # [ 55.837122] nix-grpc-daemon[774]: ts=2026-09-20T08:07:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=0 paths=1 nar_bytes_in=7524223worker2 # [ 55.852658] nix-grpc-daemon[774]: ts=2026-09-20T08:07:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347764224worker2 # [ 55.862707] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4225worker2 # [ 55.866049] nix-daemon[835]: reaped child process 1095, status = succeeded4226worker2 # [ 55.882724] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4227worker2 # [ 57.106286] nix-daemon[835]: reaped child process 1109, status = succeeded4228worker2 # [ 57.270141] nix-daemon[835]: accepted connection from pid 1124, user nix-grpc-daemon (trusted)4229worker2 # [ 57.291963] nix-daemon[835]: reaped child process 1127, status = succeeded4230lb # [ 57.278879] niks3-server[1004]: 2026/09/20 08:07:08 INFO Received uploads request method=POST path=/api/pending_closures4231worker2 # [ 57.318288] nix-grpc-daemon[847]: time=2026-09-20T08:07:08.776Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4232worker2 # [ 57.319873] nix-grpc-daemon[847]: time=2026-09-20T08:07:08.776Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4233lb # [ 57.323929] niks3-server[1004]: 2026/09/20 08:07:08 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4234worker2 # [ 57.363358] nix-grpc-daemon[847]: time=2026-09-20T08:07:08.822Z level=INFO msg="Uploading 1 narinfos"4235lb # [ 57.336899] niks3-server[1004]: 2026/09/20 08:07:08 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4236lb # [ 57.348437] niks3-server[1004]: 2026/09/20 08:07:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4237lb # [ 57.354653] niks3-server[1004]: 2026/09/20 08:07:08 INFO Signed narinfos id=14 count=14238lb # [ 57.362184] niks3-server[1004]: 2026/09/20 08:07:08 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4239worker2 # [ 57.393151] nix-grpc-daemon[847]: time=2026-09-20T08:07:08.852Z level=INFO msg="Upload complete. (299ms)"4240lb # [ 57.366118] niks3-server[1004]: 2026/09/20 08:07:08 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4241lb # [ 57.371285] niks3-server[1004]: 2026/09/20 08:07:08 INFO Completed upload id=144242lb # [ 57.373928] niks3-server[1004]: 2026/09/20 08:07:08 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4243worker2 # [ 57.405193] nix-grpc-daemon[774]: ts=2026-09-20T08:07:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=7 outputs=14244worker1 # [ 57.359035] nix-grpc-daemon[833]: ts=2026-09-20T08:07:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:561744245worker2 # [ 57.420622] nix-daemon[835]: reaped child process 1107, status = succeeded4246worker1 # [ 57.367694] nix-grpc-daemon[833]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4247worker1 # [ 57.414281] nix-grpc-daemon[833]: ts=2026-09-20T08:07:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:561744248worker1 # [ 57.419675] nix-grpc-daemon[833]: ts=2026-09-20T08:07:08Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56174 duration_s=0 paths=1 nar_bytes_out=2324249client # [ 57.520494] nix-daemon[920]: reaped child process 922, status = succeeded4250client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.53 seconds)4251client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4252client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4253client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4254client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4255client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4256client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds)4257(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.65 seconds)4258subtest: an input only one worker has still reaches the builder4259client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4260client # this derivation will be built:4261client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4262client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4263client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.47 seconds)4264client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4265client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.22 seconds)4266worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4267worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.27 seconds)4268worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4269worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.03 seconds)4270client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24271client # [ 58.879963] nix-daemon[920]: accepted connection from pid 1000, user root (trusted)4272client # this derivation will be built:4273client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4274worker1 # [ 59.117488] nix-grpc-daemon[833]: ts=2026-09-20T08:07:10Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:561744275worker1 # [ 59.122232] nix-grpc-daemon[833]: ts=2026-09-20T08:07:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:561744276client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4277worker1 # [ 59.337320] nix-daemon[889]: accepted connection from pid 995, user nix-grpc-daemon (trusted)4278worker1 # [ 59.357009] nix-daemon[889]: reaped child process 998, status = succeeded4279lb # [ 59.398724] niks3-server[1004]: 2026/09/20 08:07:10 INFO Received uploads request method=POST path=/api/pending_closures4280worker1 # [ 59.380420] nix-grpc-daemon[915]: time=2026-09-20T08:07:10.834Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4281worker1 # [ 59.382340] nix-grpc-daemon[915]: time=2026-09-20T08:07:10.834Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4282lb # [ 59.427039] niks3-server[1004]: 2026/09/20 08:07:10 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4283lb # [ 59.443150] niks3-server[1004]: 2026/09/20 08:07:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4284worker1 # [ 59.424764] nix-grpc-daemon[915]: time=2026-09-20T08:07:10.878Z level=INFO msg="Uploading 1 narinfos"4285lb # [ 59.457527] niks3-server[1004]: 2026/09/20 08:07:10 INFO Signed narinfos id=15 count=14286lb # [ 59.463757] niks3-server[1004]: 2026/09/20 08:07:10 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4287worker1 # [ 59.446189] nix-grpc-daemon[915]: time=2026-09-20T08:07:10.900Z level=INFO msg="Upload complete. (321ms)"4288lb # [ 59.473395] niks3-server[1004]: 2026/09/20 08:07:10 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4289lb # [ 59.479085] niks3-server[1004]: 2026/09/20 08:07:10 INFO Completed upload id=154290lb # [ 59.482125] niks3-server[1004]: 2026/09/20 08:07:10 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4291worker2 # [ 59.527030] nix-grpc-daemon[774]: ts=2026-09-20T08:07:10Z level=debug event=want client=8 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04292worker2 # [ 59.534079] nix-grpc-daemon[774]: ts=2026-09-20T08:07:10Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14293worker1 # [ 59.527408] nix-grpc-daemon[833]: ts=2026-09-20T08:07:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561744294worker1 # [ 59.545390] nix-grpc-daemon[833]: ts=2026-09-20T08:07:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:561744295client # copying 2 paths to 'lb:50051'...4296client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4297worker1 # [ 59.565748] nix-grpc-daemon[833]: ts=2026-09-20T08:07:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:561744298client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4299worker1 # [ 59.581370] nix-daemon[889]: accepted connection from pid 833, user nix-grpc-daemon (trusted)4300worker1 # [ 59.803048] nix-daemon[889]: accepted connection from pid 1002, user nix-grpc-daemon (trusted)4301worker1 # [ 59.823310] nix-daemon[889]: reaped child process 1005, status = succeeded4302worker1 # [ 60.003597] nix-daemon[889]: accepted connection from pid 1007, user nix-grpc-daemon (trusted)4303worker1 # [ 60.023243] nix-daemon[889]: reaped child process 1010, status = succeeded4304lb # [ 60.063031] niks3-server[1004]: 2026/09/20 08:07:11 INFO Received uploads request method=POST path=/api/pending_closures4305lb # [ 60.076150] niks3-server[1004]: 2026/09/20 08:07:11 INFO Received uploads request method=POST path=/api/pending_closures4306worker1 # [ 60.061727] nix-grpc-daemon[915]: time=2026-09-20T08:07:11.515Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4307worker1 # [ 60.063324] nix-grpc-daemon[915]: time=2026-09-20T08:07:11.515Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4308worker1 # [ 60.065286] nix-grpc-daemon[915]: time=2026-09-20T08:07:11.515Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4309lb # [ 60.123353] niks3-server[1004]: 2026/09/20 08:07:11 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4310lb # [ 60.133962] niks3-server[1004]: 2026/09/20 08:07:11 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4311lb # [ 60.143990] niks3-server[1004]: 2026/09/20 08:07:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4312lb # [ 60.150700] niks3-server[1004]: 2026/09/20 08:07:11 INFO Signed narinfos id=16 count=14313worker1 # [ 60.129747] nix-grpc-daemon[915]: time=2026-09-20T08:07:11.583Z level=INFO msg="Uploading 3 narinfos"4314lb # [ 60.158333] niks3-server[1004]: 2026/09/20 08:07:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4315lb # [ 60.166747] niks3-server[1004]: 2026/09/20 08:07:11 INFO Signed narinfos id=17 count=24316lb # [ 60.171276] niks3-server[1004]: 2026/09/20 08:07:11 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4317lb # [ 60.178454] niks3-server[1004]: 2026/09/20 08:07:11 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4318lb # [ 60.187965] niks3-server[1004]: 2026/09/20 08:07:11 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4319lb # [ 60.196578] niks3-server[1004]: 2026/09/20 08:07:11 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4320lb # [ 60.202017] niks3-server[1004]: 2026/09/20 08:07:11 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4321lb # [ 60.209436] niks3-server[1004]: 2026/09/20 08:07:11 INFO Completed upload id=164322lb # [ 60.210881] niks3-server[1004]: 2026/09/20 08:07:11 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4323lb # [ 60.214721] niks3-server[1004]: 2026/09/20 08:07:11 INFO Completed upload id=174324worker1 # [ 60.187758] nix-grpc-daemon[915]: time=2026-09-20T08:07:11.642Z level=INFO msg="Upload complete. (586ms)"4325lb # [ 60.216759] niks3-server[1004]: 2026/09/20 08:07:11 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4326worker1 # [ 60.201490] nix-grpc-daemon[833]: ts=2026-09-20T08:07:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56174 duration_s=0 paths=2 nar_bytes_in=9844327worker1 # [ 60.220619] nix-grpc-daemon[833]: ts=2026-09-20T08:07:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561744328worker1 # [ 60.228804] nix-daemon[889]: accepted connection from pid 833, user nix-grpc-daemon (trusted)4329worker1 # [ 60.235412] nix-daemon[889]: reaped child process 1000, status = succeeded4330client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4331client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4332worker1 # [ 60.255128] nix-daemon[889]: accepted connection from pid 833, user nix-grpc-daemon (trusted)4333worker1 # [ 61.296368] nix-daemon[889]: reaped child process 1014, status = succeeded4334worker1 # [ 61.474282] nix-daemon[889]: accepted connection from pid 1029, user nix-grpc-daemon (trusted)4335worker1 # [ 61.496291] nix-daemon[889]: reaped child process 1032, status = succeeded4336lb # [ 61.538482] niks3-server[1004]: 2026/09/20 08:07:12 INFO Received uploads request method=POST path=/api/pending_closures4337worker1 # [ 61.520580] nix-grpc-daemon[915]: time=2026-09-20T08:07:12.974Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4338lb # [ 61.570426] niks3-server[1004]: 2026/09/20 08:07:13 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4339lb # [ 61.580703] niks3-server[1004]: 2026/09/20 08:07:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4340worker1 # [ 61.560647] nix-grpc-daemon[915]: time=2026-09-20T08:07:13.015Z level=INFO msg="Uploading 1 narinfos"4341lb # [ 61.592997] niks3-server[1004]: 2026/09/20 08:07:13 INFO Signed narinfos id=18 count=14342lb # [ 61.599806] niks3-server[1004]: 2026/09/20 08:07:13 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4343lb # [ 61.609754] niks3-server[1004]: 2026/09/20 08:07:13 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4344lb # [ 61.616675] niks3-server[1004]: 2026/09/20 08:07:13 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4345lb # [ 61.622206] niks3-server[1004]: 2026/09/20 08:07:13 INFO Completed upload id=184346worker1 # [ 61.595797] nix-grpc-daemon[915]: time=2026-09-20T08:07:13.050Z level=INFO msg="Upload complete. (327ms)"4347worker1 # [ 61.605073] nix-grpc-daemon[833]: ts=2026-09-20T08:07:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56174 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=8 outputs=14348worker1 # [ 61.619677] nix-daemon[889]: reaped child process 1012, status = succeeded4349client # copying 1 paths...4350worker2 # [ 61.706087] nix-grpc-daemon[774]: ts=2026-09-20T08:07:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:347764351worker2 # [ 61.724468] nix-grpc-daemon[774]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4352client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4353worker1 # [ 61.716114] nix-grpc-daemon[833]: ts=2026-09-20T08:07:13Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:561744354worker1 # [ 61.723360] nix-grpc-daemon[833]: ts=2026-09-20T08:07:13Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56174 duration_s=0 paths=1 nar_bytes_out=1204355client # [ 61.797612] nix-daemon[920]: reaped child process 1003, status = succeeded4356client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.17 seconds)4357client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24358lb # [ 61.915061] envoy[922]: conn peer=[2001:db8:1::1]:40262 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3414 tx=1657 ms=25534359lb # [ 61.922643] envoy[922]: conn peer=[2001:db8:1::1]:60076 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=704360lb # [ 61.928852] envoy[922]: conn peer=[2001:db8:1::1]:60084 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3900 tx=1875 ms=23944361lb # [ 61.934056] envoy[922]: conn peer=[2001:db8:1::1]:60088 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=1244362lb # [ 61.939516] envoy[922]: conn peer=[2001:db8:1::1]:60096 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4326 tx=2198 ms=23674363lb # [ 61.945685] envoy[922]: conn peer=[2001:db8:1::1]:60098 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=664364lb # [ 61.950585] envoy[922]: conn peer=[2001:db8:1::1]:60104 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3859 tx=1877 ms=26254365lb # [ 61.955653] envoy[922]: conn peer=[2001:db8:1::1]:51038 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=314366client # [ 62.024116] nix-daemon[920]: accepted connection from pid 1020, user root (trusted)4367client # this derivation will be built:4368client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4369worker1 # [ 62.328869] nix-grpc-daemon[833]: ts=2026-09-20T08:07:13Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:561744370client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4371worker2 # [ 62.387620] nix-grpc-daemon[774]: ts=2026-09-20T08:07:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347764372worker2 # [ 62.418785] nix-grpc-daemon[774]: ts=2026-09-20T08:07:13Z level=debug event=want client=9 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04373worker2 # [ 62.427020] nix-grpc-daemon[774]: ts=2026-09-20T08:07:13Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14374worker2 # [ 62.466466] nix-grpc-daemon[774]: ts=2026-09-20T08:07:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347764375worker2 # [ 62.484960] nix-grpc-daemon[774]: ts=2026-09-20T08:07:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:347764376client # copying 1 paths to 'lb:50051'...4377client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4378worker2 # [ 62.510632] nix-grpc-daemon[774]: ts=2026-09-20T08:07:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:347764379worker2 # [ 62.527051] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4380worker2 # [ 62.552779] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 87 ms (attempt 1/5)4381worker2 # [ 62.647042] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 2/5)4382worker2 # [ 62.796564] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 316 ms (attempt 3/5)4383worker2 # [ 63.112974] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 387 ms (attempt 4/5)4384worker2 # [ 63.501120] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4385worker2 # [ 63.506733] nix-grpc-daemon[774]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4386worker2 # [ 63.759411] nix-daemon[835]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)4387worker2 # [ 63.781960] nix-daemon[835]: reaped child process 1146, status = succeeded4388worker2 # [ 63.964255] nix-daemon[835]: accepted connection from pid 1148, user nix-grpc-daemon (trusted)4389worker2 # [ 63.984072] nix-daemon[835]: reaped child process 1151, status = succeeded4390lb # [ 63.971200] niks3-server[1004]: 2026/09/20 08:07:15 INFO Received uploads request method=POST path=/api/pending_closures4391worker2 # [ 64.013790] nix-grpc-daemon[847]: time=2026-09-20T08:07:15.472Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4392worker2 # [ 64.015371] nix-grpc-daemon[847]: time=2026-09-20T08:07:15.472Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4393lb # [ 64.006793] niks3-server[1004]: 2026/09/20 08:07:15 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4394worker2 # [ 64.049816] nix-grpc-daemon[847]: time=2026-09-20T08:07:15.509Z level=INFO msg="Uploading 1 narinfos"4395lb # [ 64.023153] niks3-server[1004]: 2026/09/20 08:07:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4396lb # [ 64.034790] niks3-server[1004]: 2026/09/20 08:07:15 INFO Signed narinfos id=19 count=14397lb # [ 64.040879] niks3-server[1004]: 2026/09/20 08:07:15 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4398lb # [ 64.048416] niks3-server[1004]: 2026/09/20 08:07:15 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4399lb # [ 64.055855] niks3-server[1004]: 2026/09/20 08:07:15 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4400lb # [ 64.060055] niks3-server[1004]: 2026/09/20 08:07:15 INFO Completed upload id=194401worker2 # [ 64.087431] nix-grpc-daemon[847]: time=2026-09-20T08:07:15.546Z level=INFO msg="Upload complete. (555ms)"4402worker2 # [ 64.098477] nix-grpc-daemon[774]: ts=2026-09-20T08:07:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=1 paths=1 nar_bytes_in=5684403worker2 # [ 64.112261] nix-grpc-daemon[774]: ts=2026-09-20T08:07:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:347764404worker2 # [ 64.125526] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4405worker2 # [ 64.129416] nix-daemon[835]: reaped child process 1137, status = succeeded4406worker2 # [ 64.137372] nix-grpc-daemon[774]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4407client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4408worker2 # [ 64.153937] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4409client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4410worker2 # [ 65.183682] nix-daemon[835]: reaped child process 1156, status = succeeded4411worker2 # [ 65.354576] nix-daemon[835]: accepted connection from pid 1171, user nix-grpc-daemon (trusted)4412worker2 # [ 65.376913] nix-daemon[835]: reaped child process 1174, status = succeeded4413lb # [ 65.363152] niks3-server[1004]: 2026/09/20 08:07:16 INFO Received uploads request method=POST path=/api/pending_closures4414worker2 # [ 65.401697] nix-grpc-daemon[847]: time=2026-09-20T08:07:16.860Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4415worker2 # [ 65.437981] nix-grpc-daemon[847]: time=2026-09-20T08:07:16.897Z level=INFO msg="Uploading 1 narinfos"4416lb # [ 65.399093] niks3-server[1004]: 2026/09/20 08:07:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4417lb # [ 65.414994] niks3-server[1004]: 2026/09/20 08:07:16 INFO Signed narinfos id=20 count=14418lb # [ 65.422660] niks3-server[1004]: 2026/09/20 08:07:16 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4419lb # [ 65.429507] niks3-server[1004]: 2026/09/20 08:07:16 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4420worker2 # [ 65.468008] nix-grpc-daemon[847]: time=2026-09-20T08:07:16.927Z level=INFO msg="Upload complete. (299ms)"4421lb # [ 65.440375] niks3-server[1004]: 2026/09/20 08:07:16 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4422lb # [ 65.444888] niks3-server[1004]: 2026/09/20 08:07:16 INFO Completed upload id=204423lb # [ 65.448176] niks3-server[1004]: 2026/09/20 08:07:16 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4424worker2 # [ 65.480158] nix-grpc-daemon[774]: ts=2026-09-20T08:07:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=9 outputs=14425worker2 # [ 65.490266] nix-daemon[835]: reaped child process 1153, status = succeeded4426client # copying 1 paths...4427worker1 # [ 65.471963] nix-grpc-daemon[833]: ts=2026-09-20T08:07:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:561744428worker1 # [ 65.478790] nix-grpc-daemon[833]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4429client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4430worker2 # [ 65.576945] nix-grpc-daemon[774]: ts=2026-09-20T08:07:17Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:347764431worker2 # [ 65.584602] nix-grpc-daemon[774]: ts=2026-09-20T08:07:17Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=0 paths=1 nar_bytes_out=1204432client # [ 65.612770] nix-daemon[920]: reaped child process 1023, status = succeeded4433client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.81 seconds)4434client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24435client # [ 65.821306] nix-daemon[920]: accepted connection from pid 1041, user root (trusted)4436client # this derivation will be built:4437client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4438worker1 # [ 66.046295] nix-grpc-daemon[833]: ts=2026-09-20T08:07:17Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:561744439client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4440worker1 # [ 66.051241] nix-grpc-daemon[833]: ts=2026-09-20T08:07:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:561744441worker1 # [ 66.061070] nix-grpc-daemon[915]: time=2026-09-20T08:07:17.514Z level=INFO msg="All 1 paths already cached"4442worker2 # [ 66.135716] nix-grpc-daemon[774]: ts=2026-09-20T08:07:17Z level=debug event=want client=10 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04443worker2 # [ 66.142984] nix-grpc-daemon[774]: ts=2026-09-20T08:07:17Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14444worker1 # [ 66.092720] nix-grpc-daemon[833]: ts=2026-09-20T08:07:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561744445worker1 # [ 66.109194] nix-grpc-daemon[833]: ts=2026-09-20T08:07:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:561744446worker1 # [ 66.121222] nix-grpc-daemon[915]: time=2026-09-20T08:07:17.575Z level=INFO msg="All 1 paths already cached"4447client # copying 1 paths to 'lb:50051'...4448client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4449worker1 # [ 66.132809] nix-grpc-daemon[833]: ts=2026-09-20T08:07:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:561744450worker1 # [ 66.148625] nix-daemon[889]: accepted connection from pid 833, user nix-grpc-daemon (trusted)4451worker1 # [ 66.355918] nix-daemon[889]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)4452worker1 # [ 66.376481] nix-daemon[889]: reaped child process 1040, status = succeeded4453worker1 # [ 66.560829] nix-daemon[889]: accepted connection from pid 1042, user nix-grpc-daemon (trusted)4454worker1 # [ 66.579711] nix-daemon[889]: reaped child process 1045, status = succeeded4455lb # [ 66.619112] niks3-server[1004]: 2026/09/20 08:07:18 INFO Received uploads request method=POST path=/api/pending_closures4456worker1 # [ 66.609588] nix-grpc-daemon[915]: time=2026-09-20T08:07:18.063Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4457worker1 # [ 66.611223] nix-grpc-daemon[915]: time=2026-09-20T08:07:18.064Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4458lb # [ 66.658513] niks3-server[1004]: 2026/09/20 08:07:18 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4459worker1 # [ 66.647333] nix-grpc-daemon[915]: time=2026-09-20T08:07:18.101Z level=INFO msg="Uploading 1 narinfos"4460lb # [ 66.676599] niks3-server[1004]: 2026/09/20 08:07:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4461lb # [ 66.686478] niks3-server[1004]: 2026/09/20 08:07:18 INFO Signed narinfos id=21 count=14462lb # [ 66.690971] niks3-server[1004]: 2026/09/20 08:07:18 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4463lb # [ 66.700430] niks3-server[1004]: 2026/09/20 08:07:18 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4464worker1 # [ 66.679546] nix-grpc-daemon[915]: time=2026-09-20T08:07:18.134Z level=INFO msg="Upload complete. (512ms)"4465lb # [ 66.707650] niks3-server[1004]: 2026/09/20 08:07:18 INFO Completed upload id=214466lb # [ 66.711003] niks3-server[1004]: 2026/09/20 08:07:18 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4467worker1 # [ 66.689156] nix-grpc-daemon[833]: ts=2026-09-20T08:07:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56174 duration_s=0 paths=1 nar_bytes_in=5684468worker1 # [ 66.706999] nix-grpc-daemon[833]: ts=2026-09-20T08:07:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561744469worker1 # [ 66.717407] nix-daemon[889]: accepted connection from pid 833, user nix-grpc-daemon (trusted)4470worker1 # [ 66.720505] nix-daemon[889]: reaped child process 1035, status = succeeded4471client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4472worker1 # [ 66.736754] nix-daemon[889]: accepted connection from pid 833, user nix-grpc-daemon (trusted)4473client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4474worker1 # [ 67.963176] nix-daemon[889]: reaped child process 1049, status = succeeded4475worker1 # [ 68.119272] nix-daemon[889]: accepted connection from pid 1064, user nix-grpc-daemon (trusted)4476worker1 # [ 68.140271] nix-daemon[889]: reaped child process 1067, status = succeeded4477lb # [ 68.177286] niks3-server[1004]: 2026/09/20 08:07:19 INFO Received uploads request method=POST path=/api/pending_closures4478worker1 # [ 68.162372] nix-grpc-daemon[915]: time=2026-09-20T08:07:19.615Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4479lb # [ 68.210493] niks3-server[1004]: 2026/09/20 08:07:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4480worker1 # [ 68.195551] nix-grpc-daemon[915]: time=2026-09-20T08:07:19.650Z level=INFO msg="Uploading 1 narinfos"4481lb # [ 68.226837] niks3-server[1004]: 2026/09/20 08:07:19 INFO Signed narinfos id=22 count=14482lb # [ 68.233944] niks3-server[1004]: 2026/09/20 08:07:19 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4483lb # [ 68.247554] niks3-server[1004]: 2026/09/20 08:07:19 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4484lb # [ 68.252071] niks3-server[1004]: 2026/09/20 08:07:19 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4485lb # [ 68.256730] niks3-server[1004]: 2026/09/20 08:07:19 INFO Completed upload id=224486worker1 # [ 68.229750] nix-grpc-daemon[915]: time=2026-09-20T08:07:19.684Z level=INFO msg="Upload complete. (281ms)"4487lb # [ 68.259502] niks3-server[1004]: 2026/09/20 08:07:19 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4488worker1 # [ 68.241029] nix-grpc-daemon[833]: ts=2026-09-20T08:07:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56174 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=10 outputs=14489worker1 # [ 68.254470] nix-daemon[889]: reaped child process 1047, status = succeeded4490client # copying 1 paths...4491worker2 # [ 68.342959] nix-grpc-daemon[774]: ts=2026-09-20T08:07:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:347764492worker2 # [ 68.358695] nix-grpc-daemon[774]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4493client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4494worker2 # [ 68.408153] nix-grpc-daemon[774]: ts=2026-09-20T08:07:19Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:347764495worker2 # [ 68.415032] nix-grpc-daemon[774]: ts=2026-09-20T08:07:19Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34776 duration_s=0 paths=1 nar_bytes_out=1204496client # [ 68.485854] nix-daemon[920]: reaped child process 1044, status = succeeded4497client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.87 seconds)4498(finished: subtest: an input only one worker has still reaches the builder, in 10.84 seconds)4499subtest: upload whose reference the worker lacks is completed from the cache4500client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4501client # this derivation will be built:4502client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4503client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4504client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.47 seconds)4505client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4506client # this derivation will be built:4507client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4508client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4509client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.52 seconds)4510client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4511client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.22 seconds)4512worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4513worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.24 seconds)4514worker2 # [ 70.081845] systemd[1]: Stopping Nix worker-protocol over gRPC...4515worker2 # [ 70.369027] nix-grpc-daemon[774]: ts=2026-09-20T08:07:21Z level=info event=signal_exit4516worker2 # [ 70.604619] nix-grpc-daemon[774]: ts=2026-09-20T08:07:22Z level=info event=scheduler_yield4517worker1 # [ 70.555886] nix-grpc-daemon[833]: ts=2026-09-20T08:07:22Z level=info event=scheduler_restarting addr=lb:500514518worker2 # [ 70.611727] nix-grpc-daemon[774]: ts=2026-09-20T08:07:22Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:347644519lb # [ 70.586316] niks3-server[1004]: 2026/09/20 08:07:22 INFO lead: released remote=192.168.1.4:455084520worker2 # [ 70.618396] nix-grpc-daemon[774]: ts=2026-09-20T08:07:22Z level=info event=worker_gone addr=192.168.1.3:500514521worker2 # [ 70.623307] nix-grpc-daemon[774]: ts=2026-09-20T08:07:22Z level=info event=scheduler_restarting addr=lb:500514522worker2 # [ 70.630769] nix-grpc-daemon[774]: ts=2026-09-20T08:07:22Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:347644523worker2 # [ 70.635664] nix-grpc-daemon[774]: ts=2026-09-20T08:07:22Z level=info event=worker_gone addr=192.168.1.4:500514524worker1 # [ 70.756863] nix-grpc-daemon[833]: ts=2026-09-20T08:07:22Z level=info event=scheduler_connected addr=lb:500514525worker2 # [ 70.819776] nix-grpc-daemon[774]: ts=2026-09-20T08:07:22Z level=info event=scheduler_connected addr=lb:500514526worker1 # [ 70.765221] nix-grpc-daemon[833]: ts=2026-09-20T08:07:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4527worker2 # [ 70.843374] nix-grpc-daemon[774]: ts=2026-09-20T08:07:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4528worker1 # [ 70.966837] nix-grpc-daemon[833]: ts=2026-09-20T08:07:22Z level=info event=scheduler_connected addr=lb:500514529worker1 # [ 70.974448] nix-grpc-daemon[833]: ts=2026-09-20T08:07:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4530worker2 # [ 71.044786] nix-grpc-daemon[774]: ts=2026-09-20T08:07:22Z level=info event=scheduler_connected addr=lb:500514531worker2 # [ 71.052753] nix-grpc-daemon[774]: ts=2026-09-20T08:07:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4532worker1 # [ 71.175916] nix-grpc-daemon[833]: ts=2026-09-20T08:07:22Z level=info event=scheduler_connected addr=lb:500514533worker1 # [ 71.183460] nix-grpc-daemon[833]: ts=2026-09-20T08:07:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4534worker2 # [ 71.254249] nix-grpc-daemon[774]: ts=2026-09-20T08:07:22Z level=info event=scheduler_connected addr=lb:500514535worker2 # [ 71.261382] nix-grpc-daemon[774]: ts=2026-09-20T08:07:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4536worker1 # [ 71.385146] nix-grpc-daemon[833]: ts=2026-09-20T08:07:22Z level=info event=scheduler_connected addr=lb:500514537worker1 # [ 71.392672] nix-grpc-daemon[833]: ts=2026-09-20T08:07:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4538worker2 # [ 71.466513] nix-grpc-daemon[774]: ts=2026-09-20T08:07:22Z level=info event=scheduler_connected addr=lb:500514539worker2 # [ 71.471117] nix-grpc-daemon[774]: ts=2026-09-20T08:07:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4540worker2 # [ 71.612263] nix-grpc-daemon[774]: ts=2026-09-20T08:07:23Z level=info event=scheduler_restarting4541worker1 # [ 71.599589] nix-grpc-daemon[833]: ts=2026-09-20T08:07:23Z level=info event=scheduler_connected addr=lb:500514542worker2 # [ 71.655373] nix-daemon[835]: reaped child process 838, status = succeeded4543worker1 # [ 71.604321] nix-grpc-daemon[833]: ts=2026-09-20T08:07:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4544worker2 # [ 71.689337] nix-grpc-daemon[774]: ts=2026-09-20T08:07:23Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4545worker1 # [ 71.800825] nix-grpc-daemon[833]: ts=2026-09-20T08:07:23Z level=info event=scheduler_connected addr=lb:500514546worker2 # [ 71.858033] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4547worker2 # [ 71.863005] nix-grpc-daemon[774]: E0000 00:00:1789891643.317073 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true4548lb # [ 71.915490] envoy[922]: conn peer=[2001:db8:1::1]:51050 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3739 tx=1933 ms=32214549lb # [ 71.921383] envoy[922]: conn peer=[2001:db8:1::1]:51058 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=284550lb # [ 71.926594] envoy[922]: conn peer=[2001:db8:1::1]:51074 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3723 tx=1892 ms=23724551lb # [ 71.933339] envoy[922]: conn peer=[2001:db8:1::1]:51080 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=704552lb # [ 71.939646] envoy[922]: conn peer=192.168.1.4:42928 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4972 tx=1650 ms=483244553worker2 # [ 72.558140] nix-grpc-daemon[774]: E0000 00:00:1789891644.016013 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4554worker2 # [ 72.574277] nix-grpc-daemon[774]: E0000 00:00:1789891644.033497 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true4555lb # [ 72.798562] niks3-server[1004]: 2026/09/20 08:07:24 INFO lead: acquired remote=192.168.1.3:580924556worker1 # [ 72.772353] nix-grpc-daemon[833]: ts=2026-09-20T08:07:24Z level=info event=scheduler_take_over4557worker1 # [ 73.077781] nix-grpc-daemon[833]: ts=2026-09-20T08:07:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4558worker2 # [ 73.157906] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4559worker2 # [ 73.166514] systemd[1]: Stopped Nix worker-protocol over gRPC.4560worker2 # [ 73.175432] systemd[1]: nix-grpc-daemon.service: Consumed 3.473s CPU time over 51.197s wall clock time, 59.9M memory peak, 76.2K incoming IP traffic, 146.1K outgoing IP traffic.4561worker2 # [ 73.190422] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4562worker2 # [ 73.198615] systemd[1]: Closed Nix worker-protocol over gRPC.4563worker2 # [ 73.201169] systemd[1]: nix-grpc-daemon.socket: Consumed 737us CPU time over 1min 783ms wall clock time, 256K memory peak, 95.7K incoming IP traffic, 78.8K outgoing IP traffic.4564lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4565lb: must succeed: curl -sf localhost:9901/clusters4566lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4567lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.11 seconds)4568client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24569worker1 # [ 73.279327] nix-grpc-daemon[833]: ts=2026-09-20T08:07:24Z level=info event=scheduler_connected addr=lb:500514570worker1 # [ 73.286308] nix-grpc-daemon[833]: ts=2026-09-20T08:07:24Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04571worker1 # [ 73.558526] nix-grpc-daemon[833]: ts=2026-09-20T08:07:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:561744572worker1 # [ 73.569339] nix-grpc-daemon[833]: ts=2026-09-20T08:07:25Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:561744573client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4574client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.35 seconds)4575worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4576worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.05 seconds)4577worker2 # [ 73.787088] systemd[1]: Listening on Nix worker-protocol over gRPC.4578worker1 # [ 73.831199] systemd[1]: Stopping Nix worker-protocol over gRPC...4579worker2 # [ 74.149300] systemd[1]: Starting Nix worker-protocol over gRPC...4580worker1 # [ 74.329861] nix-grpc-daemon[833]: ts=2026-09-20T08:07:25Z level=info event=signal_exit4581worker2 # [ 74.389009] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:25Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4582worker2 # [ 74.391838] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:25Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14583worker2 # [ 74.401037] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:25Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4584worker2 # [ 74.403164] systemd[1]: Started Nix worker-protocol over gRPC.4585worker2 # [ 74.436854] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:25Z level=info event=scheduler_connected addr=lb:500514586worker1 # [ 74.385400] nix-grpc-daemon[833]: ts=2026-09-20T08:07:25Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04587worker1 # [ 74.543477] nix-grpc-daemon[833]: ts=2026-09-20T08:07:25Z level=info event=scheduler_yield4588worker2 # [ 74.603090] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:26Z level=info event=scheduler_restarting addr=lb:500514589worker1 # [ 74.551940] nix-grpc-daemon[833]: ts=2026-09-20T08:07:26Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:561684590lb # [ 74.576851] niks3-server[1004]: 2026/09/20 08:07:26 INFO lead: released remote=192.168.1.3:580924591worker1 # [ 74.557135] nix-grpc-daemon[833]: ts=2026-09-20T08:07:26Z level=info event=worker_gone addr=192.168.1.4:500514592worker1 # [ 74.563548] nix-grpc-daemon[833]: ts=2026-09-20T08:07:26Z level=info event=scheduler_restarting addr=lb:500514593worker1 # [ 74.570225] nix-grpc-daemon[833]: ts=2026-09-20T08:07:26Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:561684594worker1 # [ 74.575523] nix-grpc-daemon[833]: ts=2026-09-20T08:07:26Z level=info event=worker_gone addr=192.168.1.3:500514595worker2 # [ 74.804760] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:26Z level=info event=scheduler_connected addr=lb:500514596worker1 # [ 74.764874] nix-grpc-daemon[833]: ts=2026-09-20T08:07:26Z level=info event=scheduler_connected addr=lb:500514597worker2 # [ 74.817826] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4598worker1 # [ 74.789288] nix-grpc-daemon[833]: ts=2026-09-20T08:07:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4599worker2 # [ 75.020216] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:26Z level=info event=scheduler_connected addr=lb:500514600worker2 # [ 75.029994] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4601worker1 # [ 74.991434] nix-grpc-daemon[833]: ts=2026-09-20T08:07:26Z level=info event=scheduler_connected addr=lb:500514602worker1 # [ 75.000509] nix-grpc-daemon[833]: ts=2026-09-20T08:07:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4603worker2 # [ 75.231111] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:26Z level=info event=scheduler_connected addr=lb:500514604worker2 # [ 75.239300] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4605worker1 # [ 75.201531] nix-grpc-daemon[833]: ts=2026-09-20T08:07:26Z level=info event=scheduler_connected addr=lb:500514606worker1 # [ 75.209103] nix-grpc-daemon[833]: ts=2026-09-20T08:07:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4607worker2 # [ 75.444444] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:26Z level=info event=scheduler_connected addr=lb:500514608worker2 # [ 75.448828] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4609worker1 # [ 75.415141] nix-grpc-daemon[833]: ts=2026-09-20T08:07:26Z level=info event=scheduler_connected addr=lb:500514610worker1 # [ 75.419632] nix-grpc-daemon[833]: ts=2026-09-20T08:07:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4611worker1 # [ 75.554007] nix-grpc-daemon[833]: ts=2026-09-20T08:07:27Z level=info event=scheduler_restarting4612worker1 # [ 75.592524] nix-daemon[889]: reaped child process 891, status = succeeded4613worker2 # [ 75.645236] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:27Z level=info event=scheduler_connected addr=lb:500514614worker2 # [ 75.655066] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4615worker1 # [ 75.637645] nix-grpc-daemon[833]: ts=2026-09-20T08:07:27Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4616worker2 # [ 75.856662] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:27Z level=info event=scheduler_connected addr=lb:500514617worker1 # [ 75.804585] nix-grpc-daemon[833]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4618worker1 # [ 75.809586] nix-grpc-daemon[833]: E0000 00:00:1789891647.259040 876 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4619worker1 # [ 76.517061] nix-grpc-daemon[833]: E0000 00:00:1789891647.970011 876 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4620worker2 # [ 77.035385] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:28Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4621worker1 # [ 76.524108] nix-grpc-daemon[833]: E0000 00:00:1789891647.970390 876 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true4622worker1 # [ 77.005027] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4623worker1 # [ 77.026761] systemd[1]: Stopped Nix worker-protocol over gRPC.4624worker1 # [ 77.033434] systemd[1]: nix-grpc-daemon.service: Consumed 2.076s CPU time over 55.105s wall clock time, 48.7M memory peak, 49.1K incoming IP traffic, 83.9K outgoing IP traffic.4625worker1 # [ 77.042329] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4626worker1 # [ 77.045157] systemd[1]: Closed Nix worker-protocol over gRPC.4627worker1 # [ 77.048543] systemd[1]: nix-grpc-daemon.socket: Consumed 727us CPU time over 1min 3.704s wall clock time, 256K memory peak, 79.5K incoming IP traffic, 70.2K outgoing IP traffic.4628lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4629lb: must succeed: curl -sf localhost:9901/clusters4630lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4631lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.10 seconds)4632client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24633worker2 # [ 77.238751] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:28Z level=info event=scheduler_connected addr=lb:500514634worker2 # [ 77.245099] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4635worker2 # [ 77.445827] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:28Z level=info event=scheduler_connected addr=lb:500514636worker2 # [ 77.451959] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:28Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4637worker2 # [ 77.498286] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:370324638worker2 # [ 77.517587] nix-daemon[835]: accepted connection from pid 1198, user nix-grpc-daemon (trusted)4639worker2 # [ 77.546276] nix-grpc-daemon[1198]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 1/5)4640worker2 # [ 77.592813] nix-grpc-daemon[1198]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 2/5)4641worker2 # [ 77.653200] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:29Z level=info event=scheduler_connected addr=lb:500514642worker2 # [ 77.662504] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4643worker2 # [ 77.678244] nix-grpc-daemon[1198]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 3/5)4644worker2 # [ 77.826695] nix-grpc-daemon[1198]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 123 ms (attempt 4/5)4645worker2 # [ 77.863968] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:29Z level=info event=scheduler_connected addr=lb:500514646worker2 # [ 77.869849] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:29Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4647worker2 # [ 77.958576] nix-grpc-daemon[1198]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4648client # copying 2 paths...4649client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4650worker2 # [ 77.993414] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:370324651client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4652worker2 # [ 78.015442] nix-daemon[835]: accepted connection from pid 1198, user nix-grpc-daemon (trusted)4653worker2 # [ 78.053869] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:29Z level=info event=niks3_push_started pid=12544654worker2 # [ 78.070790] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:29Z level=info event=scheduler_connected addr=lb:500514655worker2 # [ 78.081670] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4656worker2 # [ 78.280609] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:29Z level=info event=scheduler_connected addr=lb:500514657worker2 # [ 78.299554] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:29Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4658worker2 # [ 78.485284] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:29Z level=info event=scheduler_connected addr=lb:500514659worker2 # [ 78.504354] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4660worker2 # [ 78.528435] nix-daemon[835]: accepted connection from pid 1267, user nix-grpc-daemon (trusted)4661worker2 # [ 78.550008] nix-daemon[835]: reaped child process 1270, status = succeeded4662lb # [ 78.538056] niks3-server[1004]: 2026/09/20 08:07:29 INFO Received uploads request method=POST path=/api/pending_closures4663lb # [ 78.553494] niks3-server[1004]: 2026/09/20 08:07:30 INFO Received uploads request method=POST path=/api/pending_closures4664worker2 # [ 78.592577] nix-grpc-daemon[1254]: time=2026-09-20T08:07:30.050Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4665worker2 # [ 78.594311] nix-grpc-daemon[1254]: time=2026-09-20T08:07:30.051Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4666worker2 # [ 78.599486] nix-grpc-daemon[1254]: time=2026-09-20T08:07:30.051Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4667lb # [ 78.625518] niks3-server[1004]: 2026/09/20 08:07:30 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4668lb # [ 78.636514] niks3-server[1004]: 2026/09/20 08:07:30 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4669lb # [ 78.652911] niks3-server[1004]: 2026/09/20 08:07:30 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4670lb # [ 78.661503] niks3-server[1004]: 2026/09/20 08:07:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4671worker2 # [ 78.690829] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:30Z level=info event=scheduler_connected addr=lb:500514672worker2 # [ 78.702571] nix-grpc-daemon[1254]: time=2026-09-20T08:07:30.160Z level=INFO msg="Uploading 3 narinfos"4673lb # [ 78.675203] niks3-server[1004]: 2026/09/20 08:07:30 INFO Signed narinfos id=23 count=14674lb # [ 78.677797] niks3-server[1004]: 2026/09/20 08:07:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4675lb # [ 78.681538] niks3-server[1004]: 2026/09/20 08:07:30 INFO Signed narinfos id=24 count=24676worker2 # [ 78.706766] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:30Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4677lb # [ 78.683596] niks3-server[1004]: 2026/09/20 08:07:30 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4678lb # [ 78.716332] niks3-server[1004]: 2026/09/20 08:07:30 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4679worker2 # [ 78.906887] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:30Z level=info event=scheduler_connected addr=lb:500514680worker2 # [ 78.915101] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4681lb # [ 78.939829] niks3-server[1004]: 2026/09/20 08:07:30 INFO Completed upload id=234682lb # [ 78.948356] niks3-server[1004]: 2026/09/20 08:07:30 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4683lb # [ 78.958478] niks3-server[1004]: 2026/09/20 08:07:30 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4684lb # [ 78.975067] niks3-server[1004]: 2026/09/20 08:07:30 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4685lb # [ 79.000579] niks3-server[1004]: 2026/09/20 08:07:30 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4686worker2 # [ 79.036721] nix-grpc-daemon[1254]: time=2026-09-20T08:07:30.496Z level=INFO msg="Upload complete. (711ms)"4687lb # [ 79.011011] niks3-server[1004]: 2026/09/20 08:07:30 INFO Completed upload id=244688worker2 # [ 79.048502] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37032 duration_s=1 paths=2 nar_bytes_in=3124689worker2 # [ 79.069810] nix-daemon[835]: reaped child process 1252, status = succeeded4690client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.90 seconds)4691worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4692worker2 # [ 79.118750] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:30Z level=info event=scheduler_connected addr=lb:500514693worker2 # [ 79.127859] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:30Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4694worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.06 seconds)4695worker1 # [ 79.205259] systemd[1]: Listening on Nix worker-protocol over gRPC.4696worker1 # [ 79.213581] systemd[1]: Starting Nix worker-protocol over gRPC...4697worker2 # [ 79.327312] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:30Z level=info event=scheduler_connected addr=lb:500514698worker2 # [ 79.333548] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4699lb # [ 79.389066] niks3-server[1004]: 2026/09/20 08:07:30 INFO lead: acquired remote=192.168.1.4:354324700worker2 # [ 79.420996] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:30Z level=info event=scheduler_take_over4701worker1 # [ 79.444984] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4702worker1 # [ 79.448499] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14703worker1 # [ 79.458582] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4704worker1 # [ 79.471119] systemd[1]: Started Nix worker-protocol over gRPC.4705lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4706lb: must succeed: curl -sf localhost:9901/clusters4707worker2 # [ 79.535299] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:30Z level=info event=scheduler_connected addr=lb:500514708worker1 # [ 79.493614] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:30Z level=info event=scheduler_connected addr=lb:500514709worker2 # [ 79.548233] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:31Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04710worker2 # [ 79.555712] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:31Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04711lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4712lb: must succeed: curl -sf localhost:9901/clusters4713lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4714lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.22 seconds)4715(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 12.19 seconds)4716subtest: scheduler down: the other node takes the lock and keeps it4717lb: must succeed: curl -sf localhost:9901/clusters4718lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4719lb: must succeed: curl -sf localhost:9901/clusters4720lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4721lb: must succeed: curl -sf localhost:9901/clusters4722lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4723lb: must succeed: curl -sf localhost:9901/clusters4724lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4725worker2 # [ 81.069300] systemd[1]: Stopping Nix worker-protocol over gRPC...4726worker2 # [ 81.408103] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:32Z level=info event=signal_exit4727worker2 # [ 81.623404] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:33Z level=info event=scheduler_yield4728lb # [ 81.596920] niks3-server[1004]: 2026/09/20 08:07:33 INFO lead: released remote=192.168.1.4:354324729worker1 # [ 81.579257] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:33Z level=info event=scheduler_restarting addr=lb:500514730worker2 # [ 81.634569] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:370264731worker2 # [ 81.642234] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:33Z level=info event=worker_gone addr=192.168.1.3:500514732worker2 # [ 81.646629] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:33Z level=info event=scheduler_restarting addr=lb:500514733worker2 # [ 81.650867] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:370264734worker2 # [ 81.655546] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:33Z level=info event=worker_gone addr=192.168.1.4:500514735worker1 # [ 81.785514] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:33Z level=info event=scheduler_connected addr=lb:500514736worker2 # [ 81.842000] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:33Z level=info event=scheduler_connected addr=lb:500514737worker1 # [ 81.799576] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4738worker2 # [ 81.867205] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4739lb # [ 81.915676] envoy[922]: conn peer=[2001:db8:1::1]:57172 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=314740lb # [ 81.921063] envoy[922]: conn peer=[2001:db8:1::3]:37638 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5627 tx=1769 ms=525214741lb # [ 81.926335] envoy[922]: conn peer=[2001:db8:1::1]:57180 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1005 tx=305 ms=15714742worker1 # [ 82.000735] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:33Z level=info event=scheduler_connected addr=lb:500514743worker1 # [ 82.008782] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4744worker2 # [ 82.068405] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:33Z level=info event=scheduler_connected addr=lb:500514745worker2 # [ 82.076845] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4746worker1 # [ 82.210530] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:33Z level=info event=scheduler_connected addr=lb:500514747worker1 # [ 82.219786] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4748worker2 # [ 82.278446] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:33Z level=info event=scheduler_connected addr=lb:500514749worker2 # [ 82.285633] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4750worker1 # [ 82.421446] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:33Z level=info event=scheduler_connected addr=lb:500514751worker1 # [ 82.429147] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4752worker2 # [ 82.490604] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:33Z level=info event=scheduler_connected addr=lb:500514753worker2 # [ 82.495027] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4754worker2 # [ 82.629388] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:34Z level=info event=scheduler_restarting4755worker2 # [ 82.665708] nix-daemon[835]: reaped child process 1247, status = succeeded4756worker1 # [ 82.630744] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:34Z level=info event=scheduler_connected addr=lb:500514757worker1 # [ 82.635240] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4758worker2 # [ 82.711895] nix-grpc-daemon[1198]: ts=2026-09-20T08:07:34Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4759worker1 # [ 82.836963] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:34Z level=info event=scheduler_connected addr=lb:500514760worker2 # [ 82.893923] nix-grpc-daemon[1198]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4761worker2 # [ 82.898670] nix-grpc-daemon[1198]: E0000 00:00:1789891654.353090 1241 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true4762worker2 # [ 83.440734] nix-grpc-daemon[1198]: E0000 00:00:1789891654.899936 1241 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4763worker2 # [ 83.455325] nix-grpc-daemon[1198]: E0000 00:00:1789891654.914835 1241 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true4764worker1 # [ 84.373162] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:35Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4765worker2 # [ 84.450262] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4766worker2 # [ 84.454586] systemd[1]: Stopped Nix worker-protocol over gRPC.4767worker2 # [ 84.464611] systemd[1]: nix-grpc-daemon.service: Consumed 652ms CPU time over 10.299s wall clock time, 30.8M memory peak, 21.6K incoming IP traffic, 29.1K outgoing IP traffic.4768worker2 # [ 84.473965] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4769worker2 # [ 84.474967] systemd[1]: Closed Nix worker-protocol over gRPC.4770worker2 # [ 84.475775] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 10.703s wall clock time, 256K memory peak, 30.7K incoming IP traffic, 24.8K outgoing IP traffic.4771worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4772worker1 # [ 84.472876] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:35Z level=info event=scheduler_take_over4773lb # [ 84.502425] niks3-server[1004]: 2026/09/20 08:07:35 INFO lead: acquired remote=192.168.1.3:535584774worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.11 seconds)4775worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4776worker1 # [ 84.572817] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:36Z level=info event=scheduler_connected addr=lb:500514777worker1 # [ 84.579302] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:36Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04778worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)4779client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&24780worker1 # [ 85.023515] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346124781worker1 # [ 85.039422] nix-daemon[889]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)4782client # don't know how to build these paths:4783client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4784worker1 # [ 85.083238] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:36Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04785worker1 # [ 85.091484] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:36Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14786worker1 # [ 85.134164] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346124787worker1 # [ 85.158526] nix-grpc-daemon[1090]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 1/5)4788worker1 # [ 85.243333] nix-grpc-daemon[1090]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 2/5)4789worker1 # [ 85.263605] nix-grpc-daemon[1090]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 262 ms (attempt 3/5)4790worker1 # [ 85.535262] nix-grpc-daemon[1090]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 569 ms (attempt 4/5)4791worker1 # [ 86.113368] nix-grpc-daemon[1090]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4792worker1 # [ 86.141175] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346124793client # copying 1 paths to 'lb:50051'...4794worker1 # [ 86.162118] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346124795client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4796worker1 # [ 86.184465] nix-daemon[889]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)4797worker1 # [ 86.219801] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:37Z level=info event=niks3_push_started pid=11594798worker1 # [ 86.677205] nix-daemon[889]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)4799worker1 # [ 86.698976] nix-daemon[889]: reaped child process 1175, status = succeeded4800worker1 # [ 86.898046] nix-daemon[889]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)4801worker1 # [ 86.919765] nix-daemon[889]: reaped child process 1180, status = succeeded4802lb # [ 86.961378] niks3-server[1004]: 2026/09/20 08:07:38 INFO Received uploads request method=POST path=/api/pending_closures4803worker1 # [ 86.956619] nix-grpc-daemon[1159]: time=2026-09-20T08:07:38.409Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4804worker1 # [ 86.958205] nix-grpc-daemon[1159]: time=2026-09-20T08:07:38.409Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4805lb # [ 87.029841] niks3-server[1004]: 2026/09/20 08:07:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4806lb # [ 87.044963] niks3-server[1004]: 2026/09/20 08:07:38 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4807lb # [ 87.056814] niks3-server[1004]: 2026/09/20 08:07:38 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4808lb # [ 87.068675] niks3-server[1004]: 2026/09/20 08:07:38 INFO Signed narinfos id=25 count=14809worker1 # [ 87.045591] nix-grpc-daemon[1159]: time=2026-09-20T08:07:38.499Z level=INFO msg="Uploading 1 narinfos"4810lb # [ 87.081473] niks3-server[1004]: 2026/09/20 08:07:38 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4811lb # [ 87.089063] niks3-server[1004]: 2026/09/20 08:07:38 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4812lb # [ 87.101888] niks3-server[1004]: 2026/09/20 08:07:38 INFO Completed upload id=254813worker1 # [ 87.077540] nix-grpc-daemon[1159]: time=2026-09-20T08:07:38.532Z level=INFO msg="Upload complete. (596ms)"4814worker1 # [ 87.094150] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34612 duration_s=0 paths=1 nar_bytes_in=5204815worker1 # [ 87.115686] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346124816worker1 # [ 87.123651] nix-daemon[889]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)4817worker1 # [ 87.130324] nix-daemon[889]: reaped child process 1157, status = succeeded4818client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4819client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4820worker1 # [ 87.147197] nix-daemon[889]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)4821client # farm-a> LOG-farm-a-on-standby4822worker1 # [ 88.580243] nix-daemon[889]: reaped child process 1184, status = succeeded4823worker1 # [ 88.768426] nix-daemon[889]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)4824worker1 # [ 88.792612] nix-daemon[889]: reaped child process 1202, status = succeeded4825lb # [ 88.837637] niks3-server[1004]: 2026/09/20 08:07:40 INFO Received uploads request method=POST path=/api/pending_closures4826worker1 # [ 88.824574] nix-grpc-daemon[1159]: time=2026-09-20T08:07:40.277Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4827worker1 # [ 88.826144] nix-grpc-daemon[1159]: time=2026-09-20T08:07:40.277Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4828lb # [ 88.889040] niks3-server[1004]: 2026/09/20 08:07:40 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4829lb # [ 88.903835] niks3-server[1004]: 2026/09/20 08:07:40 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4830lb # [ 88.924304] niks3-server[1004]: 2026/09/20 08:07:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4831worker1 # [ 88.904160] nix-grpc-daemon[1159]: time=2026-09-20T08:07:40.357Z level=INFO msg="Uploading 1 narinfos"4832lb # [ 88.934072] niks3-server[1004]: 2026/09/20 08:07:40 INFO Signed narinfos id=26 count=14833lb # [ 88.938955] niks3-server[1004]: 2026/09/20 08:07:40 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4834lb # [ 88.956502] niks3-server[1004]: 2026/09/20 08:07:40 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4835worker1 # [ 88.937628] nix-grpc-daemon[1159]: time=2026-09-20T08:07:40.392Z level=INFO msg="Upload complete. (370ms)"4836lb # [ 88.967364] niks3-server[1004]: 2026/09/20 08:07:40 INFO Completed upload id=264837lb # [ 88.970875] niks3-server[1004]: 2026/09/20 08:07:40 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4838worker1 # [ 88.972719] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34612 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14839worker1 # [ 88.986501] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:40Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04840worker1 # [ 88.990167] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:40Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=14841worker1 # [ 88.994072] nix-daemon[889]: reaped child process 1182, status = succeeded4842worker1 # [ 89.017602] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346124843worker1 # [ 89.038468] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346124844worker1 # [ 89.062436] nix-grpc-daemon[1159]: time=2026-09-20T08:07:40.517Z level=INFO msg="All 1 paths already cached"4845client # copying 1 paths to 'lb:50051'...4846client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4847worker1 # [ 89.074895] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346124848worker1 # [ 89.094889] nix-daemon[889]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)4849worker1 # [ 89.333648] nix-daemon[889]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)4850worker1 # [ 89.353609] nix-daemon[889]: reaped child process 1211, status = succeeded4851worker1 # [ 89.544725] nix-daemon[889]: accepted connection from pid 1213, user nix-grpc-daemon (trusted)4852worker1 # [ 89.564078] nix-daemon[889]: reaped child process 1216, status = succeeded4853lb # [ 89.602166] niks3-server[1004]: 2026/09/20 08:07:41 INFO Received uploads request method=POST path=/api/pending_closures4854worker1 # [ 89.589468] nix-grpc-daemon[1159]: time=2026-09-20T08:07:41.043Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4855worker1 # [ 89.591084] nix-grpc-daemon[1159]: time=2026-09-20T08:07:41.043Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4856lb # [ 89.642993] niks3-server[1004]: 2026/09/20 08:07:41 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4857lb # [ 89.661733] niks3-server[1004]: 2026/09/20 08:07:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4858worker1 # [ 89.643041] nix-grpc-daemon[1159]: time=2026-09-20T08:07:41.097Z level=INFO msg="Uploading 1 narinfos"4859lb # [ 89.674931] niks3-server[1004]: 2026/09/20 08:07:41 INFO Signed narinfos id=27 count=14860lb # [ 89.683261] niks3-server[1004]: 2026/09/20 08:07:41 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls4861lb # [ 89.700158] niks3-server[1004]: 2026/09/20 08:07:41 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4862lb # [ 89.710638] niks3-server[1004]: 2026/09/20 08:07:41 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo4863lb # [ 89.715235] niks3-server[1004]: 2026/09/20 08:07:41 INFO Completed upload id=274864worker1 # [ 89.688745] nix-grpc-daemon[1159]: time=2026-09-20T08:07:41.143Z level=INFO msg="Upload complete. (572ms)"4865worker1 # [ 89.700697] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34612 duration_s=0 paths=1 nar_bytes_in=6404866worker1 # [ 89.715532] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346124867worker1 # [ 89.731087] nix-daemon[889]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)4868worker1 # [ 89.737118] nix-daemon[889]: reaped child process 1206, status = succeeded4869client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...4870client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4871worker1 # [ 89.756303] nix-daemon[889]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)4872client # farm-b> LOG-farm-b-on-standby4873worker1 # [ 91.220507] nix-daemon[889]: reaped child process 1220, status = succeeded4874worker1 # [ 91.405371] nix-daemon[889]: accepted connection from pid 1235, user nix-grpc-daemon (trusted)4875worker1 # [ 91.426264] nix-daemon[889]: reaped child process 1238, status = succeeded4876lb # [ 91.467768] niks3-server[1004]: 2026/09/20 08:07:42 INFO Received uploads request method=POST path=/api/pending_closures4877worker1 # [ 91.454659] nix-grpc-daemon[1159]: time=2026-09-20T08:07:42.908Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4878worker1 # [ 91.456296] nix-grpc-daemon[1159]: time=2026-09-20T08:07:42.908Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"4879lb # [ 91.517605] niks3-server[1004]: 2026/09/20 08:07:42 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4880lb # [ 91.532963] niks3-server[1004]: 2026/09/20 08:07:42 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst4881lb # [ 91.547968] niks3-server[1004]: 2026/09/20 08:07:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4882worker1 # [ 91.528833] nix-grpc-daemon[1159]: time=2026-09-20T08:07:42.982Z level=INFO msg="Uploading 1 narinfos"4883lb # [ 91.557724] niks3-server[1004]: 2026/09/20 08:07:43 INFO Signed narinfos id=28 count=14884lb # [ 91.566267] niks3-server[1004]: 2026/09/20 08:07:43 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls4885lb # [ 91.577003] niks3-server[1004]: 2026/09/20 08:07:43 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4886lb # [ 91.586370] niks3-server[1004]: 2026/09/20 08:07:43 INFO Completed upload id=284887worker1 # [ 91.559268] nix-grpc-daemon[1159]: time=2026-09-20T08:07:43.013Z level=INFO msg="Upload complete. (388ms)"4888lb # [ 91.589234] niks3-server[1004]: 2026/09/20 08:07:43 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo4889worker1 # [ 91.585388] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34612 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=14890worker1 # [ 91.603391] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:43Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=04891worker1 # [ 91.608441] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:43Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=14892worker1 # [ 91.613381] nix-daemon[889]: reaped child process 1218, status = succeeded4893worker1 # [ 91.627632] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346124894worker1 # [ 91.645902] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346124895worker1 # [ 91.665310] nix-grpc-daemon[1159]: time=2026-09-20T08:07:43.120Z level=INFO msg="All 2 paths already cached"4896client # copying 1 paths to 'lb:50051'...4897client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...4898worker1 # [ 91.678805] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346124899worker1 # [ 91.694777] nix-daemon[889]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)4900lb # [ 91.914494] envoy[922]: conn peer=[2001:db8:1::4]:56942 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3399 tx=1072 ms=82684901worker1 # [ 91.920059] nix-daemon[889]: accepted connection from pid 1244, user nix-grpc-daemon (trusted)4902worker1 # [ 91.943593] nix-daemon[889]: reaped child process 1247, status = succeeded4903worker1 # [ 92.133591] nix-daemon[889]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)4904worker1 # [ 92.155964] nix-daemon[889]: reaped child process 1252, status = succeeded4905lb # [ 92.196907] niks3-server[1004]: 2026/09/20 08:07:43 INFO Received uploads request method=POST path=/api/pending_closures4906worker1 # [ 92.182717] nix-grpc-daemon[1159]: time=2026-09-20T08:07:43.636Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4907worker1 # [ 92.184369] nix-grpc-daemon[1159]: time=2026-09-20T08:07:43.637Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"4908lb # [ 92.233599] niks3-server[1004]: 2026/09/20 08:07:43 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst4909worker1 # [ 92.223529] nix-grpc-daemon[1159]: time=2026-09-20T08:07:43.678Z level=INFO msg="Uploading 1 narinfos"4910lb # [ 92.250031] niks3-server[1004]: 2026/09/20 08:07:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4911lb # [ 92.259623] niks3-server[1004]: 2026/09/20 08:07:43 INFO Signed narinfos id=29 count=14912lb # [ 92.269814] niks3-server[1004]: 2026/09/20 08:07:43 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls4913lb # [ 92.288420] niks3-server[1004]: 2026/09/20 08:07:43 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4914lb # [ 92.295310] niks3-server[1004]: 2026/09/20 08:07:43 INFO Completed upload id=294915worker1 # [ 92.266682] nix-grpc-daemon[1159]: time=2026-09-20T08:07:43.721Z level=INFO msg="Upload complete. (553ms)"4916lb # [ 92.298252] niks3-server[1004]: 2026/09/20 08:07:43 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo4917worker1 # [ 92.276474] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34612 duration_s=0 paths=1 nar_bytes_in=7684918worker1 # [ 92.296915] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346124919worker1 # [ 92.312317] nix-daemon[889]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)4920worker1 # [ 92.315334] nix-daemon[889]: reaped child process 1242, status = succeeded4921client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...4922worker1 # [ 92.330768] nix-daemon[889]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)4923client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4924client # farm-top> LOG-farm-top-on-standby4925worker1 # [ 93.590901] nix-daemon[889]: reaped child process 1256, status = succeeded4926worker1 # [ 93.780906] nix-daemon[889]: accepted connection from pid 1271, user nix-grpc-daemon (trusted)4927worker1 # [ 93.801070] nix-daemon[889]: reaped child process 1274, status = succeeded4928lb # [ 93.842497] niks3-server[1004]: 2026/09/20 08:07:45 INFO Received uploads request method=POST path=/api/pending_closures4929worker1 # [ 93.828282] nix-grpc-daemon[1159]: time=2026-09-20T08:07:45.281Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4930worker1 # [ 93.829792] nix-grpc-daemon[1159]: time=2026-09-20T08:07:45.281Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"4931lb # [ 93.890848] niks3-server[1004]: 2026/09/20 08:07:45 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst4932lb # [ 93.903301] niks3-server[1004]: 2026/09/20 08:07:45 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4933lb # [ 93.912712] niks3-server[1004]: 2026/09/20 08:07:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4934worker1 # [ 93.891881] nix-grpc-daemon[1159]: time=2026-09-20T08:07:45.345Z level=INFO msg="Uploading 1 narinfos"4935lb # [ 93.921127] niks3-server[1004]: 2026/09/20 08:07:45 INFO Signed narinfos id=30 count=14936lb # [ 93.923132] niks3-server[1004]: 2026/09/20 08:07:45 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls4937lb # [ 93.932297] niks3-server[1004]: 2026/09/20 08:07:45 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete4938lb # [ 93.938425] niks3-server[1004]: 2026/09/20 08:07:45 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo4939lb # [ 93.942489] niks3-server[1004]: 2026/09/20 08:07:45 INFO Completed upload id=304940worker1 # [ 93.916047] nix-grpc-daemon[1159]: time=2026-09-20T08:07:45.370Z level=INFO msg="Upload complete. (366ms)"4941worker1 # [ 93.933233] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34612 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=14942worker1 # [ 93.951108] nix-daemon[889]: reaped child process 1254, status = succeeded4943client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&2, in 9.37 seconds)4944client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath4945client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath, in 0.28 seconds)4946worker2 # [ 94.433566] systemd[1]: Listening on Nix worker-protocol over gRPC.4947worker2 # [ 94.441254] systemd[1]: Starting Nix worker-protocol over gRPC...4948worker2 # [ 94.668279] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:46Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4949worker2 # [ 94.671006] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:46Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14950worker2 # [ 94.679789] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:46Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4951worker2 # [ 94.695068] systemd[1]: Started Nix worker-protocol over gRPC.4952lb: must succeed: curl -sf localhost:9901/clusters4953worker2 # [ 94.716961] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:46Z level=info event=scheduler_connected addr=lb:500514954worker1 # [ 94.665648] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:46Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04955lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4956worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4957worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)4958lb: must succeed: curl -sf localhost:9901/clusters4959lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4960lb: must succeed: curl -sf localhost:9901/clusters4961lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4962worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4963worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)4964(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.42 seconds)4965subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise4966client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs4967client # [ 95.203019] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.4968client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.12 seconds)4969worker2 # [ 95.533357] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:423544970worker2 # [ 95.551910] nix-daemon[835]: accepted connection from pid 1291, user nix-grpc-daemon (trusted)4971client # Running as unit: rs.service; invocation ID: 69d743b3c6ce44a08b9a57d44ee69ad74972client # [ 95.510291] nix[1143]: don't know how to build these paths:4973client # [ 95.513479] nix[1143]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv4974worker1 # [ 95.534430] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:46Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=04975worker1 # [ 95.534763] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:46Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=14976worker1 # [ 95.581804] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346124977worker1 # [ 95.604634] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346124978client # [ 95.612438] nix[1143]: copying 1 paths to 'lb:50051'...4979worker1 # [ 95.623442] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346124980client # [ 95.618663] nix[1143]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...4981worker1 # [ 95.650027] nix-daemon[889]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)4982worker1 # [ 95.889197] nix-daemon[889]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)4983worker1 # [ 95.909667] nix-daemon[889]: reaped child process 1292, status = succeeded4984worker1 # [ 96.107889] nix-daemon[889]: accepted connection from pid 1294, user nix-grpc-daemon (trusted)4985worker1 # [ 96.127717] nix-daemon[889]: reaped child process 1297, status = succeeded4986lb # [ 96.168908] niks3-server[1004]: 2026/09/20 08:07:47 INFO Received uploads request method=POST path=/api/pending_closures4987worker1 # [ 96.154210] nix-grpc-daemon[1159]: time=2026-09-20T08:07:47.608Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4988worker1 # [ 96.155769] nix-grpc-daemon[1159]: time=2026-09-20T08:07:47.608Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"4989lb # [ 96.209409] niks3-server[1004]: 2026/09/20 08:07:47 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst4990lb # [ 96.230069] niks3-server[1004]: 2026/09/20 08:07:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign4991worker1 # [ 96.210267] nix-grpc-daemon[1159]: time=2026-09-20T08:07:47.664Z level=INFO msg="Uploading 1 narinfos"4992lb # [ 96.241989] niks3-server[1004]: 2026/09/20 08:07:47 INFO Signed narinfos id=31 count=14993lb # [ 96.249644] niks3-server[1004]: 2026/09/20 08:07:47 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls4994lb # [ 96.259441] niks3-server[1004]: 2026/09/20 08:07:47 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete4995lb # [ 96.268978] niks3-server[1004]: 2026/09/20 08:07:47 INFO Completed upload id=314996worker1 # [ 96.241940] nix-grpc-daemon[1159]: time=2026-09-20T08:07:47.696Z level=INFO msg="Upload complete. (568ms)"4997lb # [ 96.272980] niks3-server[1004]: 2026/09/20 08:07:47 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo4998worker1 # [ 96.252549] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34612 duration_s=0 paths=1 nar_bytes_in=4164999worker1 # [ 96.269208] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346125000worker1 # [ 96.284004] nix-daemon[889]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)5001worker1 # [ 96.293023] nix-daemon[889]: reaped child process 1287, status = succeeded5002client # [ 96.296162] nix[1143]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5003worker1 # [ 96.310551] nix-daemon[889]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)5004lb: must succeed: curl -sf localhost:9901/clusters5005lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5006lb: must succeed: curl -sf localhost:9901/clusters5007lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5008lb: must succeed: curl -sf localhost:9901/clusters5009lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5010lb: must succeed: curl -sf localhost:9901/clusters5011lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5012worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5013worker2 # [ 98.363578] systemd-journald[274]: Received client request to rotate journal, rotating.5014worker2 # [ 98.385111] systemd-journald[274]: Vacuuming done, freed 0B of archived journals from /var/log/journal/3cd5050c60d4406b964c4d8ade4ce887.5015worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)5016worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5017worker1 # [ 98.381081] systemd[1]: Stopping Nix worker-protocol over gRPC...5018worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5019??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5020 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735021client: must succeed: sleep 5.05022worker1 # [ 98.474843] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:49Z level=info event=draining5023lb # [ 101.913478] envoy[922]: conn peer=[2001:db8:1::1]:48326 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9488 tx=3858 ms=90195024client: (finished: must succeed: sleep 5.0, in 5.07 seconds)5025worker1 # [ 103.746791] nix-daemon[889]: reaped child process 1301, status = succeeded5026worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5027worker1 # [ 103.905054] nix-daemon[889]: accepted connection from pid 1341, user nix-grpc-daemon (trusted)5028worker1 # [ 103.924884] nix-daemon[889]: reaped child process 1344, status = succeeded5029lb # [ 103.963785] niks3-server[1004]: 2026/09/20 08:07:55 INFO Received uploads request method=POST path=/api/pending_closures5030worker1 # [ 103.952414] nix-grpc-daemon[1159]: time=2026-09-20T08:07:55.406Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5031worker1 # [ 103.953943] nix-grpc-daemon[1159]: time=2026-09-20T08:07:55.406Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5032lb # [ 104.016739] niks3-server[1004]: 2026/09/20 08:07:55 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5033lb # [ 104.028083] niks3-server[1004]: 2026/09/20 08:07:55 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5034worker1 # [ 104.013062] nix-grpc-daemon[1159]: time=2026-09-20T08:07:55.467Z level=INFO msg="Uploading 1 narinfos"5035lb # [ 104.042612] niks3-server[1004]: 2026/09/20 08:07:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5036lb # [ 104.051365] niks3-server[1004]: 2026/09/20 08:07:55 INFO Signed narinfos id=32 count=15037lb # [ 104.057324] niks3-server[1004]: 2026/09/20 08:07:55 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5038lb # [ 104.059682] niks3-server[1004]: 2026/09/20 08:07:55 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5039lb # [ 104.064548] niks3-server[1004]: 2026/09/20 08:07:55 INFO Completed upload id=325040worker1 # [ 104.037807] nix-grpc-daemon[1159]: time=2026-09-20T08:07:55.492Z level=INFO msg="Upload complete. (305ms)"5041lb # [ 104.067014] niks3-server[1004]: 2026/09/20 08:07:55 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5042worker1 # [ 104.053259] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34612 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15043worker1 # [ 104.069088] nix-daemon[889]: reaped child process 1299, status = succeeded5044client # [ 104.084924] systemd[1]: rs.service: Deactivated successfully.5045client # [ 104.089394] systemd[1]: rs.service: Consumed 188ms CPU time over 8.886s wall clock time, 36.9M memory peak, 8.5K incoming IP traffic, 8.9K outgoing IP traffic.5046worker1 # [ 104.475848] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:55Z level=info event=signal_exit5047worker1 # [ 104.702657] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:56Z level=info event=scheduler_yield5048lb # [ 104.732730] niks3-server[1004]: 2026/09/20 08:07:56 INFO lead: released remote=192.168.1.3:535585049worker1 # [ 104.708517] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:56Z level=info event=scheduler_restarting addr=lb:500515050worker2 # [ 104.763953] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:56Z level=info event=scheduler_restarting addr=lb:500515051worker1 # [ 104.713798] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:56Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:346025052worker1 # [ 104.719232] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:56Z level=info event=worker_gone addr=192.168.1.4:500515053worker1 # [ 104.723491] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:56Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:346025054worker1 # [ 104.728083] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:56Z level=info event=worker_gone addr=192.168.1.3:500515055worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.12 seconds)5056client: waiting for success: ! systemctl is-active rs5057worker2 # [ 104.963722] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:56Z level=info event=scheduler_connected addr=lb:500515058worker1 # [ 104.909776] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:56Z level=info event=scheduler_connected addr=lb:500515059worker1 # [ 104.916823] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5060worker2 # [ 104.971527] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5061client: (finished: waiting for success: ! systemctl is-active rs, in 0.08 seconds)5062client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5063client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds)5064client: must fail: journalctl -u rs | grep -q 'reconnecting'5065client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5066lb: must succeed: curl -sf localhost:9901/clusters5067worker2 # [ 105.172723] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:56Z level=info event=scheduler_connected addr=lb:500515068worker1 # [ 105.124964] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:56Z level=info event=scheduler_connected addr=lb:500515069worker2 # [ 105.183387] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5070worker1 # [ 105.148306] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5071lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5072worker2 # [ 105.384538] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:56Z level=info event=scheduler_connected addr=lb:500515073worker2 # [ 105.391479] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5074worker1 # [ 105.349505] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:56Z level=info event=scheduler_connected addr=lb:500515075worker1 # [ 105.356513] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5076worker2 # [ 105.592788] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:500515077worker2 # [ 105.599489] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5078worker1 # [ 105.557756] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:500515079worker1 # [ 105.564581] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5080worker1 # [ 105.708099] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:57Z level=info event=scheduler_restarting5081worker1 # [ 105.741671] nix-daemon[889]: reaped child process 1150, status = succeeded5082worker2 # [ 105.803360] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:500515083worker2 # [ 105.807642] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5084worker1 # [ 105.783748] nix-grpc-daemon[1090]: ts=2026-09-20T08:07:57Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5085worker2 # [ 106.004629] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:500515086worker1 # [ 105.952897] nix-grpc-daemon[1090]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5087worker1 # [ 105.957425] nix-grpc-daemon[1090]: E0000 00:00:1789891677.407440 1133 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5088worker1 # [ 106.083975] nix-grpc-daemon[1090]: E0000 00:00:1789891677.538477 1133 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5089worker1 # [ 106.090644] nix-grpc-daemon[1090]: E0000 00:00:1789891677.538666 1133 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5090lb: must succeed: curl -sf localhost:9901/clusters5091lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5092worker2 # [ 106.932924] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:58Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5093worker1 # [ 106.903902] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5094worker1 # [ 106.907280] systemd[1]: Stopped Nix worker-protocol over gRPC.5095worker1 # [ 106.915316] systemd[1]: nix-grpc-daemon.service: Consumed 2.133s CPU time over 27.684s wall clock time, 34.2M memory peak, 44.7K incoming IP traffic, 82.3K outgoing IP traffic.5096worker1 # [ 106.929781] systemd[1]: Starting Nix worker-protocol over gRPC...5097worker2 # [ 107.132898] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:58Z level=info event=scheduler_connected addr=lb:500515098worker2 # [ 107.140591] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5099worker1 # [ 107.127363] nix-grpc-daemon[1351]: ts=2026-09-20T08:07:58Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5100worker1 # [ 107.129989] nix-grpc-daemon[1351]: ts=2026-09-20T08:07:58Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15101worker1 # [ 107.137829] nix-grpc-daemon[1351]: ts=2026-09-20T08:07:58Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5102worker1 # [ 107.139616] systemd[1]: Started Nix worker-protocol over gRPC.5103worker1 # [ 107.147417] nix-grpc-daemon[1351]: ts=2026-09-20T08:07:58Z level=info event=scheduler_take_over5104lb # [ 107.175435] niks3-server[1004]: 2026/09/20 08:07:58 INFO lead: acquired remote=192.168.1.3:572605105worker1 # [ 107.162012] nix-grpc-daemon[1351]: ts=2026-09-20T08:07:58Z level=info event=scheduler_connected addr=lb:500515106worker1 # [ 107.172498] nix-grpc-daemon[1351]: ts=2026-09-20T08:07:58Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05107lb: must succeed: curl -sf localhost:9901/clusters5108worker2 # [ 107.341821] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:58Z level=info event=scheduler_connected addr=lb:500515109worker2 # [ 107.348801] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5110lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5111worker2 # [ 107.549980] nix-grpc-daemon[1291]: ts=2026-09-20T08:07:59Z level=info event=scheduler_connected addr=lb:500515112worker1 # [ 107.498366] nix-grpc-daemon[1351]: ts=2026-09-20T08:07:58Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05113lb: must succeed: curl -sf localhost:9901/clusters5114lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5115worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5116worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5117(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.38 seconds)5118subtest: scheduler restart mid-build: build finishes, no double build5119client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5120client # [ 108.565270] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5121client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)5122client # Running as unit: mid.service; invocation ID: 01020d88ed574900bc7d6bffc22499ac5123client # [ 108.816120] nix[1178]: don't know how to build these paths:5124client # [ 108.817889] nix[1178]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5125worker2 # [ 108.877756] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:423545126worker1 # [ 108.842923] nix-grpc-daemon[1351]: ts=2026-09-20T08:08:00Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05127worker1 # [ 108.848501] nix-grpc-daemon[1351]: ts=2026-09-20T08:08:00Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15128worker1 # [ 108.893054] nix-grpc-daemon[1351]: ts=2026-09-20T08:08:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570885129worker1 # [ 108.909190] nix-daemon[889]: accepted connection from pid 1351, user nix-grpc-daemon (trusted)5130worker1 # [ 108.932757] nix-grpc-daemon[1351]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 47 ms (attempt 1/5)5131worker1 # [ 108.986376] nix-grpc-daemon[1351]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 161 ms (attempt 2/5)5132worker1 # [ 109.155047] nix-grpc-daemon[1351]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 346 ms (attempt 3/5)5133worker1 # [ 109.508905] nix-grpc-daemon[1351]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 312 ms (attempt 4/5)5134worker1 # [ 109.829698] nix-grpc-daemon[1351]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5135worker1 # [ 109.846513] nix-grpc-daemon[1351]: ts=2026-09-20T08:08:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:570885136worker1 # [ 109.860505] nix-grpc-daemon[1351]: ts=2026-09-20T08:08:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:570885137client # [ 109.853361] nix[1178]: copying 1 paths to 'lb:50051'...5138client # [ 109.853720] nix[1178]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5139worker1 # [ 109.870090] nix-daemon[889]: accepted connection from pid 1351, user nix-grpc-daemon (trusted)5140worker1 # [ 109.890653] nix-grpc-daemon[1351]: ts=2026-09-20T08:08:01Z level=info event=niks3_push_started pid=14225141worker1 # [ 110.276826] nix-daemon[889]: accepted connection from pid 1435, user nix-grpc-daemon (trusted)5142worker1 # [ 110.294850] nix-daemon[889]: reaped child process 1438, status = succeeded5143worker1 # [ 110.468409] nix-daemon[889]: accepted connection from pid 1440, user nix-grpc-daemon (trusted)5144worker1 # [ 110.488136] nix-daemon[889]: reaped child process 1443, status = succeeded5145lb # [ 110.527276] niks3-server[1004]: 2026/09/20 08:08:01 INFO Received uploads request method=POST path=/api/pending_closures5146worker1 # [ 110.511720] nix-grpc-daemon[1422]: time=2026-09-20T08:08:01.964Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5147worker1 # [ 110.513626] nix-grpc-daemon[1422]: time=2026-09-20T08:08:01.965Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5148lb # [ 110.566863] niks3-server[1004]: 2026/09/20 08:08:02 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5149worker1 # [ 110.555310] nix-grpc-daemon[1422]: time=2026-09-20T08:08:02.009Z level=INFO msg="Uploading 1 narinfos"5150lb # [ 110.581106] niks3-server[1004]: 2026/09/20 08:08:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5151lb # [ 110.591736] niks3-server[1004]: 2026/09/20 08:08:02 INFO Signed narinfos id=33 count=15152lb # [ 110.597627] niks3-server[1004]: 2026/09/20 08:08:02 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5153lb # [ 110.612849] niks3-server[1004]: 2026/09/20 08:08:02 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5154lb # [ 110.618381] niks3-server[1004]: 2026/09/20 08:08:02 INFO Completed upload id=335155worker1 # [ 110.591809] nix-grpc-daemon[1422]: time=2026-09-20T08:08:02.046Z level=INFO msg="Upload complete. (498ms)"5156lb # [ 110.621044] niks3-server[1004]: 2026/09/20 08:08:02 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5157worker1 # [ 110.600262] nix-grpc-daemon[1351]: ts=2026-09-20T08:08:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57088 duration_s=0 paths=1 nar_bytes_in=4245158worker1 # [ 110.616540] nix-grpc-daemon[1351]: ts=2026-09-20T08:08:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:570885159worker1 # [ 110.620271] nix-daemon[889]: accepted connection from pid 1351, user nix-grpc-daemon (trusted)5160worker1 # [ 110.626008] nix-daemon[889]: reaped child process 1420, status = succeeded5161worker1 # [ 110.636133] nix-daemon[889]: accepted connection from pid 1351, user nix-grpc-daemon (trusted)5162client # [ 110.626344] nix[1178]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5163lb # [ 111.914795] envoy[922]: conn peer=[2001:db8:1::1]:33442 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2940 tx=1350 ms=85895164lb # [ 111.915186] envoy[922]: conn peer=[2001:db8:1::3]:41606 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2810 tx=1072 ms=262895165lb: must succeed: curl -sf localhost:9901/clusters5166lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5167lb: must succeed: curl -sf localhost:9901/clusters5168lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5169worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5170worker1 # [ 113.780791] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1351 (nix-grpc-daemon) on client request.5171worker1 # [ 113.782446] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5172lb # [ 113.825416] niks3-server[1004]: 2026/09/20 08:08:05 INFO lead: released remote=192.168.1.3:572605173client # [ 113.789338] nix[1178]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5174worker2 # [ 113.851550] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:05Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5175client # [ 113.796095] nix[1178]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5176worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.09 seconds)5177client: must succeed: sleep 5.05178worker1 # [ 113.833060] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5179worker1 # [ 113.834771] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5180worker1 # [ 113.843191] systemd[1]: nix-grpc-daemon.service: Consumed 493ms CPU time over 6.900s wall clock time, 31.2M memory peak, 11.7K incoming IP traffic, 14.5K outgoing IP traffic.5181worker1 # [ 113.851383] nix-daemon[889]: reaped child process 1411, status = succeeded5182worker1 # [ 113.853318] nix-daemon[889]: reaped child process 1445, status = succeeded5183worker1 # [ 113.864744] nix-daemon[1447]: unexpected Nix daemon error: error: interrupted by the user5184worker1 # [ 113.871087] nix-daemon[889]: reaped child process 1447, status = failed with exit code 15185worker2 # [ 114.051640] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:05Z level=info event=scheduler_connected addr=lb:500515186worker1 # [ 114.153284] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5187worker1 # [ 114.166813] systemd[1]: Starting Nix worker-protocol over gRPC...5188worker1 # [ 114.389170] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:05Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5189worker1 # [ 114.391487] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:05Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15190worker1 # [ 114.399309] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:05Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5191worker1 # [ 114.413047] systemd[1]: Started Nix worker-protocol over gRPC.5192worker1 # [ 114.417915] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:05Z level=info event=scheduler_take_over5193lb # [ 114.444684] niks3-server[1004]: 2026/09/20 08:08:05 INFO lead: acquired remote=192.168.1.3:371465194worker1 # [ 114.432916] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:05Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05195worker1 # [ 114.440690] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:05Z level=info event=scheduler_connected addr=lb:500515196worker1 # [ 114.444510] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:05Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05197worker1 # [ 114.447168] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:05Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15198worker1 # [ 114.449495] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:05Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05199worker2 # [ 114.506266] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423545200worker2 # [ 114.527066] nix-grpc-daemon[1291]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 96 ms (attempt 1/5)5201worker2 # [ 114.631134] nix-grpc-daemon[1291]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 2/5)5202worker2 # [ 114.685245] nix-grpc-daemon[1291]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 385 ms (attempt 3/5)5203worker2 # [ 115.079342] nix-grpc-daemon[1291]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 753 ms (attempt 4/5)5204worker2 # [ 115.841145] nix-grpc-daemon[1291]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5205worker2 # [ 115.862284] nix-grpc-daemon[1291]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5206worker2 # [ 115.898200] nix-daemon[835]: accepted connection from pid 1291, user nix-grpc-daemon (trusted)5207worker2 # [ 115.917127] nix-daemon[835]: accepted connection from pid 1291, user nix-grpc-daemon (trusted)5208client # [ 115.853883] nix[1178]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5209client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5210client: waiting for success: ! systemctl is-active mid5211worker2 # [ 119.342638] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:10Z level=info event=niks3_push_started pid=14425212worker2 # [ 119.369822] nix-daemon[835]: reaped child process 1418, status = succeeded5213worker2 # [ 119.735401] nix-daemon[835]: accepted connection from pid 1455, user nix-grpc-daemon (trusted)5214worker2 # [ 119.754864] nix-daemon[835]: reaped child process 1458, status = succeeded5215lb # [ 119.741663] niks3-server[1004]: 2026/09/20 08:08:11 INFO Received uploads request method=POST path=/api/pending_closures5216worker2 # [ 119.784519] nix-grpc-daemon[1442]: time=2026-09-20T08:08:11.242Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5217worker2 # [ 119.786004] nix-grpc-daemon[1442]: time=2026-09-20T08:08:11.242Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5218lb # [ 119.800005] niks3-server[1004]: 2026/09/20 08:08:11 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5219lb # [ 119.812378] niks3-server[1004]: 2026/09/20 08:08:11 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5220worker2 # [ 119.849643] nix-grpc-daemon[1442]: time=2026-09-20T08:08:11.307Z level=INFO msg="Uploading 1 narinfos"5221lb # [ 119.821993] niks3-server[1004]: 2026/09/20 08:08:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5222lb # [ 119.829964] niks3-server[1004]: 2026/09/20 08:08:11 INFO Signed narinfos id=34 count=15223lb # [ 119.846775] niks3-server[1004]: 2026/09/20 08:08:11 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5224lb # [ 119.895484] niks3-server[1004]: 2026/09/20 08:08:11 INFO Completed upload id=345225worker2 # [ 119.923248] nix-grpc-daemon[1442]: time=2026-09-20T08:08:11.382Z level=INFO msg="Upload complete. (364ms)"5226lb # [ 119.910989] niks3-server[1004]: 2026/09/20 08:08:11 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo5227worker2 # [ 119.936505] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42354 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15228lb # [ 119.916583] niks3-server[1004]: 2026/09/20 08:08:11 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5229worker2 # [ 119.955445] nix-daemon[835]: reaped child process 1416, status = succeeded5230client # [ 119.915739] systemd[1]: mid.service: Deactivated successfully.5231client # [ 119.921125] systemd[1]: mid.service: Consumed 176ms CPU time over 11.354s wall clock time, 38.9M memory peak, 9.7K incoming IP traffic, 10.6K outgoing IP traffic.5232client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5233client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5234client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5235(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 11.91 seconds)5236subtest: interrupting the client stops the build on the worker5237client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5238client # [ 120.447298] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5239client # Running as unit: intr.service; invocation ID: fe676f817e154027b8e1a73d1148ece55240client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5241worker1 # [ 120.685314] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:436165242worker1 # [ 120.701371] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5243client # [ 120.711990] nix[1213]: don't know how to build these paths:5244client # [ 120.713619] nix[1213]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5245worker1 # [ 120.732382] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:12Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05246worker1 # [ 120.739223] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:12Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=15247worker1 # [ 120.786383] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165248worker1 # [ 120.803943] nix-grpc-daemon[1487]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 95 ms (attempt 1/5)5249worker1 # [ 120.906639] nix-grpc-daemon[1487]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 112 ms (attempt 2/5)5250worker1 # [ 121.019236] nix-grpc-daemon[1487]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 377 ms (attempt 3/5)5251worker1 # [ 121.404305] nix-grpc-daemon[1487]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 435 ms (attempt 4/5)5252worker1 # [ 121.841478] nix-grpc-daemon[1487]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5253worker1 # [ 121.863071] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436165254client # [ 121.869451] nix[1213]: copying 1 paths to 'lb:50051'...5255worker1 # [ 121.878571] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436165256client # [ 121.874140] nix[1213]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5257lb # [ 121.913703] envoy[922]: conn peer=[2001:db8:1::3]:53798 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=475 tx=226 ms=66415258lb # [ 121.918851] envoy[922]: conn peer=[2001:db8:1::1]:53596 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3841 tx=1683 ms=110745259worker1 # [ 121.893823] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5260worker1 # [ 121.921331] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:13Z level=info event=niks3_push_started pid=15635261worker1 # [ 122.305037] nix-daemon[889]: accepted connection from pid 1576, user nix-grpc-daemon (trusted)5262worker1 # [ 122.324432] nix-daemon[889]: reaped child process 1579, status = succeeded5263worker1 # [ 122.508925] nix-daemon[889]: accepted connection from pid 1581, user nix-grpc-daemon (trusted)5264worker1 # [ 122.527263] nix-daemon[889]: reaped child process 1584, status = succeeded5265lb # [ 122.567096] niks3-server[1004]: 2026/09/20 08:08:14 INFO Received uploads request method=POST path=/api/pending_closures5266worker1 # [ 122.555697] nix-grpc-daemon[1563]: time=2026-09-20T08:08:14.008Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5267worker1 # [ 122.557566] nix-grpc-daemon[1563]: time=2026-09-20T08:08:14.008Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5268lb # [ 122.617790] niks3-server[1004]: 2026/09/20 08:08:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5269worker1 # [ 122.600991] nix-grpc-daemon[1563]: time=2026-09-20T08:08:14.055Z level=INFO msg="Uploading 1 narinfos"5270lb # [ 122.630620] niks3-server[1004]: 2026/09/20 08:08:14 INFO Signed narinfos id=35 count=15271lb # [ 122.641586] niks3-server[1004]: 2026/09/20 08:08:14 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5272lb # [ 122.653516] niks3-server[1004]: 2026/09/20 08:08:14 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5273lb # [ 122.666671] niks3-server[1004]: 2026/09/20 08:08:14 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5274lb # [ 122.672878] niks3-server[1004]: 2026/09/20 08:08:14 INFO Completed upload id=355275worker1 # [ 122.646494] nix-grpc-daemon[1563]: time=2026-09-20T08:08:14.101Z level=INFO msg="Upload complete. (515ms)"5276lb # [ 122.678750] niks3-server[1004]: 2026/09/20 08:08:14 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5277worker1 # [ 122.656432] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=0 paths=1 nar_bytes_in=4245278worker1 # [ 122.672876] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165279worker1 # [ 122.683866] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5280worker1 # [ 122.687337] nix-daemon[889]: reaped child process 1561, status = succeeded5281client # [ 122.689905] nix[1213]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5282worker1 # [ 122.700544] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5283client: must succeed: systemctl kill -s INT intr5284client # [ 124.180618] systemd[1]: intr.service: Sent signal SIGINT to main process 1213 (nix) on client request.5285client # [ 124.186604] nix[1213]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5286client # [ 124.189670] nix[1213]: error: interrupted by the user5287client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5288client # [ 124.227170] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5289client # [ 124.230057] systemd[1]: intr.service: Failed with result 'exit-code'.5290client # [ 124.233353] systemd[1]: intr.service: Consumed 145ms CPU time over 3.785s wall clock time, 39.2M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic.5291worker1 # [ 124.330679] nix-daemon[1588]: unexpected Nix daemon error: error: interrupted by the user5292worker1 # [ 124.336630] nix-daemon[889]: reaped child process 1586, status = succeeded5293worker1 # [ 124.340630] nix-daemon[889]: reaped child process 1588, status = failed with exit code 15294(finished: subtest: interrupting the client stops the build on the worker, in 5.12 seconds)5295subtest: a deploy mid-build drains: the build finishes, the new generation takes over5296client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5297client # [ 125.600971] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5298client # Running as unit: sw.service; invocation ID: 2a5facc3e75340b7a4e04fef3d90b36d5299client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.10 seconds)5300worker2 # [ 125.902791] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:423545301client # [ 125.848386] nix[1232]: don't know how to build these paths:5302client # [ 125.849417] nix[1232]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5303worker1 # [ 125.872008] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:17Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05304worker1 # [ 125.872715] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:17Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=15305worker2 # [ 125.972575] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423545306worker2 # [ 125.989306] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:423545307client # [ 125.939954] nix[1232]: copying 1 paths to 'lb:50051'...5308client # [ 125.945941] nix[1232]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5309worker2 # [ 126.009510] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:423545310worker2 # [ 126.026260] nix-daemon[835]: accepted connection from pid 1291, user nix-grpc-daemon (trusted)5311worker2 # [ 126.235460] nix-daemon[835]: accepted connection from pid 1490, user nix-grpc-daemon (trusted)5312worker2 # [ 126.256605] nix-daemon[835]: reaped child process 1493, status = succeeded5313worker2 # [ 126.440165] nix-daemon[835]: accepted connection from pid 1495, user nix-grpc-daemon (trusted)5314worker2 # [ 126.459191] nix-daemon[835]: reaped child process 1498, status = succeeded5315lb # [ 126.445800] niks3-server[1004]: 2026/09/20 08:08:17 INFO Received uploads request method=POST path=/api/pending_closures5316worker2 # [ 126.487647] nix-grpc-daemon[1442]: time=2026-09-20T08:08:17.946Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5317worker2 # [ 126.489298] nix-grpc-daemon[1442]: time=2026-09-20T08:08:17.946Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5318lb # [ 126.483684] niks3-server[1004]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5319worker2 # [ 126.519232] nix-grpc-daemon[1442]: time=2026-09-20T08:08:17.978Z level=INFO msg="Uploading 1 narinfos"5320lb # [ 126.494398] niks3-server[1004]: 2026/09/20 08:08:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5321lb # [ 126.500508] niks3-server[1004]: 2026/09/20 08:08:17 INFO Signed narinfos id=36 count=15322lb # [ 126.502410] niks3-server[1004]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5323lb # [ 126.510265] niks3-server[1004]: 2026/09/20 08:08:17 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5324lb # [ 126.516339] niks3-server[1004]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5325lb # [ 126.520675] niks3-server[1004]: 2026/09/20 08:08:17 INFO Completed upload id=365326worker2 # [ 126.548258] nix-grpc-daemon[1442]: time=2026-09-20T08:08:18.007Z level=INFO msg="Upload complete. (505ms)"5327worker2 # [ 126.556269] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42354 duration_s=0 paths=1 nar_bytes_in=4165328worker2 # [ 126.564755] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:423545329worker2 # [ 126.576729] nix-daemon[835]: accepted connection from pid 1291, user nix-grpc-daemon (trusted)5330worker2 # [ 126.581654] nix-daemon[835]: reaped child process 1488, status = succeeded5331worker2 # [ 126.593298] nix-daemon[835]: accepted connection from pid 1291, user nix-grpc-daemon (trusted)5332client # [ 126.528846] nix[1232]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5333worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25334worker2 # Checking switch inhibitors... done5335worker2 # [ 129.129549] nixos[1533]: switching to system configuration /nix/store/whbg36fwzqa4fkdb1fxwg9b9zzd3kwb8-nixos-system-worker2-test5336worker2 # [ 129.133631] systemd[1]: Stopped target Remote File Systems.5337worker2 # activating the configuration...5338worker2 # [ 129.137438] systemd[1]: Stopped target Local File Systems.5339worker2 # setting up /etc...5340worker2 # [ 129.948807] systemd[1]: Reload requested from client PID 1533 ('.switch-to-conf') (unit backdoor.service)...5341worker2 # [ 129.950567] systemd[1]: Reloading...5342worker2 # [ 130.846105] systemd[1]: Reloading finished in 892 ms.5343worker2 # restarting sysinit-reactivation.target5344worker2 # [ 130.927578] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5345worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5346worker2 # [ 131.094694] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5347worker2 # [ 131.095881] systemd[1]: Reached target Reactivate sysinit units.5348worker2 # [ 131.099703] systemd[1]: Reloading D-Bus System Message Bus...5349worker2 # [ 131.111047] dbus-broker-launch[501]: Caught SIGHUP, trigger reload.5350worker2 # [ 131.117230] systemd[1]: Reloading Nix worker-protocol over gRPC...5351worker2 # [ 131.131251] dbus-broker-launch[501]: Looking up NSS user entry for 'systemd-timesync'...5352worker2 # [ 131.136275] dbus-broker-launch[501]: NSS returned no entry for 'systemd-timesync'5353worker2 # [ 131.144573] dbus-broker-launch[501]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5354worker2 # [ 131.161388] systemd[1]: Reloaded Nix worker-protocol over gRPC.5355worker2 # [ 131.193706] systemd[1]: Reloaded D-Bus System Message Bus.5356worker2 # [ 131.197123] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5357worker2 # [ 131.198381] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5358worker2 # [ 131.206608] systemd[1]: Reached target Local File Systems.5359worker2 # [ 131.209812] systemd[1]: Reached target Remote File Systems.5360worker2 # [ 131.216420] systemd[1]: Starting linger-users.service...5361worker2 # [ 131.221221] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5362worker2 # [ 131.232315] systemd[1]: Starting Create SUID/SGID Wrappers...5363worker2 # [ 131.233162] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5364worker2 # [ 131.234316] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675365worker2 # [ 131.244214] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5366worker2 # [ 131.245777] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5367worker2 # [ 131.246967] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5368worker2 # [ 131.295631] systemd[1]: linger-users.service: Deactivated successfully.5369worker2 # [ 131.299194] systemd[1]: Finished linger-users.service.5370worker2 # [ 131.706711] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:23Z level=info event=draining5371worker2 # [ 131.759423] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5372worker2 # [ 131.764237] systemd[1]: Finished Create SUID/SGID Wrappers.5373lb # [ 131.915883] envoy[922]: conn peer=[2001:db8:1::1]:57874 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=755 ms=35385374worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5375worker2 # [ 132.013388] nixos[1533]: finished switching to system configuration /nix/store/whbg36fwzqa4fkdb1fxwg9b9zzd3kwb8-nixos-system-worker2-test5376worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.72 seconds)5377worker2: must succeed: pgrep -f 'read -t [9]0 x'5378worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5379client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&25380client # don't know how to build these paths:5381client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5382worker1 # [ 132.301172] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:436165383worker1 # [ 132.318100] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:23Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05384worker1 # [ 132.325451] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:23Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=15385worker1 # [ 132.370936] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165386worker1 # [ 132.388705] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436165387client # copying 1 paths to 'lb:50051'...5388worker1 # [ 132.405989] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436165389client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5390worker1 # [ 132.430871] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5391worker1 # [ 132.647768] nix-daemon[889]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)5392worker1 # [ 132.667554] nix-daemon[889]: reaped child process 1645, status = succeeded5393worker1 # [ 132.847901] nix-daemon[889]: accepted connection from pid 1647, user nix-grpc-daemon (trusted)5394worker1 # [ 132.866095] nix-daemon[889]: reaped child process 1650, status = succeeded5395lb # [ 132.908818] niks3-server[1004]: 2026/09/20 08:08:24 INFO Received uploads request method=POST path=/api/pending_closures5396worker1 # [ 132.895695] nix-grpc-daemon[1563]: time=2026-09-20T08:08:24.349Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5397worker1 # [ 132.897550] nix-grpc-daemon[1563]: time=2026-09-20T08:08:24.349Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5398lb # [ 132.943489] niks3-server[1004]: 2026/09/20 08:08:24 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5399worker1 # [ 132.933641] nix-grpc-daemon[1563]: time=2026-09-20T08:08:24.388Z level=INFO msg="Uploading 1 narinfos"5400lb # [ 132.964518] niks3-server[1004]: 2026/09/20 08:08:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5401lb # [ 132.973650] niks3-server[1004]: 2026/09/20 08:08:24 INFO Signed narinfos id=37 count=15402lb # [ 132.979442] niks3-server[1004]: 2026/09/20 08:08:24 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5403lb # [ 132.988952] niks3-server[1004]: 2026/09/20 08:08:24 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5404lb # [ 132.994225] niks3-server[1004]: 2026/09/20 08:08:24 INFO Completed upload id=375405worker1 # [ 132.961744] nix-grpc-daemon[1563]: time=2026-09-20T08:08:24.416Z level=INFO msg="Upload complete. (513ms)"5406lb # [ 132.997878] niks3-server[1004]: 2026/09/20 08:08:24 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5407worker1 # [ 132.972151] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=0 paths=1 nar_bytes_in=5285408worker1 # [ 132.982918] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165409worker1 # [ 132.989961] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5410worker1 # [ 132.994626] nix-daemon[889]: reaped child process 1640, status = succeeded5411worker1 # [ 133.005827] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5412client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5413client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5414client # farm-a> LOG-farm-a-during-drain5415worker1 # [ 134.464378] nix-daemon[889]: reaped child process 1654, status = succeeded5416worker1 # [ 134.667504] nix-daemon[889]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)5417worker1 # [ 134.687306] nix-daemon[889]: reaped child process 1672, status = succeeded5418lb # [ 134.730457] niks3-server[1004]: 2026/09/20 08:08:26 INFO Received uploads request method=POST path=/api/pending_closures5419worker1 # [ 134.716567] nix-grpc-daemon[1563]: time=2026-09-20T08:08:26.169Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5420worker1 # [ 134.718376] nix-grpc-daemon[1563]: time=2026-09-20T08:08:26.169Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5421lb # [ 134.794399] niks3-server[1004]: 2026/09/20 08:08:26 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5422lb # [ 134.810564] niks3-server[1004]: 2026/09/20 08:08:26 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5423lb # [ 134.824868] niks3-server[1004]: 2026/09/20 08:08:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5424worker1 # [ 134.804186] nix-grpc-daemon[1563]: time=2026-09-20T08:08:26.258Z level=INFO msg="Uploading 1 narinfos"5425lb # [ 134.832172] niks3-server[1004]: 2026/09/20 08:08:26 INFO Signed narinfos id=38 count=15426lb # [ 134.835847] niks3-server[1004]: 2026/09/20 08:08:26 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5427lb # [ 134.849333] niks3-server[1004]: 2026/09/20 08:08:26 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5428lb # [ 134.867058] niks3-server[1004]: 2026/09/20 08:08:26 INFO Completed upload id=385429worker1 # [ 134.840672] nix-grpc-daemon[1563]: time=2026-09-20T08:08:26.295Z level=INFO msg="Upload complete. (420ms)"5430lb # [ 134.870446] niks3-server[1004]: 2026/09/20 08:08:26 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5431worker1 # [ 134.863344] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15432worker1 # [ 134.883665] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:26Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05433worker1 # [ 134.889599] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:26Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=15434worker1 # [ 134.894242] nix-daemon[889]: reaped child process 1652, status = succeeded5435worker1 # [ 134.912418] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165436worker1 # [ 134.931154] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436165437worker1 # [ 134.948909] nix-grpc-daemon[1563]: time=2026-09-20T08:08:26.403Z level=INFO msg="All 1 paths already cached"5438client # copying 1 paths to 'lb:50051'...5439worker1 # [ 134.961729] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436165440client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5441worker1 # [ 134.987581] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5442worker1 # [ 135.224828] nix-daemon[889]: accepted connection from pid 1678, user nix-grpc-daemon (trusted)5443worker1 # [ 135.251119] nix-daemon[889]: reaped child process 1681, status = succeeded5444worker1 # [ 135.451271] nix-daemon[889]: accepted connection from pid 1683, user nix-grpc-daemon (trusted)5445worker1 # [ 135.470151] nix-daemon[889]: reaped child process 1686, status = succeeded5446lb # [ 135.511575] niks3-server[1004]: 2026/09/20 08:08:26 INFO Received uploads request method=POST path=/api/pending_closures5447worker1 # [ 135.497375] nix-grpc-daemon[1563]: time=2026-09-20T08:08:26.951Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5448worker1 # [ 135.499116] nix-grpc-daemon[1563]: time=2026-09-20T08:08:26.951Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5449lb # [ 135.553707] niks3-server[1004]: 2026/09/20 08:08:27 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5450worker1 # [ 135.540387] nix-grpc-daemon[1563]: time=2026-09-20T08:08:26.994Z level=INFO msg="Uploading 1 narinfos"5451lb # [ 135.570470] niks3-server[1004]: 2026/09/20 08:08:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5452lb # [ 135.581377] niks3-server[1004]: 2026/09/20 08:08:27 INFO Signed narinfos id=39 count=15453lb # [ 135.593318] niks3-server[1004]: 2026/09/20 08:08:27 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5454worker1 # [ 135.573932] nix-grpc-daemon[1563]: time=2026-09-20T08:08:27.028Z level=INFO msg="Upload complete. (565ms)"5455lb # [ 135.603432] niks3-server[1004]: 2026/09/20 08:08:27 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5456lb # [ 135.609525] niks3-server[1004]: 2026/09/20 08:08:27 INFO Completed upload id=395457lb # [ 135.613033] niks3-server[1004]: 2026/09/20 08:08:27 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5458worker1 # [ 135.582700] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=0 paths=1 nar_bytes_in=6405459worker1 # [ 135.599866] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165460worker1 # [ 135.607744] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5461worker1 # [ 135.613958] nix-daemon[889]: reaped child process 1676, status = succeeded5462client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5463client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5464worker1 # [ 135.630284] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5465client # farm-b> LOG-farm-b-during-drain5466worker1 # [ 136.683314] nix-daemon[889]: reaped child process 1690, status = succeeded5467worker1 # [ 136.902257] nix-daemon[889]: accepted connection from pid 1705, user nix-grpc-daemon (trusted)5468worker1 # [ 136.924252] nix-daemon[889]: reaped child process 1708, status = succeeded5469lb # [ 136.967154] niks3-server[1004]: 2026/09/20 08:08:28 INFO Received uploads request method=POST path=/api/pending_closures5470worker1 # [ 136.949860] nix-grpc-daemon[1563]: time=2026-09-20T08:08:28.404Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5471worker1 # [ 136.952379] nix-grpc-daemon[1563]: time=2026-09-20T08:08:28.406Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5472lb # [ 137.014796] niks3-server[1004]: 2026/09/20 08:08:28 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5473lb # [ 137.028781] niks3-server[1004]: 2026/09/20 08:08:28 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5474lb # [ 137.039596] niks3-server[1004]: 2026/09/20 08:08:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5475worker1 # [ 137.017554] nix-grpc-daemon[1563]: time=2026-09-20T08:08:28.471Z level=INFO msg="Uploading 1 narinfos"5476lb # [ 137.046682] niks3-server[1004]: 2026/09/20 08:08:28 INFO Signed narinfos id=40 count=15477lb # [ 137.051710] niks3-server[1004]: 2026/09/20 08:08:28 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5478lb # [ 137.060220] niks3-server[1004]: 2026/09/20 08:08:28 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5479lb # [ 137.068283] niks3-server[1004]: 2026/09/20 08:08:28 INFO Completed upload id=405480lb # [ 137.070892] niks3-server[1004]: 2026/09/20 08:08:28 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5481worker1 # [ 137.040536] nix-grpc-daemon[1563]: time=2026-09-20T08:08:28.495Z level=INFO msg="Upload complete. (397ms)"5482worker1 # [ 137.065493] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15483worker1 # [ 137.084499] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:28Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05484worker1 # [ 137.091568] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:28Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=15485worker1 # [ 137.097413] nix-daemon[889]: reaped child process 1688, status = succeeded5486worker1 # [ 137.106852] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165487worker1 # [ 137.123551] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436165488worker1 # [ 137.140234] nix-grpc-daemon[1563]: time=2026-09-20T08:08:28.594Z level=INFO msg="All 2 paths already cached"5489client # copying 1 paths to 'lb:50051'...5490worker1 # [ 137.151769] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436165491client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5492worker1 # [ 137.183789] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5493worker1 # [ 137.433157] nix-daemon[889]: accepted connection from pid 1714, user nix-grpc-daemon (trusted)5494worker1 # [ 137.457000] nix-daemon[889]: reaped child process 1717, status = succeeded5495worker1 # [ 137.655079] nix-daemon[889]: accepted connection from pid 1719, user nix-grpc-daemon (trusted)5496worker1 # [ 137.675402] nix-daemon[889]: reaped child process 1722, status = succeeded5497lb # [ 137.713589] niks3-server[1004]: 2026/09/20 08:08:29 INFO Received uploads request method=POST path=/api/pending_closures5498worker1 # [ 137.698787] nix-grpc-daemon[1563]: time=2026-09-20T08:08:29.153Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5499worker1 # [ 137.700418] nix-grpc-daemon[1563]: time=2026-09-20T08:08:29.153Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5500lb # [ 137.749719] niks3-server[1004]: 2026/09/20 08:08:29 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5501worker1 # [ 137.747950] nix-grpc-daemon[1563]: time=2026-09-20T08:08:29.202Z level=INFO msg="Uploading 1 narinfos"5502lb # [ 137.768754] niks3-server[1004]: 2026/09/20 08:08:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5503lb # [ 137.783174] niks3-server[1004]: 2026/09/20 08:08:29 INFO Signed narinfos id=41 count=15504lb # [ 137.789751] niks3-server[1004]: 2026/09/20 08:08:29 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5505lb # [ 137.798042] niks3-server[1004]: 2026/09/20 08:08:29 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5506worker1 # [ 137.779220] nix-grpc-daemon[1563]: time=2026-09-20T08:08:29.233Z level=INFO msg="Upload complete. (574ms)"5507lb # [ 137.807646] niks3-server[1004]: 2026/09/20 08:08:29 INFO Completed upload id=415508lb # [ 137.810693] niks3-server[1004]: 2026/09/20 08:08:29 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5509worker1 # [ 137.792440] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=0 paths=1 nar_bytes_in=7685510worker1 # [ 137.807981] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165511worker1 # [ 137.820156] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5512worker1 # [ 137.822731] nix-daemon[889]: reaped child process 1712, status = succeeded5513client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5514client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5515worker1 # [ 137.840564] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5516client # farm-top> LOG-farm-top-during-drain5517worker1 # [ 139.298032] nix-daemon[889]: reaped child process 1726, status = succeeded5518worker1 # [ 139.507965] nix-daemon[889]: accepted connection from pid 1741, user nix-grpc-daemon (trusted)5519worker1 # [ 139.531082] nix-daemon[889]: reaped child process 1744, status = succeeded5520lb # [ 139.570975] niks3-server[1004]: 2026/09/20 08:08:31 INFO Received uploads request method=POST path=/api/pending_closures5521worker1 # [ 139.557478] nix-grpc-daemon[1563]: time=2026-09-20T08:08:31.011Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5522worker1 # [ 139.561057] nix-grpc-daemon[1563]: time=2026-09-20T08:08:31.014Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5523lb # [ 139.618839] niks3-server[1004]: 2026/09/20 08:08:31 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5524lb # [ 139.636881] niks3-server[1004]: 2026/09/20 08:08:31 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5525lb # [ 139.646255] niks3-server[1004]: 2026/09/20 08:08:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5526worker1 # [ 139.626066] nix-grpc-daemon[1563]: time=2026-09-20T08:08:31.080Z level=INFO msg="Uploading 1 narinfos"5527lb # [ 139.656345] niks3-server[1004]: 2026/09/20 08:08:31 INFO Signed narinfos id=42 count=15528lb # [ 139.659199] niks3-server[1004]: 2026/09/20 08:08:31 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5529lb # [ 139.672910] niks3-server[1004]: 2026/09/20 08:08:31 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5530lb # [ 139.681708] niks3-server[1004]: 2026/09/20 08:08:31 INFO Completed upload id=425531worker1 # [ 139.655363] nix-grpc-daemon[1563]: time=2026-09-20T08:08:31.109Z level=INFO msg="Upload complete. (401ms)"5532lb # [ 139.684326] niks3-server[1004]: 2026/09/20 08:08:31 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5533worker1 # [ 139.669429] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15534worker1 # [ 139.689101] nix-daemon[889]: reaped child process 1724, status = succeeded5535client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&2, in 7.69 seconds)5536client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath5537client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath, in 0.25 seconds)5538worker2: must succeed: pkill -f 'read -t [9]0 x'5539worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.07 seconds)5540client: waiting for success: ! systemctl is-active sw5541worker2 # [ 140.245661] nix-daemon[835]: reaped child process 1502, status = succeeded5542worker2 # [ 140.415643] nix-daemon[835]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)5543worker2 # [ 140.433182] nix-daemon[835]: reaped child process 1676, status = succeeded5544lb # [ 140.419276] niks3-server[1004]: 2026/09/20 08:08:31 INFO Received uploads request method=POST path=/api/pending_closures5545worker2 # [ 140.456453] nix-grpc-daemon[1442]: time=2026-09-20T08:08:31.915Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5546worker2 # [ 140.457923] nix-grpc-daemon[1442]: time=2026-09-20T08:08:31.915Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5547lb # [ 140.449142] niks3-server[1004]: 2026/09/20 08:08:31 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5548lb # [ 140.462501] niks3-server[1004]: 2026/09/20 08:08:31 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5549lb # [ 140.476734] niks3-server[1004]: 2026/09/20 08:08:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5550worker2 # [ 140.509777] nix-grpc-daemon[1442]: time=2026-09-20T08:08:31.968Z level=INFO msg="Uploading 1 narinfos"5551lb # [ 140.486912] niks3-server[1004]: 2026/09/20 08:08:31 INFO Signed narinfos id=43 count=15552lb # [ 140.493101] niks3-server[1004]: 2026/09/20 08:08:31 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5553lb # [ 140.500975] niks3-server[1004]: 2026/09/20 08:08:31 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5554lb # [ 140.507460] niks3-server[1004]: 2026/09/20 08:08:31 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5555lb # [ 140.512509] niks3-server[1004]: 2026/09/20 08:08:31 INFO Completed upload id=435556worker2 # [ 140.540105] nix-grpc-daemon[1442]: time=2026-09-20T08:08:31.999Z level=INFO msg="Upload complete. (317ms)"5557worker2 # [ 140.552890] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42354 duration_s=13 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15558worker2 # [ 140.567150] nix-daemon[835]: reaped child process 1500, status = succeeded5559client # [ 140.529857] systemd[1]: sw.service: Deactivated successfully.5560client # [ 140.535434] systemd[1]: sw.service: Consumed 162ms CPU time over 14.933s wall clock time, 36.9M memory peak, 8.5K incoming IP traffic, 9.1K outgoing IP traffic.5561worker2 # [ 140.710033] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:32Z level=info event=signal_exit5562client: (finished: waiting for success: ! systemctl is-active sw, in 1.13 seconds)5563client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5564client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds)5565worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5566lb # [ 141.915569] envoy[922]: conn peer=[2001:db8:1::1]:35238 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9499 tx=3848 ms=73875567lb # [ 141.921123] envoy[922]: conn peer=[2001:db8:1::1]:38280 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=1328 ms=146635568worker1 # [ 141.902016] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:436125569worker2 # [ 141.961210] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:33Z level=info event=scheduler_restarting5570worker1 # [ 141.902328] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:33Z level=info event=worker_gone addr=192.168.1.4:500515571worker2 # [ 141.968318] nix-grpc-daemon[1291]: ts=2026-09-20T08:08:33Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5572worker2 # [ 141.995341] nix-daemon[835]: reaped child process 1349, status = succeeded5573worker2 # [ 142.789954] nix-grpc-daemon[1291]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5574worker2 # [ 142.790384] nix-grpc-daemon[1291]: E0000 00:00:1789891714.249306 1334 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true5575worker2 # [ 142.815250] nix-grpc-daemon[1291]: E0000 00:00:1789891714.274616 1334 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5576worker2 # [ 143.254429] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5577worker2 # [ 143.263557] systemd[1]: nix-grpc-daemon.service: Consumed 972ms CPU time over 48.812s wall clock time, 30.9M memory peak, 23.7K incoming IP traffic, 32.8K outgoing IP traffic.5578worker2 # [ 143.282132] systemd[1]: Starting Nix worker-protocol over gRPC...5579worker2 # [ 143.482274] nix-grpc-daemon[1690]: ts=2026-09-20T08:08:34Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5580worker2 # [ 143.484814] nix-grpc-daemon[1690]: ts=2026-09-20T08:08:34Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15581worker2 # [ 143.492717] nix-grpc-daemon[1690]: ts=2026-09-20T08:08:34Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5582worker2 # [ 143.494488] systemd[1]: Started Nix worker-protocol over gRPC.5583worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.23 seconds)5584lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5585lb: must succeed: curl -sf localhost:9901/clusters5586worker2 # [ 143.521599] nix-grpc-daemon[1690]: ts=2026-09-20T08:08:34Z level=info event=scheduler_connected addr=lb:500515587worker1 # [ 143.471780] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:34Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05588lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5589lb: must succeed: curl -sf localhost:9901/clusters5590lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5591lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds)5592lb: must succeed: curl -sf localhost:9901/clusters5593lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5594worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5595worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5596(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 19.24 seconds)5597subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5598client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15599worker1 # [ 145.029801] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:436165600worker1 # [ 145.044899] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:36Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05601worker1 # [ 145.052193] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:36Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15602worker1 # [ 145.058220] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:36Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05603worker1 # [ 145.063463] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:36Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05604worker1 # [ 145.089754] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165605worker1 # [ 145.106109] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436165606worker1 # [ 145.121064] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436165607worker1 # [ 145.135997] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5608worker1 # [ 145.350634] nix-daemon[889]: accepted connection from pid 1755, user nix-grpc-daemon (trusted)5609worker1 # [ 145.371404] nix-daemon[889]: reaped child process 1758, status = succeeded5610worker1 # [ 145.552805] nix-daemon[889]: accepted connection from pid 1760, user nix-grpc-daemon (trusted)5611worker1 # [ 145.571658] nix-daemon[889]: reaped child process 1763, status = succeeded5612lb # [ 145.610783] niks3-server[1004]: 2026/09/20 08:08:37 INFO Received uploads request method=POST path=/api/pending_closures5613worker1 # [ 145.688917] nix-grpc-daemon[1563]: time=2026-09-20T08:08:37.142Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5614worker1 # [ 145.694022] nix-grpc-daemon[1563]: time=2026-09-20T08:08:37.142Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5615lb # [ 145.745781] niks3-server[1004]: 2026/09/20 08:08:37 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5616worker1 # [ 145.737357] nix-grpc-daemon[1563]: time=2026-09-20T08:08:37.191Z level=INFO msg="Uploading 1 narinfos"5617lb # [ 145.756443] niks3-server[1004]: 2026/09/20 08:08:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5618lb # [ 145.768877] niks3-server[1004]: 2026/09/20 08:08:37 INFO Signed narinfos id=44 count=15619lb # [ 145.777303] niks3-server[1004]: 2026/09/20 08:08:37 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5620worker1 # [ 145.765895] nix-grpc-daemon[1563]: time=2026-09-20T08:08:37.220Z level=INFO msg="Upload complete. (613ms)"5621lb # [ 145.792813] niks3-server[1004]: 2026/09/20 08:08:37 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5622lb # [ 145.799236] niks3-server[1004]: 2026/09/20 08:08:37 INFO Completed upload id=445623lb # [ 145.803277] niks3-server[1004]: 2026/09/20 08:08:37 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5624worker1 # [ 145.777190] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=0 paths=1 nar_bytes_in=5125625worker1 # [ 145.792540] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165626worker1 # [ 145.803874] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5627worker1 # [ 145.810559] nix-daemon[889]: reaped child process 1753, status = succeeded5628worker1 # [ 145.824844] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5629worker1 # [ 147.277605] nix-daemon[889]: reaped child process 1767, status = succeeded5630worker1 # [ 147.458215] nix-daemon[889]: accepted connection from pid 1782, user nix-grpc-daemon (trusted)5631worker1 # [ 147.477100] nix-daemon[889]: reaped child process 1785, status = succeeded5632lb # [ 147.518231] niks3-server[1004]: 2026/09/20 08:08:38 INFO Received uploads request method=POST path=/api/pending_closures5633worker1 # [ 147.504508] nix-grpc-daemon[1563]: time=2026-09-20T08:08:38.955Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5634worker1 # [ 147.506554] nix-grpc-daemon[1563]: time=2026-09-20T08:08:38.955Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5635lb # [ 147.552518] niks3-server[1004]: 2026/09/20 08:08:39 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5636lb # [ 147.567009] niks3-server[1004]: 2026/09/20 08:08:39 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5637lb # [ 147.576962] niks3-server[1004]: 2026/09/20 08:08:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5638worker1 # [ 147.556426] nix-grpc-daemon[1563]: time=2026-09-20T08:08:39.010Z level=INFO msg="Uploading 1 narinfos"5639lb # [ 147.586318] niks3-server[1004]: 2026/09/20 08:08:39 INFO Signed narinfos id=45 count=15640lb # [ 147.592517] niks3-server[1004]: 2026/09/20 08:08:39 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5641lb # [ 147.601515] niks3-server[1004]: 2026/09/20 08:08:39 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5642worker1 # [ 147.579932] nix-grpc-daemon[1563]: time=2026-09-20T08:08:39.034Z level=INFO msg="Upload complete. (339ms)"5643lb # [ 147.608851] niks3-server[1004]: 2026/09/20 08:08:39 INFO Completed upload id=455644lb # [ 147.611559] niks3-server[1004]: 2026/09/20 08:08:39 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5645worker1 # [ 147.598094] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=15646worker1 # [ 147.619951] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:39Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15647worker1 # [ 147.627097] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165648worker1 # [ 147.633437] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:39Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05649worker1 # [ 147.639440] nix-daemon[889]: reaped child process 1765, status = succeeded5650worker1 # [ 147.643138] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436165651worker1 # [ 147.649708] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436165652worker1 # [ 147.659535] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5653worker1 # [ 147.851617] nix-daemon[889]: accepted connection from pid 1791, user nix-grpc-daemon (trusted)5654worker1 # [ 147.872480] nix-daemon[889]: reaped child process 1794, status = succeeded5655worker1 # [ 148.048620] nix-daemon[889]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)5656worker1 # [ 148.066860] nix-daemon[889]: reaped child process 1799, status = succeeded5657lb # [ 148.106160] niks3-server[1004]: 2026/09/20 08:08:39 INFO Received uploads request method=POST path=/api/pending_closures5658worker1 # [ 148.254135] nix-grpc-daemon[1563]: time=2026-09-20T08:08:39.708Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5659worker1 # [ 148.258959] nix-grpc-daemon[1563]: time=2026-09-20T08:08:39.708Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5660worker1 # [ 148.283549] nix-grpc-daemon[1563]: time=2026-09-20T08:08:39.737Z level=INFO msg="Uploading 1 narinfos"5661lb # [ 148.309569] niks3-server[1004]: 2026/09/20 08:08:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5662lb # [ 148.322477] niks3-server[1004]: 2026/09/20 08:08:39 INFO Signed narinfos id=46 count=15663lb # [ 148.329539] niks3-server[1004]: 2026/09/20 08:08:39 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5664lb # [ 148.341368] niks3-server[1004]: 2026/09/20 08:08:39 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5665lb # [ 148.346512] niks3-server[1004]: 2026/09/20 08:08:39 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5666lb # [ 148.352811] niks3-server[1004]: 2026/09/20 08:08:39 INFO Completed upload id=465667worker1 # [ 148.325422] nix-grpc-daemon[1563]: time=2026-09-20T08:08:39.780Z level=INFO msg="Upload complete. (653ms)"5668lb # [ 148.356445] niks3-server[1004]: 2026/09/20 08:08:39 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5669worker1 # [ 148.336319] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=0 paths=1 nar_bytes_in=5125670worker1 # [ 148.352377] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165671worker1 # [ 148.365346] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5672worker1 # [ 148.374267] nix-daemon[889]: reaped child process 1789, status = succeeded5673worker1 # [ 148.389683] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5674worker1 # [ 149.841097] nix-daemon[889]: reaped child process 1803, status = succeeded5675worker1 # [ 150.024181] nix-daemon[889]: accepted connection from pid 1818, user nix-grpc-daemon (trusted)5676worker1 # [ 150.045438] nix-daemon[889]: reaped child process 1821, status = succeeded5677lb # [ 150.086460] niks3-server[1004]: 2026/09/20 08:08:41 INFO Received uploads request method=POST path=/api/pending_closures5678worker1 # [ 150.071249] nix-grpc-daemon[1563]: time=2026-09-20T08:08:41.522Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5679worker1 # [ 150.072950] nix-grpc-daemon[1563]: time=2026-09-20T08:08:41.522Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5680lb # [ 150.128087] niks3-server[1004]: 2026/09/20 08:08:41 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5681worker1 # [ 150.119643] nix-grpc-daemon[1563]: time=2026-09-20T08:08:41.574Z level=INFO msg="Uploading 1 narinfos"5682lb # [ 150.138897] niks3-server[1004]: 2026/09/20 08:08:41 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5683lb # [ 150.152755] niks3-server[1004]: 2026/09/20 08:08:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5684lb # [ 150.155906] niks3-server[1004]: 2026/09/20 08:08:41 INFO Signed narinfos id=47 count=15685lb # [ 150.160055] niks3-server[1004]: 2026/09/20 08:08:41 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5686lb # [ 150.168493] niks3-server[1004]: 2026/09/20 08:08:41 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5687lb # [ 150.172287] niks3-server[1004]: 2026/09/20 08:08:41 INFO Completed upload id=475688lb # [ 150.175273] niks3-server[1004]: 2026/09/20 08:08:41 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5689worker1 # [ 150.141523] nix-grpc-daemon[1563]: time=2026-09-20T08:08:41.596Z level=INFO msg="Upload complete. (331ms)"5690worker1 # [ 150.158177] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=15691worker1 # [ 150.176983] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:41Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15692worker1 # [ 150.185217] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165693worker1 # [ 150.190083] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:41Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05694worker1 # [ 150.193796] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436165695worker1 # [ 150.199066] nix-daemon[889]: reaped child process 1801, status = succeeded5696worker1 # [ 150.206952] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436165697worker1 # [ 150.213516] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5698worker1 # [ 150.402923] nix-daemon[889]: accepted connection from pid 1827, user nix-grpc-daemon (trusted)5699worker1 # [ 150.422323] nix-daemon[889]: reaped child process 1830, status = succeeded5700worker1 # [ 150.605371] nix-daemon[889]: accepted connection from pid 1832, user nix-grpc-daemon (trusted)5701worker1 # [ 150.624280] nix-daemon[889]: reaped child process 1835, status = succeeded5702lb # [ 150.662284] niks3-server[1004]: 2026/09/20 08:08:42 INFO Received uploads request method=POST path=/api/pending_closures5703worker1 # [ 150.824759] nix-grpc-daemon[1563]: time=2026-09-20T08:08:42.278Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5704worker1 # [ 150.829470] nix-grpc-daemon[1563]: time=2026-09-20T08:08:42.278Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5705worker1 # [ 150.853981] nix-grpc-daemon[1563]: time=2026-09-20T08:08:42.308Z level=INFO msg="Uploading 1 narinfos"5706lb # [ 150.880124] niks3-server[1004]: 2026/09/20 08:08:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5707lb # [ 150.893641] niks3-server[1004]: 2026/09/20 08:08:42 INFO Signed narinfos id=48 count=15708lb # [ 150.906868] niks3-server[1004]: 2026/09/20 08:08:42 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5709lb # [ 150.914590] niks3-server[1004]: 2026/09/20 08:08:42 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5710worker1 # [ 150.893105] nix-grpc-daemon[1563]: time=2026-09-20T08:08:42.347Z level=INFO msg="Upload complete. (673ms)"5711lb # [ 150.920779] niks3-server[1004]: 2026/09/20 08:08:42 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5712lb # [ 150.927110] niks3-server[1004]: 2026/09/20 08:08:42 INFO Completed upload id=485713lb # [ 150.931115] niks3-server[1004]: 2026/09/20 08:08:42 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5714worker1 # [ 150.905446] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=0 paths=1 nar_bytes_in=5125715worker1 # [ 150.917262] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165716worker1 # [ 150.938229] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5717worker1 # [ 150.943783] nix-daemon[889]: reaped child process 1825, status = succeeded5718worker1 # [ 150.964241] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5719lb # [ 151.915175] envoy[922]: conn peer=[2001:db8:1::4]:53824 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2202 tx=866 ms=472525720worker1 # [ 152.213371] nix-daemon[889]: reaped child process 1839, status = succeeded5721worker1 # [ 152.397253] nix-daemon[889]: accepted connection from pid 1854, user nix-grpc-daemon (trusted)5722worker1 # [ 152.414947] nix-daemon[889]: reaped child process 1857, status = succeeded5723lb # [ 152.454115] niks3-server[1004]: 2026/09/20 08:08:43 INFO Received uploads request method=POST path=/api/pending_closures5724worker1 # [ 152.438495] nix-grpc-daemon[1563]: time=2026-09-20T08:08:43.892Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5725worker1 # [ 152.440204] nix-grpc-daemon[1563]: time=2026-09-20T08:08:43.892Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5726lb # [ 152.488907] niks3-server[1004]: 2026/09/20 08:08:43 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5727lb # [ 152.503019] niks3-server[1004]: 2026/09/20 08:08:43 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5728worker1 # [ 152.483651] nix-grpc-daemon[1563]: time=2026-09-20T08:08:43.938Z level=INFO msg="Uploading 1 narinfos"5729lb # [ 152.513299] niks3-server[1004]: 2026/09/20 08:08:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5730lb # [ 152.522605] niks3-server[1004]: 2026/09/20 08:08:43 INFO Signed narinfos id=49 count=15731lb # [ 152.528157] niks3-server[1004]: 2026/09/20 08:08:43 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5732worker1 # [ 152.500939] nix-grpc-daemon[1563]: time=2026-09-20T08:08:43.955Z level=INFO msg="Upload complete. (321ms)"5733lb # [ 152.531788] niks3-server[1004]: 2026/09/20 08:08:43 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5734lb # [ 152.536064] niks3-server[1004]: 2026/09/20 08:08:43 INFO Completed upload id=495735lb # [ 152.540447] niks3-server[1004]: 2026/09/20 08:08:43 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5736worker1 # [ 152.516422] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=15737worker1 # [ 152.532276] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:43Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15738worker1 # [ 152.542504] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165739worker1 # [ 152.547566] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:43Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05740worker1 # [ 152.552872] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436165741worker1 # [ 152.557530] nix-grpc-daemon[1563]: time=2026-09-20T08:08:44.011Z level=INFO msg="All 1 paths already cached"5742worker1 # [ 152.560494] nix-daemon[889]: reaped child process 1837, status = succeeded5743worker1 # [ 152.564353] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436165744worker1 # [ 152.573825] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5745worker1 # [ 152.761542] nix-daemon[889]: accepted connection from pid 1863, user nix-grpc-daemon (trusted)5746worker1 # [ 152.779085] nix-daemon[889]: reaped child process 1866, status = succeeded5747worker1 # [ 152.955900] nix-daemon[889]: accepted connection from pid 1868, user nix-grpc-daemon (trusted)5748worker1 # [ 152.972719] nix-daemon[889]: reaped child process 1871, status = succeeded5749lb # [ 153.014609] niks3-server[1004]: 2026/09/20 08:08:44 INFO Received uploads request method=POST path=/api/pending_closures5750worker1 # [ 152.996749] nix-grpc-daemon[1563]: time=2026-09-20T08:08:44.451Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5751worker1 # [ 152.998246] nix-grpc-daemon[1563]: time=2026-09-20T08:08:44.451Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5752lb # [ 153.042956] niks3-server[1004]: 2026/09/20 08:08:44 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5753worker1 # [ 153.026690] nix-grpc-daemon[1563]: time=2026-09-20T08:08:44.481Z level=INFO msg="Uploading 1 narinfos"5754lb # [ 153.056643] niks3-server[1004]: 2026/09/20 08:08:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5755lb # [ 153.066441] niks3-server[1004]: 2026/09/20 08:08:44 INFO Signed narinfos id=50 count=15756lb # [ 153.069870] niks3-server[1004]: 2026/09/20 08:08:44 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5757worker1 # [ 153.051970] nix-grpc-daemon[1563]: time=2026-09-20T08:08:44.506Z level=INFO msg="Upload complete. (467ms)"5758lb # [ 153.078757] niks3-server[1004]: 2026/09/20 08:08:44 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5759lb # [ 153.083862] niks3-server[1004]: 2026/09/20 08:08:44 INFO Completed upload id=505760worker1 # [ 153.060138] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=0 paths=1 nar_bytes_in=6245761lb # [ 153.086987] niks3-server[1004]: 2026/09/20 08:08:44 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5762worker1 # [ 153.064605] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165763worker1 # [ 153.075948] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5764worker1 # [ 153.077831] nix-daemon[889]: reaped child process 1861, status = succeeded5765worker1 # [ 153.089587] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5766worker1 # [ 153.912477] nix-daemon[889]: reaped child process 1875, status = succeeded5767worker1 # [ 154.072558] nix-daemon[889]: accepted connection from pid 1890, user nix-grpc-daemon (trusted)5768worker1 # [ 154.092396] nix-daemon[889]: reaped child process 1893, status = succeeded5769lb # [ 154.131685] niks3-server[1004]: 2026/09/20 08:08:45 INFO Received uploads request method=POST path=/api/pending_closures5770worker1 # [ 154.116446] nix-grpc-daemon[1563]: time=2026-09-20T08:08:45.568Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5771worker1 # [ 154.117958] nix-grpc-daemon[1563]: time=2026-09-20T08:08:45.568Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5772lb # [ 154.172808] niks3-server[1004]: 2026/09/20 08:08:45 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5773lb # [ 154.185775] niks3-server[1004]: 2026/09/20 08:08:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5774worker1 # [ 154.166622] nix-grpc-daemon[1563]: time=2026-09-20T08:08:45.621Z level=INFO msg="Uploading 1 narinfos"5775lb # [ 154.197234] niks3-server[1004]: 2026/09/20 08:08:45 INFO Signed narinfos id=51 count=15776lb # [ 154.203130] niks3-server[1004]: 2026/09/20 08:08:45 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5777lb # [ 154.213469] niks3-server[1004]: 2026/09/20 08:08:45 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5778lb # [ 154.216350] niks3-server[1004]: 2026/09/20 08:08:45 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5779lb # [ 154.220055] niks3-server[1004]: 2026/09/20 08:08:45 INFO Completed upload id=515780worker1 # [ 154.193689] nix-grpc-daemon[1563]: time=2026-09-20T08:08:45.648Z level=INFO msg="Upload complete. (295ms)"5781lb # [ 154.222208] niks3-server[1004]: 2026/09/20 08:08:45 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5782worker1 # [ 154.210573] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=15783worker1 # [ 154.223723] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:45Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15784worker1 # [ 154.233078] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165785worker1 # [ 154.237774] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:45Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05786worker1 # [ 154.241977] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436165787worker1 # [ 154.246103] nix-daemon[889]: reaped child process 1873, status = succeeded5788worker1 # [ 154.249208] nix-grpc-daemon[1563]: time=2026-09-20T08:08:45.696Z level=INFO msg="All 1 paths already cached"5789worker1 # [ 154.257032] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436165790worker1 # [ 154.264590] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5791worker1 # [ 154.447918] nix-daemon[889]: accepted connection from pid 1899, user nix-grpc-daemon (trusted)5792worker1 # [ 154.467087] nix-daemon[889]: reaped child process 1902, status = succeeded5793worker1 # [ 154.646082] nix-daemon[889]: accepted connection from pid 1904, user nix-grpc-daemon (trusted)5794worker1 # [ 154.663574] nix-daemon[889]: reaped child process 1907, status = succeeded5795lb # [ 154.701858] niks3-server[1004]: 2026/09/20 08:08:46 INFO Received uploads request method=POST path=/api/pending_closures5796worker1 # [ 154.684070] nix-grpc-daemon[1563]: time=2026-09-20T08:08:46.138Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5797worker1 # [ 154.686041] nix-grpc-daemon[1563]: time=2026-09-20T08:08:46.140Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5798lb # [ 154.730117] niks3-server[1004]: 2026/09/20 08:08:46 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5799worker1 # [ 154.717174] nix-grpc-daemon[1563]: time=2026-09-20T08:08:46.171Z level=INFO msg="Uploading 1 narinfos"5800lb # [ 154.747951] niks3-server[1004]: 2026/09/20 08:08:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5801lb # [ 154.758468] niks3-server[1004]: 2026/09/20 08:08:46 INFO Signed narinfos id=52 count=15802lb # [ 154.769295] niks3-server[1004]: 2026/09/20 08:08:46 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5803lb # [ 154.774001] niks3-server[1004]: 2026/09/20 08:08:46 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5804worker1 # [ 154.752072] nix-grpc-daemon[1563]: time=2026-09-20T08:08:46.206Z level=INFO msg="Upload complete. (482ms)"5805lb # [ 154.779388] niks3-server[1004]: 2026/09/20 08:08:46 INFO Completed upload id=525806lb # [ 154.784360] niks3-server[1004]: 2026/09/20 08:08:46 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5807worker1 # [ 154.760152] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=0 paths=1 nar_bytes_in=6245808worker1 # [ 154.774839] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165809worker1 # [ 154.781589] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5810worker1 # [ 154.786857] nix-daemon[889]: reaped child process 1897, status = succeeded5811worker1 # [ 154.798559] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5812worker1 # [ 155.832877] nix-daemon[889]: reaped child process 1911, status = succeeded5813worker1 # [ 155.998493] nix-daemon[889]: accepted connection from pid 1926, user nix-grpc-daemon (trusted)5814worker1 # [ 156.017210] nix-daemon[889]: reaped child process 1929, status = succeeded5815lb # [ 156.059585] niks3-server[1004]: 2026/09/20 08:08:47 INFO Received uploads request method=POST path=/api/pending_closures5816worker1 # [ 156.043070] nix-grpc-daemon[1563]: time=2026-09-20T08:08:47.496Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5817worker1 # [ 156.044656] nix-grpc-daemon[1563]: time=2026-09-20T08:08:47.496Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5818lb # [ 156.097606] niks3-server[1004]: 2026/09/20 08:08:47 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5819lb # [ 156.109380] niks3-server[1004]: 2026/09/20 08:08:47 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5820worker1 # [ 156.091109] nix-grpc-daemon[1563]: time=2026-09-20T08:08:47.545Z level=INFO msg="Uploading 1 narinfos"5821lb # [ 156.119157] niks3-server[1004]: 2026/09/20 08:08:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5822lb # [ 156.126854] niks3-server[1004]: 2026/09/20 08:08:47 INFO Signed narinfos id=53 count=15823lb # [ 156.136776] niks3-server[1004]: 2026/09/20 08:08:47 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5824worker1 # [ 156.109985] nix-grpc-daemon[1563]: time=2026-09-20T08:08:47.564Z level=INFO msg="Upload complete. (298ms)"5825lb # [ 156.140105] niks3-server[1004]: 2026/09/20 08:08:47 INFO Completed upload id=535826lb # [ 156.143264] niks3-server[1004]: 2026/09/20 08:08:47 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5827lb # [ 156.146551] niks3-server[1004]: 2026/09/20 08:08:47 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5828worker1 # [ 156.127130] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=15829worker1 # [ 156.140262] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:47Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15830worker1 # [ 156.147908] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165831worker1 # [ 156.152762] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:47Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05832worker1 # [ 156.157121] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436165833worker1 # [ 156.159923] nix-daemon[889]: reaped child process 1909, status = succeeded5834worker1 # [ 156.162502] nix-grpc-daemon[1563]: time=2026-09-20T08:08:47.616Z level=INFO msg="All 1 paths already cached"5835worker1 # [ 156.166586] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436165836worker1 # [ 156.176128] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5837worker1 # [ 156.363633] nix-daemon[889]: accepted connection from pid 1935, user nix-grpc-daemon (trusted)5838worker1 # [ 156.381713] nix-daemon[889]: reaped child process 1938, status = succeeded5839worker1 # [ 156.558984] nix-daemon[889]: accepted connection from pid 1940, user nix-grpc-daemon (trusted)5840worker1 # [ 156.576872] nix-daemon[889]: reaped child process 1943, status = succeeded5841lb # [ 156.614553] niks3-server[1004]: 2026/09/20 08:08:48 INFO Received uploads request method=POST path=/api/pending_closures5842worker1 # [ 156.596657] nix-grpc-daemon[1563]: time=2026-09-20T08:08:48.051Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5843worker1 # [ 156.598220] nix-grpc-daemon[1563]: time=2026-09-20T08:08:48.051Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5844lb # [ 156.640513] niks3-server[1004]: 2026/09/20 08:08:48 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5845lb # [ 156.654175] niks3-server[1004]: 2026/09/20 08:08:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5846worker1 # [ 156.633577] nix-grpc-daemon[1563]: time=2026-09-20T08:08:48.088Z level=INFO msg="Uploading 1 narinfos"5847lb # [ 156.667413] niks3-server[1004]: 2026/09/20 08:08:48 INFO Signed narinfos id=54 count=15848lb # [ 156.673110] niks3-server[1004]: 2026/09/20 08:08:48 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5849lb # [ 156.681048] niks3-server[1004]: 2026/09/20 08:08:48 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5850worker1 # [ 156.658674] nix-grpc-daemon[1563]: time=2026-09-20T08:08:48.113Z level=INFO msg="Upload complete. (471ms)"5851lb # [ 156.685922] niks3-server[1004]: 2026/09/20 08:08:48 INFO Completed upload id=545852lb # [ 156.688954] niks3-server[1004]: 2026/09/20 08:08:48 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo5853worker1 # [ 156.668259] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=0 paths=1 nar_bytes_in=6245854worker1 # [ 156.679885] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165855worker1 # [ 156.686221] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5856worker1 # [ 156.690930] nix-daemon[889]: reaped child process 1933, status = succeeded5857worker1 # [ 156.702232] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5858worker1 # [ 158.329842] nix-daemon[889]: reaped child process 1947, status = succeeded5859worker1 # [ 158.496939] nix-daemon[889]: accepted connection from pid 1962, user nix-grpc-daemon (trusted)5860worker1 # [ 158.516272] nix-daemon[889]: reaped child process 1965, status = succeeded5861lb # [ 158.555762] niks3-server[1004]: 2026/09/20 08:08:50 INFO Received uploads request method=POST path=/api/pending_closures5862worker1 # [ 158.538860] nix-grpc-daemon[1563]: time=2026-09-20T08:08:49.993Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5863worker1 # [ 158.546093] nix-grpc-daemon[1563]: time=2026-09-20T08:08:49.995Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"5864lb # [ 158.597361] niks3-server[1004]: 2026/09/20 08:08:50 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst5865lb # [ 158.609985] niks3-server[1004]: 2026/09/20 08:08:50 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv5866lb # [ 158.618270] niks3-server[1004]: 2026/09/20 08:08:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5867worker1 # [ 158.596825] nix-grpc-daemon[1563]: time=2026-09-20T08:08:50.051Z level=INFO msg="Uploading 1 narinfos"5868lb # [ 158.626864] niks3-server[1004]: 2026/09/20 08:08:50 INFO Signed narinfos id=55 count=15869lb # [ 158.632277] niks3-server[1004]: 2026/09/20 08:08:50 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls5870lb # [ 158.639308] niks3-server[1004]: 2026/09/20 08:08:50 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5871worker1 # [ 158.618566] nix-grpc-daemon[1563]: time=2026-09-20T08:08:50.073Z level=INFO msg="Upload complete. (303ms)"5872lb # [ 158.646549] niks3-server[1004]: 2026/09/20 08:08:50 INFO Completed upload id=555873lb # [ 158.649712] niks3-server[1004]: 2026/09/20 08:08:50 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo5874worker1 # [ 158.634799] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=15875worker1 # [ 158.652921] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:50Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=15876worker1 # [ 158.662370] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165877worker1 # [ 158.667445] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:50Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=05878worker1 # [ 158.671899] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436165879worker1 # [ 158.676567] nix-grpc-daemon[1563]: time=2026-09-20T08:08:50.125Z level=INFO msg="All 2 paths already cached"5880worker1 # [ 158.679961] nix-daemon[889]: reaped child process 1945, status = succeeded5881worker1 # [ 158.689110] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436165882worker1 # [ 158.694780] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5883worker1 # [ 158.878545] nix-daemon[889]: accepted connection from pid 1971, user nix-grpc-daemon (trusted)5884worker1 # [ 158.897296] nix-daemon[889]: reaped child process 1974, status = succeeded5885worker1 # [ 159.068135] nix-daemon[889]: accepted connection from pid 1976, user nix-grpc-daemon (trusted)5886worker1 # [ 159.085909] nix-daemon[889]: reaped child process 1979, status = succeeded5887lb # [ 159.126842] niks3-server[1004]: 2026/09/20 08:08:50 INFO Received uploads request method=POST path=/api/pending_closures5888worker1 # [ 159.111753] nix-grpc-daemon[1563]: time=2026-09-20T08:08:50.566Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5889worker1 # [ 159.113405] nix-grpc-daemon[1563]: time=2026-09-20T08:08:50.566Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"5890lb # [ 159.159971] niks3-server[1004]: 2026/09/20 08:08:50 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst5891lb # [ 159.172727] niks3-server[1004]: 2026/09/20 08:08:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5892worker1 # [ 159.150397] nix-grpc-daemon[1563]: time=2026-09-20T08:08:50.604Z level=INFO msg="Uploading 1 narinfos"5893lb # [ 159.181934] niks3-server[1004]: 2026/09/20 08:08:50 INFO Signed narinfos id=56 count=15894lb # [ 159.186478] niks3-server[1004]: 2026/09/20 08:08:50 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls5895lb # [ 159.193603] niks3-server[1004]: 2026/09/20 08:08:50 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5896lb # [ 159.200871] niks3-server[1004]: 2026/09/20 08:08:50 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo5897lb # [ 159.204106] niks3-server[1004]: 2026/09/20 08:08:50 INFO Completed upload id=565898worker1 # [ 159.177465] nix-grpc-daemon[1563]: time=2026-09-20T08:08:50.632Z level=INFO msg="Upload complete. (474ms)"5899worker1 # [ 159.185028] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=0 paths=1 nar_bytes_in=7525900worker1 # [ 159.198900] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165901worker1 # [ 159.205002] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5902worker1 # [ 159.209873] nix-daemon[889]: reaped child process 1969, status = succeeded5903worker1 # [ 159.223691] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5904worker1 # [ 160.257908] nix-daemon[889]: reaped child process 1983, status = succeeded5905worker1 # [ 160.433113] nix-daemon[889]: accepted connection from pid 1998, user nix-grpc-daemon (trusted)5906worker1 # [ 160.450071] nix-daemon[889]: reaped child process 2001, status = succeeded5907lb # [ 160.491647] niks3-server[1004]: 2026/09/20 08:08:51 INFO Received uploads request method=POST path=/api/pending_closures5908worker1 # [ 160.476449] nix-grpc-daemon[1563]: time=2026-09-20T08:08:51.930Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5909worker1 # [ 160.478264] nix-grpc-daemon[1563]: time=2026-09-20T08:08:51.930Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"5910lb # [ 160.531958] niks3-server[1004]: 2026/09/20 08:08:51 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst5911lb # [ 160.544216] niks3-server[1004]: 2026/09/20 08:08:52 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv5912worker1 # [ 160.526299] nix-grpc-daemon[1563]: time=2026-09-20T08:08:51.980Z level=INFO msg="Uploading 1 narinfos"5913lb # [ 160.557276] niks3-server[1004]: 2026/09/20 08:08:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign5914lb # [ 160.565974] niks3-server[1004]: 2026/09/20 08:08:52 INFO Signed narinfos id=57 count=15915lb # [ 160.569890] niks3-server[1004]: 2026/09/20 08:08:52 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls5916lb # [ 160.579498] niks3-server[1004]: 2026/09/20 08:08:52 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete5917lb # [ 160.585178] niks3-server[1004]: 2026/09/20 08:08:52 INFO Completed upload id=575918worker1 # [ 160.558605] nix-grpc-daemon[1563]: time=2026-09-20T08:08:52.013Z level=INFO msg="Upload complete. (324ms)"5919lb # [ 160.588105] niks3-server[1004]: 2026/09/20 08:08:52 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo5920worker1 # [ 160.573146] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=15921worker1 # [ 160.589683] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:52Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=15922worker1 # [ 160.594590] nix-daemon[889]: reaped child process 1981, status = succeeded5923worker1 # [ 160.613527] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165924worker1 # [ 160.628257] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436165925worker1 # [ 160.642164] nix-grpc-daemon[1563]: time=2026-09-20T08:08:52.096Z level=INFO msg="All 2 paths already cached"5926worker1 # [ 160.650977] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436165927worker1 # [ 160.664195] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5928worker1 # [ 160.872137] nix-daemon[889]: accepted connection from pid 2005, user nix-grpc-daemon (trusted)5929worker1 # [ 160.891124] nix-daemon[889]: reaped child process 2008, status = succeeded5930worker1 # [ 161.061139] nix-daemon[889]: accepted connection from pid 2010, user nix-grpc-daemon (trusted)5931worker1 # [ 161.079152] nix-daemon[889]: reaped child process 2013, status = succeeded5932lb # [ 161.117317] niks3-server[1004]: 2026/09/20 08:08:52 INFO Received uploads request method=POST path=/api/pending_closures5933worker1 # [ 161.099216] nix-grpc-daemon[1563]: time=2026-09-20T08:08:52.553Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5934worker1 # [ 161.100772] nix-grpc-daemon[1563]: time=2026-09-20T08:08:52.553Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"5935lb # [ 161.147602] niks3-server[1004]: 2026/09/20 08:08:52 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst5936lb # [ 161.157584] niks3-server[1004]: 2026/09/20 08:08:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign5937worker1 # [ 161.137365] nix-grpc-daemon[1563]: time=2026-09-20T08:08:52.591Z level=INFO msg="Uploading 1 narinfos"5938lb # [ 161.168372] niks3-server[1004]: 2026/09/20 08:08:52 INFO Signed narinfos id=58 count=15939lb # [ 161.171363] niks3-server[1004]: 2026/09/20 08:08:52 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls5940lb # [ 161.182473] niks3-server[1004]: 2026/09/20 08:08:52 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete5941lb # [ 161.188775] niks3-server[1004]: 2026/09/20 08:08:52 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo5942lb # [ 161.192866] niks3-server[1004]: 2026/09/20 08:08:52 INFO Completed upload id=585943worker1 # [ 161.166315] nix-grpc-daemon[1563]: time=2026-09-20T08:08:52.621Z level=INFO msg="Upload complete. (485ms)"5944worker1 # [ 161.175384] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=0 paths=1 nar_bytes_in=7525945worker1 # [ 161.188133] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165946worker1 # [ 161.196553] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5947worker1 # [ 161.199250] nix-daemon[889]: reaped child process 2003, status = succeeded5948worker1 # [ 161.212203] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5949worker1 # [ 162.046814] nix-daemon[889]: reaped child process 2017, status = succeeded5950worker1 # [ 162.220381] nix-daemon[889]: accepted connection from pid 2032, user nix-grpc-daemon (trusted)5951worker1 # [ 162.237439] nix-daemon[889]: reaped child process 2035, status = succeeded5952lb # [ 162.279535] niks3-server[1004]: 2026/09/20 08:08:53 INFO Received uploads request method=POST path=/api/pending_closures5953worker1 # [ 162.266071] nix-grpc-daemon[1563]: time=2026-09-20T08:08:53.718Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5954worker1 # [ 162.267574] nix-grpc-daemon[1563]: time=2026-09-20T08:08:53.718Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"5955lb # [ 162.314935] niks3-server[1004]: 2026/09/20 08:08:53 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst5956worker1 # [ 162.311021] nix-grpc-daemon[1563]: time=2026-09-20T08:08:53.765Z level=INFO msg="Uploading 1 narinfos"5957lb # [ 162.332824] niks3-server[1004]: 2026/09/20 08:08:53 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls5958lb # [ 162.341416] niks3-server[1004]: 2026/09/20 08:08:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign5959lb # [ 162.348401] niks3-server[1004]: 2026/09/20 08:08:53 INFO Signed narinfos id=59 count=15960lb # [ 162.350391] niks3-server[1004]: 2026/09/20 08:08:53 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv5961lb # [ 162.356762] niks3-server[1004]: 2026/09/20 08:08:53 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete5962lb # [ 162.362797] niks3-server[1004]: 2026/09/20 08:08:53 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo5963lb # [ 162.367056] niks3-server[1004]: 2026/09/20 08:08:53 INFO Completed upload id=595964worker1 # [ 162.340387] nix-grpc-daemon[1563]: time=2026-09-20T08:08:53.795Z level=INFO msg="Upload complete. (318ms)"5965worker1 # [ 162.352880] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=15966worker1 # [ 162.366749] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:53Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=15967worker1 # [ 162.371169] nix-daemon[889]: reaped child process 2015, status = succeeded5968worker1 # [ 162.395059] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165969worker1 # [ 162.410021] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436165970worker1 # [ 162.425062] nix-grpc-daemon[1563]: time=2026-09-20T08:08:53.879Z level=INFO msg="All 2 paths already cached"5971worker1 # [ 162.434074] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436165972worker1 # [ 162.448109] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5973worker1 # [ 162.651540] nix-daemon[889]: accepted connection from pid 2039, user nix-grpc-daemon (trusted)5974worker1 # [ 162.667813] nix-daemon[889]: reaped child process 2042, status = succeeded5975worker1 # [ 162.847136] nix-daemon[889]: accepted connection from pid 2044, user nix-grpc-daemon (trusted)5976worker1 # [ 162.864484] nix-daemon[889]: reaped child process 2047, status = succeeded5977lb # [ 162.902709] niks3-server[1004]: 2026/09/20 08:08:54 INFO Received uploads request method=POST path=/api/pending_closures5978worker1 # [ 162.886056] nix-grpc-daemon[1563]: time=2026-09-20T08:08:54.340Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5979worker1 # [ 162.887537] nix-grpc-daemon[1563]: time=2026-09-20T08:08:54.340Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"5980lb # [ 162.931093] niks3-server[1004]: 2026/09/20 08:08:54 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst5981worker1 # [ 162.919767] nix-grpc-daemon[1563]: time=2026-09-20T08:08:54.374Z level=INFO msg="Uploading 1 narinfos"5982lb # [ 162.947185] niks3-server[1004]: 2026/09/20 08:08:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign5983lb # [ 162.956399] niks3-server[1004]: 2026/09/20 08:08:54 INFO Signed narinfos id=60 count=15984lb # [ 162.962361] niks3-server[1004]: 2026/09/20 08:08:54 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls5985lb # [ 162.971187] niks3-server[1004]: 2026/09/20 08:08:54 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete5986lb # [ 162.975970] niks3-server[1004]: 2026/09/20 08:08:54 INFO Completed upload id=605987worker1 # [ 162.948890] nix-grpc-daemon[1563]: time=2026-09-20T08:08:54.403Z level=INFO msg="Upload complete. (483ms)"5988lb # [ 162.978445] niks3-server[1004]: 2026/09/20 08:08:54 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo5989worker1 # [ 162.956129] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=0 paths=1 nar_bytes_in=7525990worker1 # [ 162.965943] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436165991worker1 # [ 162.976359] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5992worker1 # [ 162.981121] nix-daemon[889]: reaped child process 2037, status = succeeded5993worker1 # [ 162.994488] nix-daemon[889]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5994worker1 # [ 163.636886] nix-daemon[889]: reaped child process 2051, status = succeeded5995worker1 # [ 163.808059] nix-daemon[889]: accepted connection from pid 2066, user nix-grpc-daemon (trusted)5996worker1 # [ 163.826841] nix-daemon[889]: reaped child process 2069, status = succeeded5997lb # [ 163.866751] niks3-server[1004]: 2026/09/20 08:08:55 INFO Received uploads request method=POST path=/api/pending_closures5998worker1 # [ 163.850498] nix-grpc-daemon[1563]: time=2026-09-20T08:08:55.303Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5999worker1 # [ 163.852373] nix-grpc-daemon[1563]: time=2026-09-20T08:08:55.304Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6000lb # [ 163.894320] niks3-server[1004]: 2026/09/20 08:08:55 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6001lb # [ 163.910061] niks3-server[1004]: 2026/09/20 08:08:55 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6002lb # [ 163.923985] niks3-server[1004]: 2026/09/20 08:08:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6003worker1 # [ 163.902255] nix-grpc-daemon[1563]: time=2026-09-20T08:08:55.356Z level=INFO msg="Uploading 1 narinfos"6004lb # [ 163.933952] niks3-server[1004]: 2026/09/20 08:08:55 INFO Signed narinfos id=61 count=16005lb # [ 163.940291] niks3-server[1004]: 2026/09/20 08:08:55 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6006lb # [ 163.949312] niks3-server[1004]: 2026/09/20 08:08:55 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6007worker1 # [ 163.927396] nix-grpc-daemon[1563]: time=2026-09-20T08:08:55.382Z level=INFO msg="Upload complete. (321ms)"6008lb # [ 163.954656] niks3-server[1004]: 2026/09/20 08:08:55 INFO Completed upload id=616009lb # [ 163.958936] niks3-server[1004]: 2026/09/20 08:08:55 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6010worker1 # [ 163.938530] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43616 duration_s=0 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16011worker1 # [ 163.957606] nix-daemon[889]: reaped child process 2049, status = succeeded6012client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.29 seconds)6013worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6014worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.08 seconds)6015client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16016worker1 # [ 164.381878] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:436166017worker1 # [ 164.399091] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:55Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06018client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.29 seconds)6019(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 19.66 seconds)6020subtest: low disk drains a worker and builds go to the other6021worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6022worker1 # [ 165.453323] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:56Z level=info event=unhealthy reason=min_free6023worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.14 seconds)6024worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6025worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.04 seconds)6026client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&26027worker1 # [ 165.874293] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:436166028client # don't know how to build these paths:6029client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6030worker1 # [ 165.892124] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:57Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06031worker1 # [ 165.898264] nix-grpc-daemon[1487]: ts=2026-09-20T08:08:57Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16032worker2 # [ 166.006620] nix-grpc-daemon[1690]: ts=2026-09-20T08:08:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355246033worker2 # [ 166.022686] nix-daemon[835]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6034worker2 # [ 166.049465] nix-grpc-daemon[1690]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 1 ms (attempt 1/5)6035worker2 # [ 166.058642] nix-grpc-daemon[1690]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 189 ms (attempt 2/5)6036worker2 # [ 166.247722] nix-grpc-daemon[1690]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 199 ms (attempt 3/5)6037worker2 # [ 166.454537] nix-grpc-daemon[1690]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 462 ms (attempt 4/5)6038worker2 # [ 166.924899] nix-grpc-daemon[1690]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6039worker2 # [ 166.946873] nix-grpc-daemon[1690]: ts=2026-09-20T08:08:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355246040client # copying 1 paths to 'lb:50051'...6041client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6042worker2 # [ 166.964064] nix-grpc-daemon[1690]: ts=2026-09-20T08:08:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355246043worker2 # [ 166.979091] nix-daemon[835]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6044worker2 # [ 167.007918] nix-grpc-daemon[1690]: ts=2026-09-20T08:08:58Z level=info event=niks3_push_started pid=17466045worker2 # [ 167.401517] nix-daemon[835]: accepted connection from pid 1759, user nix-grpc-daemon (trusted)6046worker2 # [ 167.421785] nix-daemon[835]: reaped child process 1762, status = succeeded6047worker2 # [ 167.602540] nix-daemon[835]: accepted connection from pid 1764, user nix-grpc-daemon (trusted)6048worker2 # [ 167.620620] nix-daemon[835]: reaped child process 1767, status = succeeded6049lb # [ 167.609699] niks3-server[1004]: 2026/09/20 08:08:59 INFO Received uploads request method=POST path=/api/pending_closures6050worker2 # [ 167.650695] nix-grpc-daemon[1746]: time=2026-09-20T08:08:59.108Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6051worker2 # [ 167.652574] nix-grpc-daemon[1746]: time=2026-09-20T08:08:59.108Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6052lb # [ 167.648215] niks3-server[1004]: 2026/09/20 08:08:59 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6053lb # [ 167.660174] niks3-server[1004]: 2026/09/20 08:08:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6054worker2 # [ 167.694991] nix-grpc-daemon[1746]: time=2026-09-20T08:08:59.154Z level=INFO msg="Uploading 1 narinfos"6055lb # [ 167.674100] niks3-server[1004]: 2026/09/20 08:08:59 INFO Signed narinfos id=62 count=16056lb # [ 167.681684] niks3-server[1004]: 2026/09/20 08:08:59 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6057lb # [ 167.692222] niks3-server[1004]: 2026/09/20 08:08:59 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6058lb # [ 167.699448] niks3-server[1004]: 2026/09/20 08:08:59 INFO Completed upload id=626059lb # [ 167.703446] niks3-server[1004]: 2026/09/20 08:08:59 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6060worker2 # [ 167.727239] nix-grpc-daemon[1746]: time=2026-09-20T08:08:59.185Z level=INFO msg="Upload complete. (498ms)"6061worker2 # [ 167.737654] nix-grpc-daemon[1690]: ts=2026-09-20T08:08:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35524 duration_s=0 paths=1 nar_bytes_in=5126062worker2 # [ 167.745005] nix-grpc-daemon[1690]: ts=2026-09-20T08:08:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355246063worker2 # [ 167.756075] nix-daemon[835]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6064worker2 # [ 167.761352] nix-daemon[835]: reaped child process 1744, status = succeeded6065client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6066client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6067worker2 # [ 167.775397] nix-daemon[835]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6068client # farm-a> LOG-farm-a-drain6069worker2 # [ 168.395064] nix-daemon[835]: reaped child process 1771, status = succeeded6070worker2 # [ 168.554940] nix-daemon[835]: accepted connection from pid 1786, user nix-grpc-daemon (trusted)6071worker2 # [ 168.572391] nix-daemon[835]: reaped child process 1789, status = succeeded6072lb # [ 168.556755] niks3-server[1004]: 2026/09/20 08:09:00 INFO Received uploads request method=POST path=/api/pending_closures6073worker2 # [ 168.596085] nix-grpc-daemon[1746]: time=2026-09-20T08:09:00.053Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6074worker2 # [ 168.597566] nix-grpc-daemon[1746]: time=2026-09-20T08:09:00.053Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6075lb # [ 168.610916] niks3-server[1004]: 2026/09/20 08:09:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6076worker2 # [ 168.644112] nix-grpc-daemon[1746]: time=2026-09-20T08:09:00.102Z level=INFO msg="Uploading 1 narinfos"6077lb # [ 168.625476] niks3-server[1004]: 2026/09/20 08:09:00 INFO Signed narinfos id=63 count=16078lb # [ 168.627885] niks3-server[1004]: 2026/09/20 08:09:00 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6079lb # [ 168.637769] niks3-server[1004]: 2026/09/20 08:09:00 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6080worker2 # [ 168.673606] nix-grpc-daemon[1746]: time=2026-09-20T08:09:00.132Z level=INFO msg="Upload complete. (287ms)"6081lb # [ 168.646229] niks3-server[1004]: 2026/09/20 08:09:00 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6082lb # [ 168.651122] niks3-server[1004]: 2026/09/20 08:09:00 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6083lb # [ 168.655375] niks3-server[1004]: 2026/09/20 08:09:00 INFO Completed upload id=636084lb # [ 168.657625] niks3-server[1004]: 2026/09/20 08:09:00 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6085worker2 # [ 168.684943] nix-grpc-daemon[1690]: ts=2026-09-20T08:09:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35524 duration_s=0 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16086worker1 # [ 168.638743] nix-grpc-daemon[1487]: ts=2026-09-20T08:09:00Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06087worker2 # [ 168.698765] nix-daemon[835]: reaped child process 1769, status = succeeded6088worker1 # [ 168.644228] nix-grpc-daemon[1487]: ts=2026-09-20T08:09:00Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16089worker2 # [ 168.740175] nix-grpc-daemon[1690]: ts=2026-09-20T08:09:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355246090worker2 # [ 168.755529] nix-grpc-daemon[1690]: ts=2026-09-20T08:09:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355246091client # copying 1 paths to 'lb:50051'...6092worker2 # [ 168.770935] nix-grpc-daemon[1746]: time=2026-09-20T08:09:00.229Z level=INFO msg="All 1 paths already cached"6093client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6094worker2 # [ 168.776444] nix-grpc-daemon[1690]: ts=2026-09-20T08:09:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355246095worker2 # [ 168.790092] nix-daemon[835]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6096worker2 # [ 168.995930] nix-daemon[835]: accepted connection from pid 1793, user nix-grpc-daemon (trusted)6097worker2 # [ 169.013890] nix-daemon[835]: reaped child process 1796, status = succeeded6098worker2 # [ 169.191891] nix-daemon[835]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)6099worker2 # [ 169.209279] nix-daemon[835]: reaped child process 1801, status = succeeded6100lb # [ 169.195076] niks3-server[1004]: 2026/09/20 08:09:00 INFO Received uploads request method=POST path=/api/pending_closures6101worker2 # [ 169.233019] nix-grpc-daemon[1746]: time=2026-09-20T08:09:00.692Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6102worker2 # [ 169.234478] nix-grpc-daemon[1746]: time=2026-09-20T08:09:00.692Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6103lb # [ 169.222644] niks3-server[1004]: 2026/09/20 08:09:00 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6104worker2 # [ 169.262865] nix-grpc-daemon[1746]: time=2026-09-20T08:09:00.722Z level=INFO msg="Uploading 1 narinfos"6105lb # [ 169.238999] niks3-server[1004]: 2026/09/20 08:09:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6106lb # [ 169.249340] niks3-server[1004]: 2026/09/20 08:09:00 INFO Signed narinfos id=64 count=16107lb # [ 169.253385] niks3-server[1004]: 2026/09/20 08:09:00 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6108worker2 # [ 169.288050] nix-grpc-daemon[1746]: time=2026-09-20T08:09:00.747Z level=INFO msg="Upload complete. (481ms)"6109lb # [ 169.261775] niks3-server[1004]: 2026/09/20 08:09:00 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6110lb # [ 169.267920] niks3-server[1004]: 2026/09/20 08:09:00 INFO Completed upload id=646111worker2 # [ 169.296117] nix-grpc-daemon[1690]: ts=2026-09-20T08:09:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35524 duration_s=0 paths=1 nar_bytes_in=6326112lb # [ 169.271640] niks3-server[1004]: 2026/09/20 08:09:00 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6113worker2 # [ 169.307018] nix-grpc-daemon[1690]: ts=2026-09-20T08:09:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355246114worker2 # [ 169.314277] nix-daemon[835]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6115worker2 # [ 169.318803] nix-daemon[835]: reaped child process 1791, status = succeeded6116client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6117client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6118worker2 # [ 169.331510] nix-daemon[835]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6119client # farm-b> LOG-farm-b-drain6120worker2 # [ 170.157419] nix-daemon[835]: reaped child process 1805, status = succeeded6121worker2 # [ 170.330608] nix-daemon[835]: accepted connection from pid 1820, user nix-grpc-daemon (trusted)6122worker2 # [ 170.347920] nix-daemon[835]: reaped child process 1823, status = succeeded6123lb # [ 170.333355] niks3-server[1004]: 2026/09/20 08:09:01 INFO Received uploads request method=POST path=/api/pending_closures6124worker2 # [ 170.370418] nix-grpc-daemon[1746]: time=2026-09-20T08:09:01.829Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6125worker2 # [ 170.371962] nix-grpc-daemon[1746]: time=2026-09-20T08:09:01.829Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6126lb # [ 170.371791] niks3-server[1004]: 2026/09/20 08:09:01 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6127worker2 # [ 170.411514] nix-grpc-daemon[1746]: time=2026-09-20T08:09:01.870Z level=INFO msg="Uploading 1 narinfos"6128lb # [ 170.383618] niks3-server[1004]: 2026/09/20 08:09:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6129lb # [ 170.395894] niks3-server[1004]: 2026/09/20 08:09:01 INFO Signed narinfos id=65 count=16130lb # [ 170.402637] niks3-server[1004]: 2026/09/20 08:09:01 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6131lb # [ 170.412464] niks3-server[1004]: 2026/09/20 08:09:01 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6132worker2 # [ 170.445115] nix-grpc-daemon[1746]: time=2026-09-20T08:09:01.904Z level=INFO msg="Upload complete. (304ms)"6133lb # [ 170.418260] niks3-server[1004]: 2026/09/20 08:09:01 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6134lb # [ 170.424571] niks3-server[1004]: 2026/09/20 08:09:01 INFO Completed upload id=656135lb # [ 170.427790] niks3-server[1004]: 2026/09/20 08:09:01 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6136worker2 # [ 170.457149] nix-grpc-daemon[1690]: ts=2026-09-20T08:09:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35524 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16137worker1 # [ 170.409979] nix-grpc-daemon[1487]: ts=2026-09-20T08:09:01Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06138worker1 # [ 170.415957] nix-grpc-daemon[1487]: ts=2026-09-20T08:09:01Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16139worker2 # [ 170.476614] nix-daemon[835]: reaped child process 1803, status = succeeded6140worker2 # [ 170.508207] nix-grpc-daemon[1690]: ts=2026-09-20T08:09:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355246141worker2 # [ 170.523443] nix-grpc-daemon[1690]: ts=2026-09-20T08:09:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:355246142worker2 # [ 170.537654] nix-grpc-daemon[1746]: time=2026-09-20T08:09:01.997Z level=INFO msg="All 2 paths already cached"6143client # copying 1 paths to 'lb:50051'...6144client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6145worker2 # [ 170.547693] nix-grpc-daemon[1690]: ts=2026-09-20T08:09:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:355246146worker2 # [ 170.562012] nix-daemon[835]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6147worker2 # [ 170.764839] nix-daemon[835]: accepted connection from pid 1827, user nix-grpc-daemon (trusted)6148worker2 # [ 170.785282] nix-daemon[835]: reaped child process 1830, status = succeeded6149worker2 # [ 170.960002] nix-daemon[835]: accepted connection from pid 1832, user nix-grpc-daemon (trusted)6150worker2 # [ 170.978214] nix-daemon[835]: reaped child process 1835, status = succeeded6151lb # [ 170.962163] niks3-server[1004]: 2026/09/20 08:09:02 INFO Received uploads request method=POST path=/api/pending_closures6152worker2 # [ 170.998395] nix-grpc-daemon[1746]: time=2026-09-20T08:09:02.457Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6153worker2 # [ 170.999906] nix-grpc-daemon[1746]: time=2026-09-20T08:09:02.457Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6154lb # [ 170.991183] niks3-server[1004]: 2026/09/20 08:09:02 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6155lb # [ 171.002342] niks3-server[1004]: 2026/09/20 08:09:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6156worker2 # [ 171.037365] nix-grpc-daemon[1746]: time=2026-09-20T08:09:02.496Z level=INFO msg="Uploading 1 narinfos"6157lb # [ 171.013595] niks3-server[1004]: 2026/09/20 08:09:02 INFO Signed narinfos id=66 count=16158lb # [ 171.019774] niks3-server[1004]: 2026/09/20 08:09:02 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6159lb # [ 171.026183] niks3-server[1004]: 2026/09/20 08:09:02 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6160lb # [ 171.033558] niks3-server[1004]: 2026/09/20 08:09:02 INFO Completed upload id=666161worker2 # [ 171.060954] nix-grpc-daemon[1746]: time=2026-09-20T08:09:02.520Z level=INFO msg="Upload complete. (482ms)"6162lb # [ 171.036339] niks3-server[1004]: 2026/09/20 08:09:02 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6163worker2 # [ 171.068124] nix-grpc-daemon[1690]: ts=2026-09-20T08:09:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35524 duration_s=0 paths=1 nar_bytes_in=7606164worker2 # [ 171.076637] nix-grpc-daemon[1690]: ts=2026-09-20T08:09:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:355246165worker2 # [ 171.088164] nix-daemon[835]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6166worker2 # [ 171.091834] nix-daemon[835]: reaped child process 1825, status = succeeded6167worker2 # [ 171.103419] nix-daemon[835]: accepted connection from pid 1690, user nix-grpc-daemon (trusted)6168client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6169client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6170lb # [ 171.916558] envoy[922]: conn peer=[2001:db8:1::1]:52668 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26841 tx=10683 ms=189736171lb # [ 171.916928] envoy[922]: conn peer=[2001:db8:1::1]:49412 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=710 tx=439 ms=386172client # farm-top> LOG-farm-top-drain6173worker2 # [ 172.155641] nix-daemon[835]: reaped child process 1839, status = succeeded6174worker2 # [ 172.334267] nix-daemon[835]: accepted connection from pid 1854, user nix-grpc-daemon (trusted)6175worker2 # [ 172.352691] nix-daemon[835]: reaped child process 1857, status = succeeded6176lb # [ 172.337586] niks3-server[1004]: 2026/09/20 08:09:03 INFO Received uploads request method=POST path=/api/pending_closures6177worker2 # [ 172.375517] nix-grpc-daemon[1746]: time=2026-09-20T08:09:03.833Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6178worker2 # [ 172.377532] nix-grpc-daemon[1746]: time=2026-09-20T08:09:03.833Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6179lb # [ 172.372365] niks3-server[1004]: 2026/09/20 08:09:03 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6180lb # [ 172.385520] niks3-server[1004]: 2026/09/20 08:09:03 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6181lb # [ 172.394268] niks3-server[1004]: 2026/09/20 08:09:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6182lb # [ 172.400810] niks3-server[1004]: 2026/09/20 08:09:03 INFO Signed narinfos id=67 count=16183worker2 # [ 172.428590] nix-grpc-daemon[1746]: time=2026-09-20T08:09:03.887Z level=INFO msg="Uploading 1 narinfos"6184lb # [ 172.407199] niks3-server[1004]: 2026/09/20 08:09:03 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6185lb # [ 172.418785] niks3-server[1004]: 2026/09/20 08:09:03 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6186lb # [ 172.425572] niks3-server[1004]: 2026/09/20 08:09:03 INFO Completed upload id=676187worker2 # [ 172.452476] nix-grpc-daemon[1746]: time=2026-09-20T08:09:03.912Z level=INFO msg="Upload complete. (333ms)"6188lb # [ 172.428897] niks3-server[1004]: 2026/09/20 08:09:03 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6189worker2 # [ 172.465211] nix-grpc-daemon[1690]: ts=2026-09-20T08:09:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35524 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16190worker2 # [ 172.483631] nix-daemon[835]: reaped child process 1837, status = succeeded6191client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&2, in 6.84 seconds)6192client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath6193client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath, in 0.24 seconds)6194worker1: must succeed: rm /nix/.rw-store/fill6195worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6196worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6197worker1 # [ 173.458203] nix-grpc-daemon[1487]: ts=2026-09-20T08:09:04Z level=info event=healthy reason=min_free6198worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.13 seconds)6199(finished: subtest: low disk drains a worker and builds go to the other, in 9.65 seconds)6200(finished: run the VM test script, in 175.47 seconds)6201test script finished in 175.77s6202cleanup6203kill QemuMachine (pid 50)6204client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6205kill QemuMachine (pid 49)6206lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6207kill QemuMachine (pid 51)6208worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6209kill QemuMachine (pid 52)6210worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6211(finished: cleanup, in 1.28 seconds)6212additionally exposed symbols:6213 client, lb, worker1, worker2,6214 vlan1,6215 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh