nixbot

builds

succeeded vm-test-run-nix-grpc-farm checks.aarch64-linux.farm · build #282 · raw

1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13lb # Formatting '/build/vm-state-lb/tmp.ghotXydEER', fmt=raw size=107374182414lb # mke2fs 1.47.4 (6-Mar-2025)15lb: QEMU running (pid 49)16lb # Discarding device blocks: 0/262144 done17worker1 # Disk image does not exist, creating the virtualisation disk image...18client # Disk image does not exist, creating the virtualisation disk image...19worker2 # Disk image does not exist, creating the virtualisation disk image...20worker2: QEMU running (pid 52)21worker1 # Formatting '/build/vm-state-worker1/tmp.u0075zUrsG', fmt=raw size=107374182422client # Formatting '/build/vm-state-client/tmp.VQeXtjrFMP', fmt=raw size=107374182423worker2 # Formatting '/build/vm-state-worker2/tmp.EHR1zwKypA', fmt=raw size=107374182424lb # Creating filesystem with 262144 4k blocks and 65536 inodes25client: QEMU running (pid 50)26worker1: QEMU running (pid 51)27worker1 # mke2fs 1.47.4 (6-Mar-2025)28client # mke2fs 1.47.4 (6-Mar-2025)29lb # Filesystem UUID: 9a7d33cb-18f2-414b-89aa-03e28df7bb4130worker2 # mke2fs 1.47.4 (6-Mar-2025)31worker1 # Discarding device blocks: 0/262144 done32lb # Superblock backups stored on blocks:33worker2 # Discarding device blocks: 0/262144 done34worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes35lb # 32768, 98304, 163840, 22937636worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes37worker1 # Filesystem UUID: ab786f33-2a3a-43a2-bde3-20e2c759720f38lb # 39worker2 # Filesystem UUID: 8d07ccb2-4d6c-4ccb-990c-ef1c4533358e40worker1 # Superblock backups stored on blocks:41lb # Allocating group tables: 0/8 done42worker2 # Superblock backups stored on blocks:43worker1 # 32768, 98304, 163840, 22937644lb # Writing inode tables: 0/8 done45worker2 # 32768, 98304, 163840, 22937646worker1 # 47lb # Creating journal (8192 blocks): done48worker2 # 49worker1 # Allocating group tables: 0/8 done50lb # Writing superblocks and filesystem accounting information: 0/8 done51worker2 # Allocating group tables: 0/8 done52worker1 # Writing inode tables: 0/8 done53lb # 54worker2 # Writing inode tables: 0/8 done55worker1 # Creating journal (8192 blocks): done56lb # Virtualisation disk image created.57worker2 # Creating journal (8192 blocks): done58worker1 # Writing superblocks and filesystem accounting information: 0/8 done59(finished: start all VMs, in 0.45 seconds)60client # Discarding device blocks: 0/262144 done61worker2 # Writing superblocks and filesystem accounting information: 0/8 done62worker1 # 63client: waiting for unit network-addresses-eth1.service64client # Creating filesystem with 262144 4k blocks and 65536 inodes65worker2 # 66worker1 # Virtualisation disk image created.67client: waiting for the VM to finish booting68client # Filesystem UUID: 4fdcd810-d708-4a81-a787-4e4edda4767b69worker2 # Virtualisation disk image created.70client # Superblock backups stored on blocks:71client # 32768, 98304, 163840, 22937672client # 73client # Allocating group tables: 0/8 done74client # Writing inode tables: 0/8 done75client # Creating journal (8192 blocks): done76client # Writing superblocks and filesystem accounting information: 0/8 done77client # 78client # Virtualisation disk image created.79lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681lb # [ 0.000000] KASLR enabled82lb # [ 0.000000] random: crng init done83lb # [ 0.000000] Machine model: linux,dummy-virt84lb # [ 0.000000] efi: UEFI not found.85lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88lb # [ 0.000000] Zone ranges:89lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90lb # [ 0.000000] DMA32 empty91lb # [ 0.000000] Normal empty92lb # [ 0.000000] Device empty93lb # [ 0.000000] Movable zone start for each node94lb # [ 0.000000] Early memory node ranges95lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098lb # [ 0.000000] psci: probing for conduit method from DT.99lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.100lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101lb # [ 0.000000] psci: Trusted OS migration not required102lb # [ 0.000000] psci: SMC Calling Convention v1.1103lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105lb # [ 0.000000] Detected PIPT I-cache on CPU0106lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107lb # [ 0.000000] CPU features: detected: GICv3 CPU interface108lb # [ 0.000000] CPU features: detected: Spectre-v4109lb # [ 0.000000] CPU features: detected: Spectre-BHB110lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112lb # [ 0.000000] alternatives: applying boot alternatives113lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1y76sp58sczakc84qnb2p7nq6lq4cpg2-nixos-system-lb-test/init regInfo=/nix/store/yf668d8xpf1l4919kivs4ak64gjacscd-closure-info/registration console=ttyAMA0,115200n8 console=tty0114lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/yf668d8xpf1l4919kivs4ak64gjacscd-closure-info/registration", will be passed to user space.115lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119lb # [ 0.000000] software IO TLB: area num 1.120lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122lb # [ 0.000000] Fallback order for Node 0: 0123lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216124lb # [ 0.000000] Policy zone: DMA125lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off126lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1127lb # [ 0.000000] allocated 3145728 bytes of page_ext128lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages129lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups130lb # [ 0.000000] rcu: Hierarchical RCU implementation.131lb # [ 0.000000] rcu: RCU event tracing is enabled.132lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.133lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.134lb # [ 0.000000] Rude variant of Tasks RCU enabled.135lb # [ 0.000000] Tracing variant of Tasks RCU enabled.136lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.137lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1138worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]139lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.140lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.141worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026142worker1 # [ 0.000000] KASLR enabled143worker1 # [ 0.000000] random: crng init done144lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.145worker1 # [ 0.000000] Machine model: linux,dummy-virt146lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0147worker1 # [ 0.000000] efi: UEFI not found.148lb # [ 0.000000] GICv3: 256 SPIs implemented149lb # [ 0.000000] GICv3: 0 Extended SPIs implemented150worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT151lb # [ 0.000000] Root IRQ handler: gic_handle_irq152worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]153lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI154worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]155lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0156worker1 # [ 0.000000] Zone ranges:157lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000158worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]159lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]160worker1 # [ 0.000000] DMA32 empty161worker1 # [ 0.000000] Normal empty162worker1 # [ 0.000000] Device empty163lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)164worker1 # [ 0.000000] Movable zone start for each node165worker1 # [ 0.000000] Early memory node ranges166lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)167worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]168client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]169lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000170worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]171worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]172lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000173worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000174client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026175worker1 # [ 0.000000] psci: probing for conduit method from DT.176lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.177worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026178client # [ 0.000000] KASLR enabled179worker2 # [ 0.000000] KASLR enabled180worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.181client # [ 0.000000] random: crng init done182worker2 # [ 0.000000] random: crng init done183worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs184client # [ 0.000000] Machine model: linux,dummy-virt185lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns186worker2 # [ 0.000000] Machine model: linux,dummy-virt187client # [ 0.000000] efi: UEFI not found.188worker1 # [ 0.000000] psci: Trusted OS migration not required189worker2 # [ 0.000000] efi: UEFI not found.190lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).191worker1 # [ 0.000000] psci: SMC Calling Convention v1.1192client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT193worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT194worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)195lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns196client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]197worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]198worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296199client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]200lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns201worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]202client # [ 0.000000] Zone ranges:203worker1 # [ 0.000000] Detected PIPT I-cache on CPU0204worker2 # [ 0.000000] Zone ranges:205lb # [ 0.000035] arm-pv: using stolen time PV206client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]207worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]208client # [ 0.000000] DMA32 empty209worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)210worker2 # [ 0.000000] DMA32 empty211lb # [ 0.000664] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)212client # [ 0.000000] Normal empty213worker2 # [ 0.000000] Normal empty214worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface215client # [ 0.000000] Device empty216worker2 # [ 0.000000] Device empty217lb # [ 0.000815] Console: colour dummy device 80x25218worker1 # [ 0.000000] CPU features: detected: Spectre-v4219client # [ 0.000000] Movable zone start for each node220worker2 # [ 0.000000] Movable zone start for each node221lb # [ 0.000823] printk: legacy console [tty0] enabled222client # [ 0.000000] Early memory node ranges223worker1 # [ 0.000000] CPU features: detected: Spectre-BHB224worker2 # [ 0.000000] Early memory node ranges225worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38226worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]227client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]228lb # [ 0.001021] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)229lb # [ 0.001028] pid_max: default: 32768 minimum: 301230worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23231client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]232worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]233client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000234lb # [ 0.001113] LSM: initializing lsm=capability,landlock,yama,bpf,ima235worker1 # [ 0.000000] alternatives: applying boot alternatives236worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000237lb # [ 0.001290] landlock: Up and running.238client # [ 0.000000] psci: probing for conduit method from DT.239worker2 # [ 0.000000] psci: probing for conduit method from DT.240lb # [ 0.001292] Yama: becoming mindful.241client # [ 0.000000] psci: PSCIv1.3 detected in firmware.242worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.243lb # [ 0.001917] LSM support for eBPF active244client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs245worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs246lb # [ 0.002072] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)247client # [ 0.000000] psci: Trusted OS migration not required248worker2 # [ 0.000000] psci: Trusted OS migration not required249client # [ 0.000000] psci: SMC Calling Convention v1.1250worker2 # [ 0.000000] psci: SMC Calling Convention v1.1251lb # [ 0.002109] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)252worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/j8hg5v2mna41b2rmqffhgiw2p9n7fx0y-nixos-system-worker1-test/init regInfo=/nix/store/jsp8jrhhk8b4cd1nrwsv3w1mv7c8x67x-closure-info/registration console=ttyAMA0,115200n8 console=tty0253lb # [ 0.003600] cacheinfo: Unable to detect cache hierarchy for CPU 0254client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)255worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)256lb # [ 0.004315] rcu: Hierarchical SRCU implementation.257client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296258worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296259lb # [ 0.004319] rcu: Max phase no-delay instances is 1000.260client # [ 0.000000] Detected PIPT I-cache on CPU0261worker2 # [ 0.000000] Detected PIPT I-cache on CPU0262worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/jsp8jrhhk8b4cd1nrwsv3w1mv7c8x67x-closure-info/registration", will be passed to user space.263lb # [ 0.005485] fsl-mc MSI: its@8080000 domain created264lb # [ 0.005583] EFI services will not be available.265client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)266worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)267lb # [ 0.005691] smp: Bringing up secondary CPUs ...268client # [ 0.000000] CPU features: detected: GICv3 CPU interface269worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes270worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface271lb # [ 0.005700] smp: Brought up 1 node, 1 CPU272client # [ 0.000000] CPU features: detected: Spectre-v4273worker2 # [ 0.000000] CPU features: detected: Spectre-v4274lb # [ 0.005703] SMP: Total of 1 processors activated.275worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)276client # [ 0.000000] CPU features: detected: Spectre-BHB277worker2 # [ 0.000000] CPU features: detected: Spectre-BHB278lb # [ 0.005708] CPU: All CPU(s) started at EL1279client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38280worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38281worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)282lb # [ 0.005719] CPU features: detected: Branch Target Identification283client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23284worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23285worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB286lb # [ 0.005725] CPU features: detected: ARMv8.4 Translation Table Level287worker2 # [ 0.000000] alternatives: applying boot alternatives288worker1 # [ 0.000000] software IO TLB: area num 1.289client # [ 0.000000] alternatives: applying boot alternatives290lb # [ 0.005728] CPU features: detected: Instruction cache invalidation not required for I/D coherence291worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB292lb # [ 0.005731] CPU features: detected: Data cache clean to the PoU not required for I/D coherence293worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)294worker1 # [ 0.000000] Fallback order for Node 0: 0295lb # [ 0.005735] CPU features: detected: Common not Private translations296worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216297lb # [ 0.005738] CPU features: detected: CRC32 instructions298worker1 # [ 0.000000] Policy zone: DMA299client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test/init regInfo=/nix/store/bs9wr4dhg08lmmqzzj6b672rzvy73rhp-closure-info/registration console=ttyAMA0,115200n8 console=tty0300lb # [ 0.005741] CPU features: detected: Data cache clean to Point of Deep Persistence301worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1d3l1q1rzfvh0f7kbcwmr9fszyp0b0dz-nixos-system-worker2-test/init regInfo=/nix/store/ff87zia02lc2pva4ypygaxx75p990h0m-closure-info/registration console=ttyAMA0,115200n8 console=tty0302worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off303lb # [ 0.005745] CPU features: detected: Data cache clean to Point of Persistence304worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1305worker1 # [ 0.000000] allocated 3145728 bytes of page_ext306lb # [ 0.005748] CPU features: detected: Data independent timing control (DIT)307worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/ff87zia02lc2pva4ypygaxx75p990h0m-closure-info/registration", will be passed to user space.308client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/bs9wr4dhg08lmmqzzj6b672rzvy73rhp-closure-info/registration", will be passed to user space.309lb # [ 0.005751] CPU features: detected: E0PD310worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages311worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes312client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes313worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups314lb # [ 0.005754] CPU features: detected: Enhanced Counter Virtualization315worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.316client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)317worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)318lb # [ 0.005756] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)319worker1 # [ 0.000000] rcu: RCU event tracing is enabled.320client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)321lb # [ 0.005760] CPU features: detected: Enhanced Virtualization Traps322worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)323worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.324lb # [ 0.005763] CPU features: detected: Fine Grained Traps325worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB326client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB327worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.328client # [ 0.000000] software IO TLB: area num 1.329worker2 # [ 0.000000] software IO TLB: area num 1.330worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.331lb # [ 0.005766] CPU features: detected: Generic authentication (architected QARMA5 algorithm)332client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB333worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB334worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.335lb # [ 0.005771] CPU features: detected: RCpc load-acquire (LDAPR)336lb # [ 0.005773] CPU features: detected: LSE atomic instructions337worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.338client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)339worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)340worker2 # [ 0.000000] Fallback order for Node 0: 0341client # [ 0.000000] Fallback order for Node 0: 0342lb # [ 0.005776] CPU features: detected: Privileged Access Never343worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1344lb # [ 0.005779] CPU features: detected: PMUv3345client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216346worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216347worker2 # [ 0.000000] Policy zone: DMA348client # [ 0.000000] Policy zone: DMA349lb # [ 0.005782] CPU features: detected: RAS Extension Support350worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.351lb # [ 0.005784] CPU features: detected: RASv1p1 Extension Support352client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off353worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off354worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.355lb # [ 0.005787] CPU features: detected: Random Number Generator356worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1357client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1358worker2 # [ 0.000000] allocated 3145728 bytes of page_ext359client # [ 0.000000] allocated 3145728 bytes of page_ext360worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.361worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages362client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages363lb # [ 0.005789] CPU features: detected: Speculation barrier (SB)364worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0365client # [ 0.000000] ftrace: allocated 294 pages with 4 groups366worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups367lb # [ 0.005792] CPU features: detected: Stage-2 Force Write-Back368worker1 # [ 0.000000] GICv3: 256 SPIs implemented369worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.370client # [ 0.000000] rcu: Hierarchical RCU implementation.371worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented372lb # [ 0.005794] CPU features: detected: TLB range maintenance instructions373worker2 # [ 0.000000] rcu: RCU event tracing is enabled.374client # [ 0.000000] rcu: RCU event tracing is enabled.375worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq376lb # [ 0.005799] CPU features: detected: Speculative Store Bypassing Safe (SSBS)377worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI378worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.379client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.380worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0381lb # [ 0.005841] alternatives: applying system-wide alternatives382worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.383client # [ 0.000000] Trampoline variant of Tasks RCU enabled.384worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000385client # [ 0.000000] Rude variant of Tasks RCU enabled.386lb # [ 0.008864] CPU features: detected: BBM Level 2 without TLB conflict abort387worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.388worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]389client # [ 0.000000] Tracing variant of Tasks RCU enabled.390worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.391client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.392worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.393worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)394lb # [ 0.009065] Memory: 1406792K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)395lb # [ 0.009461] devtmpfs: initialized396worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1397client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1398worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)399lb # [ 0.011330] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)400worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.401client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.402worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000403lb # [ 0.011351] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).404worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.405client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.406worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000407lb # [ 0.011536] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL408worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.409lb # [ 0.011541] 0 pages in range for non-PLT usage410worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.411client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.412lb # [ 0.011542] 508288 pages in range for PLT usage413worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0414client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0415worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns416lb # [ 0.011663] pinctrl core: initialized pinctrl subsystem417worker2 # [ 0.000000] GICv3: 256 SPIs implemented418client # [ 0.000000] GICv3: 256 SPIs implemented419lb # [ 0.012449] DMI not present or invalid.420worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).421client # [ 0.000000] GICv3: 0 Extended SPIs implemented422worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented423lb # [ 0.016219] NET: Registered PF_NETLINK/PF_ROUTE protocol family424client # [ 0.000000] Root IRQ handler: gic_handle_irq425worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq426worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI427client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI428worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns429lb # [ 0.018409] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations430client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0431worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0432lb # [ 0.018592] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations433worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns434worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000435client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000436worker1 # [ 0.000031] arm-pv: using stolen time PV437worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]438client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]439lb # [ 0.018791] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations440lb # [ 0.018813] audit: initializing netlink subsys (disabled)441worker1 # [ 0.000527] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)442worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)443client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)444lb # [ 0.019416] thermal_sys: Registered thermal governor 'fair_share'445worker1 # [ 0.000687] Console: colour dummy device 80x25446worker1 # [ 0.000695] printk: legacy console [tty0] enabled447lb # [ 0.019418] thermal_sys: Registered thermal governor 'bang_bang'448worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)449client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)450lb # [ 0.019422] thermal_sys: Registered thermal governor 'step_wise'451worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000452client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000453worker1 # [ 0.000890] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)454lb # [ 0.019428] thermal_sys: Registered thermal governor 'user_space'455worker1 # [ 0.000897] pid_max: default: 32768 minimum: 301456worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000457client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000458lb # [ 0.019431] thermal_sys: Registered thermal governor 'power_allocator'459worker1 # [ 0.000973] LSM: initializing lsm=capability,landlock,yama,bpf,ima460worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.461client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.462worker1 # [ 0.001127] landlock: Up and running.463lb # [ 0.019457] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1464worker1 # [ 0.001130] Yama: becoming mindful.465lb # [ 0.019465] cpuidle: using governor ladder466worker1 # [ 0.001647] LSM support for eBPF active467client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns468worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns469lb # [ 0.019471] cpuidle: using governor menu470worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).471client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).472worker1 # [ 0.001761] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)473lb # [ 0.019663] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.474worker1 # [ 0.001793] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)475lb # [ 0.019678] ASID allocator initialised with 65536 entries476worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns477client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns478lb # [ 0.020927] Serial: AMBA PL011 UART driver479worker1 # [ 0.002834] cacheinfo: Unable to detect cache hierarchy for CPU 0480worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns481client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns482worker1 # [ 0.003570] rcu: Hierarchical SRCU implementation.483lb # [ 0.026295] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1484worker2 # [ 0.000031] arm-pv: using stolen time PV485client # [ 0.000029] arm-pv: using stolen time PV486worker1 # [ 0.003574] rcu: Max phase no-delay instances is 1000.487lb # [ 0.026430] printk: console [ttyAMA0] enabled488worker1 # [ 0.004780] fsl-mc MSI: its@8080000 domain created489worker2 # [ 0.000414] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)490client # [ 0.000384] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)491worker1 # [ 0.004865] EFI services will not be available.492worker2 # [ 0.000586] Console: colour dummy device 80x25493client # [ 0.000518] Console: colour dummy device 80x25494worker1 # [ 0.004933] smp: Bringing up secondary CPUs ...495worker2 # [ 0.000593] printk: legacy console [tty0] enabled496worker1 # [ 0.004941] smp: Brought up 1 node, 1 CPU497client # [ 0.000526] printk: legacy console [tty0] enabled498worker1 # [ 0.004944] SMP: Total of 1 processors activated.499worker1 # [ 0.004949] CPU: All CPU(s) started at EL1500worker2 # [ 0.000788] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)501client # [ 0.000718] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)502worker2 # [ 0.000796] pid_max: default: 32768 minimum: 301503worker1 # [ 0.004959] CPU features: detected: Branch Target Identification504client # [ 0.000725] pid_max: default: 32768 minimum: 301505worker2 # [ 0.000863] LSM: initializing lsm=capability,landlock,yama,bpf,ima506worker1 # [ 0.004964] CPU features: detected: ARMv8.4 Translation Table Level507client # [ 0.000791] LSM: initializing lsm=capability,landlock,yama,bpf,ima508worker2 # [ 0.001003] landlock: Up and running.509client # [ 0.000919] landlock: Up and running.510worker2 # [ 0.001005] Yama: becoming mindful.511client # [ 0.000921] Yama: becoming mindful.512worker1 # [ 0.004967] CPU features: detected: Instruction cache invalidation not required for I/D coherence513worker2 # [ 0.001474] LSM support for eBPF active514client # [ 0.001369] LSM support for eBPF active515worker2 # [ 0.001598] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)516worker1 # [ 0.004971] CPU features: detected: Data cache clean to the PoU not required for I/D coherence517client # [ 0.001505] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)518worker1 # [ 0.004974] CPU features: detected: Common not Private translations519worker2 # [ 0.001629] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)520lb # [ 0.144459] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages521client # [ 0.001543] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)522worker1 # [ 0.004978] CPU features: detected: CRC32 instructions523worker2 # [ 0.002687] cacheinfo: Unable to detect cache hierarchy for CPU 0524lb # [ 0.144478] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page525client # [ 0.002627] cacheinfo: Unable to detect cache hierarchy for CPU 0526worker2 # [ 0.003388] rcu: Hierarchical SRCU implementation.527worker1 # [ 0.004980] CPU features: detected: Data cache clean to Point of Deep Persistence528client # [ 0.003353] rcu: Hierarchical SRCU implementation.529lb # [ 0.144483] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages530worker2 # [ 0.003392] rcu: Max phase no-delay instances is 1000.531client # [ 0.003358] rcu: Max phase no-delay instances is 1000.532worker1 # [ 0.004984] CPU features: detected: Data cache clean to Point of Persistence533lb # [ 0.144487] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page534worker2 # [ 0.004585] fsl-mc MSI: its@8080000 domain created535client # [ 0.004557] fsl-mc MSI: its@8080000 domain created536worker2 # [ 0.004674] EFI services will not be available.537worker1 # [ 0.004987] CPU features: detected: Data independent timing control (DIT)538lb # [ 0.144491] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages539client # [ 0.004648] EFI services will not be available.540worker2 # [ 0.004798] smp: Bringing up secondary CPUs ...541worker1 # [ 0.004990] CPU features: detected: E0PD542client # [ 0.004727] smp: Bringing up secondary CPUs ...543lb # [ 0.144495] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page544worker2 # [ 0.004806] smp: Brought up 1 node, 1 CPU545client # [ 0.004735] smp: Brought up 1 node, 1 CPU546worker1 # [ 0.004993] CPU features: detected: Enhanced Counter Virtualization547worker2 # [ 0.004809] SMP: Total of 1 processors activated.548lb # [ 0.144499] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages549client # [ 0.004738] SMP: Total of 1 processors activated.550worker2 # [ 0.004814] CPU: All CPU(s) started at EL1551worker1 # [ 0.004995] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)552client # [ 0.004743] CPU: All CPU(s) started at EL1553lb # [ 0.144504] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page554worker2 # [ 0.004825] CPU features: detected: Branch Target Identification555worker1 # [ 0.004999] CPU features: detected: Enhanced Virtualization Traps556client # [ 0.004753] CPU features: detected: Branch Target Identification557worker2 # [ 0.004830] CPU features: detected: ARMv8.4 Translation Table Level558worker1 # [ 0.005002] CPU features: detected: Fine Grained Traps559client # [ 0.004758] CPU features: detected: ARMv8.4 Translation Table Level560worker1 # [ 0.005005] CPU features: detected: Generic authentication (architected QARMA5 algorithm)561worker2 # [ 0.004833] CPU features: detected: Instruction cache invalidation not required for I/D coherence562lb # [ 0.151615] fbcon: Taking over console563client # [ 0.004761] CPU features: detected: Instruction cache invalidation not required for I/D coherence564lb # [ 0.151632] ACPI: Interpreter disabled.565worker1 # [ 0.005010] CPU features: detected: RCpc load-acquire (LDAPR)566worker2 # [ 0.004837] CPU features: detected: Data cache clean to the PoU not required for I/D coherence567client # [ 0.004765] CPU features: detected: Data cache clean to the PoU not required for I/D coherence568worker1 # [ 0.005013] CPU features: detected: LSE atomic instructions569worker2 # [ 0.004840] CPU features: detected: Common not Private translations570worker1 # [ 0.005016] CPU features: detected: Privileged Access Never571client # [ 0.004768] CPU features: detected: Common not Private translations572worker1 # [ 0.005019] CPU features: detected: PMUv3573worker2 # [ 0.004844] CPU features: detected: CRC32 instructions574client # [ 0.004771] CPU features: detected: CRC32 instructions575worker1 # [ 0.005022] CPU features: detected: RAS Extension Support576worker2 # [ 0.004846] CPU features: detected: Data cache clean to Point of Deep Persistence577client # [ 0.004774] CPU features: detected: Data cache clean to Point of Deep Persistence578worker1 # [ 0.005024] CPU features: detected: RASv1p1 Extension Support579worker2 # [ 0.004850] CPU features: detected: Data cache clean to Point of Persistence580client # [ 0.004778] CPU features: detected: Data cache clean to Point of Persistence581worker1 # [ 0.005027] CPU features: detected: Random Number Generator582worker2 # [ 0.004853] CPU features: detected: Data independent timing control (DIT)583client # [ 0.004781] CPU features: detected: Data independent timing control (DIT)584worker1 # [ 0.005030] CPU features: detected: Speculation barrier (SB)585worker2 # [ 0.004857] CPU features: detected: E0PD586client # [ 0.004784] CPU features: detected: E0PD587worker1 # [ 0.005032] CPU features: detected: Stage-2 Force Write-Back588worker2 # [ 0.004859] CPU features: detected: Enhanced Counter Virtualization589client # [ 0.004786] CPU features: detected: Enhanced Counter Virtualization590worker1 # [ 0.005035] CPU features: detected: TLB range maintenance instructions591worker2 # [ 0.004862] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)592client # [ 0.004789] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)593worker1 # [ 0.005040] CPU features: detected: Speculative Store Bypassing Safe (SSBS)594worker2 # [ 0.004865] CPU features: detected: Enhanced Virtualization Traps595client # [ 0.004793] CPU features: detected: Enhanced Virtualization Traps596worker1 # [ 0.005077] alternatives: applying system-wide alternatives597worker2 # [ 0.004868] CPU features: detected: Fine Grained Traps598client # [ 0.004796] CPU features: detected: Fine Grained Traps599worker1 # [ 0.007986] CPU features: detected: BBM Level 2 without TLB conflict abort600lb # [ 0.160617] iommu: Default domain type: Translated601worker2 # [ 0.004872] CPU features: detected: Generic authentication (architected QARMA5 algorithm)602client # [ 0.004799] CPU features: detected: Generic authentication (architected QARMA5 algorithm)603lb # [ 0.160627] iommu: DMA domain TLB invalidation policy: strict mode604worker2 # [ 0.004877] CPU features: detected: RCpc load-acquire (LDAPR)605lb # [ 0.160982] SCSI subsystem initialized606client # [ 0.004804] CPU features: detected: RCpc load-acquire (LDAPR)607worker2 # [ 0.004880] CPU features: detected: LSE atomic instructions608worker1 # [ 0.008130] Memory: 1406504K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)609client # [ 0.004807] CPU features: detected: LSE atomic instructions610worker1 # [ 0.008487] devtmpfs: initialized611worker2 # [ 0.004883] CPU features: detected: Privileged Access Never612client # [ 0.004810] CPU features: detected: Privileged Access Never613lb # [ 0.162910] usbcore: registered new interface driver usbfs614worker2 # [ 0.004886] CPU features: detected: PMUv3615worker1 # [ 0.010214] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)616client # [ 0.004813] CPU features: detected: PMUv3617lb # [ 0.162942] usbcore: registered new interface driver hub618worker2 # [ 0.004888] CPU features: detected: RAS Extension Support619client # [ 0.004815] CPU features: detected: RAS Extension Support620lb # [ 0.162960] usbcore: registered new device driver usb621worker1 # [ 0.010241] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).622worker2 # [ 0.004891] CPU features: detected: RASv1p1 Extension Support623client # [ 0.004818] CPU features: detected: RASv1p1 Extension Support624lb # [ 0.163257] pps_core: LinuxPPS API ver. 1 registered625worker1 # [ 0.010426] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL626worker2 # [ 0.004893] CPU features: detected: Random Number Generator627client # [ 0.004821] CPU features: detected: Random Number Generator628lb # [ 0.163263] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>629worker2 # [ 0.004896] CPU features: detected: Speculation barrier (SB)630client # [ 0.004823] CPU features: detected: Speculation barrier (SB)631lb # [ 0.163280] PTP clock support registered632worker2 # [ 0.004899] CPU features: detected: Stage-2 Force Write-Back633lb # [ 0.163333] EDAC MC: Ver: 3.0.0634client # [ 0.004826] CPU features: detected: Stage-2 Force Write-Back635worker2 # [ 0.004902] CPU features: detected: TLB range maintenance instructions636lb # [ 0.167723] scmi_core: SCMI protocol bus registered637client # [ 0.004829] CPU features: detected: TLB range maintenance instructions638worker2 # [ 0.004906] CPU features: detected: Speculative Store Bypassing Safe (SSBS)639client # [ 0.004834] CPU features: detected: Speculative Store Bypassing Safe (SSBS)640lb # [ 0.168692] FPGA manager framework641worker2 # [ 0.004945] alternatives: applying system-wide alternatives642lb # [ 0.169660] vgaarb: loaded643client # [ 0.004871] alternatives: applying system-wide alternatives644worker2 # [ 0.007899] CPU features: detected: BBM Level 2 without TLB conflict abort645client # [ 0.007792] CPU features: detected: BBM Level 2 without TLB conflict abort646lb # [ 0.170285] clocksource: Switched to clocksource arch_sys_counter647worker2 # [ 0.008095] Memory: 1406516K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)648worker2 # [ 0.008448] devtmpfs: initialized649client # [ 0.007918] Memory: 1406536K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)650client # [ 0.008275] devtmpfs: initialized651worker2 # [ 0.010197] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)652client # [ 0.010060] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)653lb # [ 0.173462] VFS: Disk quotas dquot_6.6.0654worker2 # [ 0.010218] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).655worker1 # [ 0.010431] 0 pages in range for non-PLT usage656lb # [ 0.173497] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)657client # [ 0.010082] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).658worker1 # [ 0.010432] 508288 pages in range for PLT usage659worker2 # [ 0.010407] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL660client # [ 0.010269] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL661worker2 # [ 0.010412] 0 pages in range for non-PLT usage662worker1 # [ 0.010521] pinctrl core: initialized pinctrl subsystem663client # [ 0.010274] 0 pages in range for non-PLT usage664worker2 # [ 0.010413] 508288 pages in range for PLT usage665worker1 # [ 0.011273] DMI not present or invalid.666client # [ 0.010275] 508288 pages in range for PLT usage667worker2 # [ 0.010508] pinctrl core: initialized pinctrl subsystem668worker1 # [ 0.014528] NET: Registered PF_NETLINK/PF_ROUTE protocol family669client # [ 0.010384] pinctrl core: initialized pinctrl subsystem670worker2 # [ 0.011298] DMI not present or invalid.671lb # [ 0.177051] netfs: FS-Cache loaded672worker1 # [ 0.016699] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations673client # [ 0.011094] DMI not present or invalid.674lb # [ 0.177187] pnp: PnP ACPI: disabled675worker2 # [ 0.014291] NET: Registered PF_NETLINK/PF_ROUTE protocol family676client # [ 0.014306] NET: Registered PF_NETLINK/PF_ROUTE protocol family677worker1 # [ 0.016893] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations678worker2 # [ 0.016515] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations679worker1 # [ 0.017100] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations680worker2 # [ 0.016706] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations681client # [ 0.016482] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations682worker1 # [ 0.017121] audit: initializing netlink subsys (disabled)683worker2 # [ 0.016903] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations684worker1 # [ 0.017653] thermal_sys: Registered thermal governor 'fair_share'685client # [ 0.016666] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations686worker2 # [ 0.016924] audit: initializing netlink subsys (disabled)687worker1 # [ 0.017655] thermal_sys: Registered thermal governor 'bang_bang'688client # [ 0.016861] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations689worker2 # [ 0.017427] thermal_sys: Registered thermal governor 'fair_share'690worker1 # [ 0.017659] thermal_sys: Registered thermal governor 'step_wise'691client # [ 0.016883] audit: initializing netlink subsys (disabled)692worker2 # [ 0.017429] thermal_sys: Registered thermal governor 'bang_bang'693lb # [ 0.180959] NET: Registered PF_INET protocol family694worker1 # [ 0.017664] thermal_sys: Registered thermal governor 'user_space'695client # [ 0.017418] thermal_sys: Registered thermal governor 'fair_share'696worker2 # [ 0.017432] thermal_sys: Registered thermal governor 'step_wise'697lb # [ 0.181212] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)698worker1 # [ 0.017667] thermal_sys: Registered thermal governor 'power_allocator'699client # [ 0.017420] thermal_sys: Registered thermal governor 'bang_bang'700worker2 # [ 0.017437] thermal_sys: Registered thermal governor 'user_space'701client # [ 0.017424] thermal_sys: Registered thermal governor 'step_wise'702worker1 # [ 0.017691] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1703worker2 # [ 0.017440] thermal_sys: Registered thermal governor 'power_allocator'704worker1 # [ 0.017699] cpuidle: using governor ladder705client # [ 0.017429] thermal_sys: Registered thermal governor 'user_space'706worker1 # [ 0.017705] cpuidle: using governor menu707worker2 # [ 0.017479] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1708client # [ 0.017432] thermal_sys: Registered thermal governor 'power_allocator'709worker2 # [ 0.017489] cpuidle: using governor ladder710worker1 # [ 0.017885] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.711worker2 # [ 0.017494] cpuidle: using governor menu712client # [ 0.017462] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1713worker1 # [ 0.017900] ASID allocator initialised with 65536 entries714client # [ 0.017472] cpuidle: using governor ladder715worker1 # [ 0.019069] Serial: AMBA PL011 UART driver716worker2 # [ 0.017680] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.717client # [ 0.017478] cpuidle: using governor menu718worker2 # [ 0.017695] ASID allocator initialised with 65536 entries719worker1 # [ 0.024137] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1720worker2 # [ 0.018843] Serial: AMBA PL011 UART driver721client # [ 0.017686] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.722worker1 # [ 0.024253] printk: console [ttyAMA0] enabled723client # [ 0.017702] ASID allocator initialised with 65536 entries724client # [ 0.018867] Serial: AMBA PL011 UART driver725worker1 # [ 0.144696] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages726worker2 # [ 0.023909] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1727client # [ 0.023954] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1728worker2 # [ 0.024063] printk: console [ttyAMA0] enabled729worker1 # [ 0.144716] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page730client # [ 0.024104] printk: console [ttyAMA0] enabled731worker1 # [ 0.144721] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages732worker1 # [ 0.144726] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page733worker1 # [ 0.144730] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages734worker1 # [ 0.144734] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page735worker1 # [ 0.144738] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages736worker1 # [ 0.144743] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page737worker2 # [ 0.141786] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages738worker1 # [ 0.152145] fbcon: Taking over console739worker1 # [ 0.152159] ACPI: Interpreter disabled.740worker2 # [ 0.141805] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page741worker1 # [ 0.154026] iommu: Default domain type: Translated742worker2 # [ 0.141811] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages743worker1 # [ 0.154036] iommu: DMA domain TLB invalidation policy: strict mode744worker2 # [ 0.141815] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page745client # [ 0.144789] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages746worker1 # [ 0.155750] SCSI subsystem initialized747worker2 # [ 0.141819] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages748client # [ 0.144809] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page749worker2 # [ 0.141823] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page750client # [ 0.144814] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages751worker2 # [ 0.141828] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages752client # [ 0.144819] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page753worker2 # [ 0.141832] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page754client # [ 0.144823] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages755client # [ 0.144828] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page756client # [ 0.144832] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages757worker2 # [ 0.149253] fbcon: Taking over console758client # [ 0.144836] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page759worker2 # [ 0.149267] ACPI: Interpreter disabled.760client # [ 0.152359] fbcon: Taking over console761client # [ 0.152375] ACPI: Interpreter disabled.762worker1 # [ 0.163227] usbcore: registered new interface driver usbfs763worker1 # [ 0.163259] usbcore: registered new interface driver hub764client # [ 0.154263] iommu: Default domain type: Translated765worker1 # [ 0.163276] usbcore: registered new device driver usb766client # [ 0.154274] iommu: DMA domain TLB invalidation policy: strict mode767worker1 # [ 0.163552] pps_core: LinuxPPS API ver. 1 registered768lb # [ 0.209810] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)769client # [ 0.155978] SCSI subsystem initialized770worker1 # [ 0.163558] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>771lb # [ 0.209853] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)772worker1 # [ 0.163569] PTP clock support registered773worker1 # [ 0.163616] EDAC MC: Ver: 3.0.0774lb # [ 0.209880] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)775worker1 # [ 0.168293] scmi_core: SCMI protocol bus registered776lb # [ 0.209953] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)777worker2 # [ 0.158012] iommu: Default domain type: Translated778lb # [ 0.210095] TCP: Hash tables configured (established 16384 bind 16384)779worker1 # [ 0.169238] FPGA manager framework780worker2 # [ 0.158022] iommu: DMA domain TLB invalidation policy: strict mode781worker1 # [ 0.170230] vgaarb: loaded782worker2 # [ 0.158393] SCSI subsystem initialized783lb # [ 0.210175] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)784lb # [ 0.210210] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)785worker2 # [ 0.160364] usbcore: registered new interface driver usbfs786worker1 # [ 0.170851] clocksource: Switched to clocksource arch_sys_counter787lb # [ 0.210245] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)788worker2 # [ 0.160399] usbcore: registered new interface driver hub789client # [ 0.161246] usbcore: registered new interface driver usbfs790worker1 # [ 0.171436] VFS: Disk quotas dquot_6.6.0791worker2 # [ 0.160416] usbcore: registered new device driver usb792client # [ 0.161280] usbcore: registered new interface driver hub793worker1 # [ 0.171461] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)794worker2 # [ 0.160685] pps_core: LinuxPPS API ver. 1 registered795client # [ 0.161299] usbcore: registered new device driver usb796worker1 # [ 0.173777] netfs: FS-Cache loaded797client # [ 0.161577] pps_core: LinuxPPS API ver. 1 registered798worker1 # [ 0.173892] pnp: PnP ACPI: disabled799worker2 # [ 0.160691] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>800worker2 # [ 0.160700] PTP clock support registered801client # [ 0.161582] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>802worker2 # [ 0.160749] EDAC MC: Ver: 3.0.0803client # [ 0.161592] PTP clock support registered804client # [ 0.161641] EDAC MC: Ver: 3.0.0805worker2 # [ 0.165283] scmi_core: SCMI protocol bus registered806client # [ 0.166303] scmi_core: SCMI protocol bus registered807worker2 # [ 0.166246] FPGA manager framework808worker2 # [ 0.167383] vgaarb: loaded809client # [ 0.167275] FPGA manager framework810client # [ 0.168222] vgaarb: loaded811worker2 # [ 0.168008] clocksource: Switched to clocksource arch_sys_counter812client # [ 0.168857] clocksource: Switched to clocksource arch_sys_counter813lb # [ 0.217448] NET: Registered PF_UNIX/PF_LOCAL protocol family814lb # [ 0.217496] NET: Registered PF_XDP protocol family815worker2 # [ 0.171817] VFS: Disk quotas dquot_6.6.0816lb # [ 0.217514] PCI: CLS 0 bytes, default 64817worker1 # [ 0.179738] NET: Registered PF_INET protocol family818client # [ 0.172663] VFS: Disk quotas dquot_6.6.0819worker2 # [ 0.171857] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)820lb # [ 0.217751] Trying to unpack rootfs image as initramfs...821worker1 # [ 0.180007] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)822client # [ 0.172707] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)823lb # [ 0.228707] kvm [1]: HYP mode not available824worker2 # [ 0.175437] netfs: FS-Cache loaded825worker2 # [ 0.175547] pnp: PnP ACPI: disabled826client # [ 0.176294] netfs: FS-Cache loaded827client # [ 0.176416] pnp: PnP ACPI: disabled828worker2 # [ 0.179330] NET: Registered PF_INET protocol family829client # [ 0.180385] NET: Registered PF_INET protocol family830worker2 # [ 0.179588] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)831client # [ 0.180638] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)832worker1 # [ 0.209824] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833worker1 # [ 0.209873] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834worker1 # [ 0.209900] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835worker1 # [ 0.209976] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)836worker1 # [ 0.210119] TCP: Hash tables configured (established 16384 bind 16384)837worker1 # [ 0.210201] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)838worker1 # [ 0.210248] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)839worker1 # [ 0.210284] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)840worker1 # [ 0.210391] NET: Registered PF_UNIX/PF_LOCAL protocol family841worker1 # [ 0.210419] NET: Registered PF_XDP protocol family842worker2 # [ 0.208995] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)843worker1 # [ 0.210436] PCI: CLS 0 bytes, default 64844client # [ 0.210993] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)845worker1 # [ 0.210678] Trying to unpack rootfs image as initramfs...846worker2 # [ 0.209052] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)847client # [ 0.211046] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)848worker2 # [ 0.209079] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)849client # [ 0.211076] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)850worker2 # [ 0.209153] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)851client # [ 0.211154] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)852worker2 # [ 0.209296] TCP: Hash tables configured (established 16384 bind 16384)853client # [ 0.211309] TCP: Hash tables configured (established 16384 bind 16384)854worker2 # [ 0.209382] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)855client # [ 0.211395] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)856worker2 # [ 0.209417] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)857client # [ 0.211431] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)858worker2 # [ 0.209453] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)859client # [ 0.211469] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)860worker2 # [ 0.209548] NET: Registered PF_UNIX/PF_LOCAL protocol family861client # [ 0.211557] NET: Registered PF_UNIX/PF_LOCAL protocol family862worker2 # [ 0.209621] NET: Registered PF_XDP protocol family863worker1 # [ 0.228625] kvm [1]: HYP mode not available864worker2 # [ 0.209640] PCI: CLS 0 bytes, default 64865client # [ 0.211598] NET: Registered PF_XDP protocol family866worker2 # [ 0.209880] Trying to unpack rootfs image as initramfs...867client # [ 0.211618] PCI: CLS 0 bytes, default 64868client # [ 0.211854] Trying to unpack rootfs image as initramfs...869client # [ 0.226608] kvm [1]: HYP mode not available870worker2 # [ 0.225750] kvm [1]: HYP mode not available871lb # [ 0.313784] Initialise system trusted keyrings872lb # [ 0.322369] workingset: timestamp_bits=42 max_order=19 bucket_order=0873lb # [ 0.323766] squashfs: version 4.0 (2009/01/31) Phillip Lougher874lb # [ 0.323822] 9p: Installing v9fs 9p2000 file system support875lb # [ 0.343672] Key type asymmetric registered876lb # [ 0.343694] Asymmetric key parser 'x509' registered877lb # [ 0.343755] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)878lb # [ 0.345814] io scheduler mq-deadline registered879lb # [ 0.345825] io scheduler kyber registered880lb # [ 0.359000] pl061_gpio 9030000.pl061: PL061 GPIO chip registered881lb # [ 0.360299] ledtrig-cpu: registered to indicate activity on CPUs882lb # [ 0.360681] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:883lb # [ 0.360699] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000884lb # [ 0.360710] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000885lb # [ 0.360719] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000886lb # [ 0.360739] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits887worker1 # [ 0.323391] Initialise system trusted keyrings888lb # [ 0.360760] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]889worker1 # [ 0.324135] workingset: timestamp_bits=42 max_order=19 bucket_order=0890lb # [ 0.360832] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00891lb # [ 0.360841] pci_bus 0000:00: root bus resource [bus 00-ff]892worker1 # [ 0.325381] squashfs: version 4.0 (2009/01/31) Phillip Lougher893lb # [ 0.360848] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]894lb # [ 0.360853] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]895worker1 # [ 0.326180] 9p: Installing v9fs 9p2000 file system support896lb # [ 0.360858] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]897lb # [ 0.360950] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint898lb # [ 0.361385] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint899lb # [ 0.361566] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]900lb # [ 0.361582] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]901worker2 # [ 0.320907] Initialise system trusted keyrings902lb # [ 0.361611] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]903client # [ 0.321463] Initialise system trusted keyrings904lb # [ 0.361626] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]905worker2 # [ 0.321657] workingset: timestamp_bits=42 max_order=19 bucket_order=0906client # [ 0.322194] workingset: timestamp_bits=42 max_order=19 bucket_order=0907lb # [ 0.362068] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint908worker2 # [ 0.322930] squashfs: version 4.0 (2009/01/31) Phillip Lougher909client # [ 0.323458] squashfs: version 4.0 (2009/01/31) Phillip Lougher910lb # [ 0.362245] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]911worker2 # [ 0.323717] 9p: Installing v9fs 9p2000 file system support912lb # [ 0.362261] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]913client # [ 0.324220] 9p: Installing v9fs 9p2000 file system support914lb # [ 0.380162] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]915lb # [ 0.380767] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint916lb # [ 0.380946] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]917lb # [ 0.380962] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]918lb # [ 0.380991] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]919lb # [ 0.381433] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint920lb # [ 0.381608] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]921lb # [ 0.381623] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]922lb # [ 0.381654] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]923lb # [ 0.382097] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint924lb # [ 0.382273] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]925worker1 # [ 0.346788] Key type asymmetric registered926worker1 # [ 0.346814] Asymmetric key parser 'x509' registered927lb # [ 0.394306] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]928lb # [ 0.394359] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]929client # [ 0.344813] Key type asymmetric registered930worker1 # [ 0.354943] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)931lb # [ 0.394823] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint932client # [ 0.344839] Asymmetric key parser 'x509' registered933lb # [ 0.395003] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]934worker1 # [ 0.355978] io scheduler mq-deadline registered935worker1 # [ 0.355989] io scheduler kyber registered936lb # [ 0.395019] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]937lb # [ 0.395048] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]938lb # [ 0.395486] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint939lb # [ 0.395663] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]940lb # [ 0.395678] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]941lb # [ 0.395706] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]942lb # [ 0.395721] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]943lb # [ 0.396194] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint944worker2 # [ 0.352344] Key type asymmetric registered945lb # [ 0.396376] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]946worker2 # [ 0.352373] Asymmetric key parser 'x509' registered947client # [ 0.352963] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)948lb # [ 0.396404] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]949client # [ 0.354012] io scheduler mq-deadline registered950worker2 # [ 0.352442] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)951client # [ 0.354023] io scheduler kyber registered952lb # [ 0.396845] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint953worker2 # [ 0.354523] io scheduler mq-deadline registered954lb # [ 0.397025] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]955worker2 # [ 0.354534] io scheduler kyber registered956lb # [ 0.397053] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]957lb # [ 0.397436] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint958worker1 # [ 0.366975] pl061_gpio 9030000.pl061: PL061 GPIO chip registered959lb # [ 0.397612] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]960lb # [ 0.397850] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint961lb # [ 0.398128] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]962lb # [ 0.398144] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]963worker1 # [ 0.368320] ledtrig-cpu: registered to indicate activity on CPUs964lb # [ 0.398173] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]965worker1 # [ 0.368685] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:966worker1 # [ 0.368703] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000967worker1 # [ 0.368714] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000968worker1 # [ 0.368723] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000969worker2 # [ 0.364142] pl061_gpio 9030000.pl061: PL061 GPIO chip registered970client # [ 0.364996] pl061_gpio 9030000.pl061: PL061 GPIO chip registered971worker1 # [ 0.368744] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits972worker1 # [ 0.368767] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]973worker1 # [ 0.368836] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00974worker2 # [ 0.365530] ledtrig-cpu: registered to indicate activity on CPUs975worker1 # [ 0.368845] pci_bus 0000:00: root bus resource [bus 00-ff]976client # [ 0.366377] ledtrig-cpu: registered to indicate activity on CPUs977worker2 # [ 0.365902] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:978worker1 # [ 0.368852] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]979client # [ 0.366752] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:980worker1 # [ 0.368857] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]981worker2 # [ 0.365918] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000982client # [ 0.366769] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000983worker1 # [ 0.368862] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]984worker2 # [ 0.365944] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000985worker1 # [ 0.368917] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint986client # [ 0.366781] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000987worker2 # [ 0.365953] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000988lb # [ 0.422685] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint989worker1 # [ 0.369358] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint990client # [ 0.366789] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000991lb # [ 0.422876] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]992worker2 # [ 0.365974] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits993worker1 # [ 0.369561] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]994lb # [ 0.422892] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]995client # [ 0.366810] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits996worker1 # [ 0.369578] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]997worker2 # [ 0.365998] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]998lb # [ 0.422921] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]999worker1 # [ 0.369608] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1000client # [ 0.366834] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1001worker2 # [ 0.366075] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001002lb # [ 0.423508] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1003worker1 # [ 0.369624] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1004client # [ 0.366920] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001005worker2 # [ 0.366085] pci_bus 0000:00: root bus resource [bus 00-ff]1006lb # [ 0.423519] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1007client # [ 0.366930] pci_bus 0000:00: root bus resource [bus 00-ff]1008worker2 # [ 0.366092] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1009worker1 # [ 0.370093] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1010worker1 # [ 0.370278] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1011lb # [ 0.423524] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1012client # [ 0.366936] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1013worker2 # [ 0.366097] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1014worker1 # [ 0.370293] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1015client # [ 0.366941] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1016lb # [ 0.423568] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1017worker2 # [ 0.366102] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1018worker1 # [ 0.370323] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1019client # [ 0.366946] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1020lb # [ 0.423614] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1021worker2 # [ 0.366158] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1022worker1 # [ 0.370771] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1023client # [ 0.367003] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1024lb # [ 0.423661] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1025worker2 # [ 0.366591] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1026worker1 # [ 0.390700] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1027worker2 # [ 0.366778] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1028lb # [ 0.423707] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1029client # [ 0.367721] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1030worker1 # [ 0.390719] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1031client # [ 0.367930] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1032worker2 # [ 0.366795] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1033lb # [ 0.423754] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1034worker1 # [ 0.390749] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1035client # [ 0.367948] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1036worker2 # [ 0.366825] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1037lb # [ 0.423801] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1038client # [ 0.367978] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1039worker2 # [ 0.366841] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1040client # [ 0.367995] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1041lb # [ 0.423847] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1042worker2 # [ 0.367308] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1043lb # [ 0.423893] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1044worker2 # [ 0.367492] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1045client # [ 0.368512] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1046worker1 # [ 0.393287] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1047client # [ 0.368698] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1048worker2 # [ 0.367508] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1049worker1 # [ 0.393476] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1050lb # [ 0.423939] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1051client # [ 0.368714] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1052worker2 # [ 0.367538] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1053worker1 # [ 0.393492] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1054lb # [ 0.424033] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1055client # [ 0.368745] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1056worker1 # [ 0.393530] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1057worker2 # [ 0.367988] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1058lb # [ 0.424079] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1059worker1 # [ 0.393987] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1060lb # [ 0.424100] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1061worker2 # [ 0.387569] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1062worker1 # [ 0.394172] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1063lb # [ 0.424121] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1064worker2 # [ 0.387589] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1065client # [ 0.387739] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1066worker1 # [ 0.394188] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1067lb # [ 0.424143] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1068worker2 # [ 0.387619] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1069client # [ 0.387927] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1070worker1 # [ 0.394217] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1071lb # [ 0.424167] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1072client # [ 0.387943] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1073worker1 # [ 0.394680] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1074lb # [ 0.424189] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1075client # [ 0.387973] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1076lb # [ 0.424210] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1077client # [ 0.388430] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1078lb # [ 0.424232] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1079client # [ 0.388613] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1080lb # [ 0.424253] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1081client # [ 0.388628] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1082lb # [ 0.424275] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1083client # [ 0.388662] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1084lb # [ 0.424297] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1085lb # [ 0.424319] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1086lb # [ 0.424340] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1087lb # [ 0.424360] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1088lb # [ 0.424381] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1089lb # [ 0.424402] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1090lb # [ 0.424423] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1091lb # [ 0.424444] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1092worker2 # [ 0.396126] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1093lb # [ 0.424465] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1094worker2 # [ 0.396324] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1095lb # [ 0.424487] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1096worker2 # [ 0.396340] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1097lb # [ 0.424508] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1098worker2 # [ 0.396373] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1099lb # [ 0.424534] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1100worker2 # [ 0.396850] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1101lb # [ 0.424544] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1102worker2 # [ 0.397034] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1103worker1 # [ 0.406903] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1104lb # [ 0.424549] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1105worker2 # [ 0.397050] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1106worker1 # [ 0.406927] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1107lb # [ 0.425713] pci 0000:00:0a.0: enabling device (0000 -> 0002)1108worker2 # [ 0.397080] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1109worker1 # [ 0.406956] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1110worker2 # [ 0.397560] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1111worker1 # [ 0.407436] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1112worker1 # [ 0.407626] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1113worker2 # [ 0.397744] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1114worker2 # [ 0.397760] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1115worker1 # [ 0.407642] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1116client # [ 0.401175] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1117worker2 # [ 0.397790] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1118worker1 # [ 0.407671] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1119client # [ 0.401367] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1120worker1 # [ 0.407687] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1121worker2 # [ 0.398240] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1122client # [ 0.401384] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1123worker2 # [ 0.398425] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1124worker1 # [ 0.408138] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1125client # [ 0.401414] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1126worker2 # [ 0.398440] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1127worker1 # [ 0.408326] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1128client # [ 0.401873] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1129worker2 # [ 0.398470] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1130worker1 # [ 0.408356] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1131client # [ 0.402058] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1132worker2 # [ 0.398486] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1133worker1 # [ 0.408808] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1134client # [ 0.402073] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1135worker2 # [ 0.398938] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1136worker1 # [ 0.408997] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1137client # [ 0.402104] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1138worker2 # [ 0.399131] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1139worker1 # [ 0.409027] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1140client # [ 0.402557] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1141worker2 # [ 0.399161] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1142worker1 # [ 0.409418] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1143client # [ 0.402740] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1144worker2 # [ 0.399612] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1145worker1 # [ 0.409607] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1146client # [ 0.402756] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1147worker2 # [ 0.399800] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1148worker1 # [ 0.409851] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1149client # [ 0.402785] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1150worker2 # [ 0.399830] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1151worker1 # [ 0.410121] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1152client # [ 0.402802] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1153worker1 # [ 0.410138] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1154client # [ 0.403375] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1155worker1 # [ 0.410167] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1156client # [ 0.403757] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1157worker1 # [ 0.410619] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1158client # [ 0.403793] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1159worker1 # [ 0.410803] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1160client # [ 0.404334] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1161worker1 # [ 0.410819] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1162client # [ 0.404533] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1163worker1 # [ 0.410849] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1164client # [ 0.404564] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1165worker1 # [ 0.411430] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1166client # [ 0.404995] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1167worker2 # [ 0.418684] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1168worker1 # [ 0.411442] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1169client # [ 0.405179] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1170worker2 # [ 0.418872] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1171worker1 # [ 0.411447] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1172worker2 # [ 0.419125] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1173client # [ 0.405431] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1174worker1 # [ 0.411492] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1175worker2 # [ 0.419389] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1176client # [ 0.405690] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1177worker2 # [ 0.419406] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1178client # [ 0.405707] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1179worker1 # [ 0.411539] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1180client # [ 0.405737] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1181worker2 # [ 0.419436] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1182worker1 # [ 0.411586] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1183client # [ 0.406220] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1184worker2 # [ 0.419904] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1185worker1 # [ 0.411634] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1186client # [ 0.406404] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1187worker2 # [ 0.420099] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1188worker1 # [ 0.411681] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1189client # [ 0.406420] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1190worker2 # [ 0.420115] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1191worker1 # [ 0.411728] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1192client # [ 0.406450] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1193worker2 # [ 0.420145] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1194lb # [ 0.484639] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1195client # [ 0.407031] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1196worker2 # [ 0.420718] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1197worker1 # [ 0.411776] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1198client # [ 0.407043] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1199worker2 # [ 0.420729] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1200worker1 # [ 0.411824] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1201client # [ 0.407049] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1202worker2 # [ 0.420735] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1203worker1 # [ 0.411879] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1204client # [ 0.407095] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1205worker2 # [ 0.420781] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1206worker1 # [ 0.411937] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1207client # [ 0.407142] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1208worker2 # [ 0.420830] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1209worker1 # [ 0.411985] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1210worker1 # [ 0.412006] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1211client # [ 0.407189] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1212worker2 # [ 0.420879] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1213worker1 # [ 0.412029] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1214worker2 # [ 0.420926] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1215client # [ 0.407237] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1216worker1 # [ 0.412050] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1217worker2 # [ 0.420973] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1218client # [ 0.407291] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1219worker1 # [ 0.412075] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1220worker2 # [ 0.421021] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1221client # [ 0.407339] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1222worker1 # [ 0.412096] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1223worker2 # [ 0.421068] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1224client # [ 0.407387] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1225worker1 # [ 0.412118] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1226worker2 # [ 0.421116] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1227worker1 # [ 0.412140] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1228client # [ 0.407435] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1229worker1 # [ 0.412162] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1230worker2 # [ 0.421163] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1231client # [ 0.407481] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1232worker1 # [ 0.412183] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1233worker2 # [ 0.421225] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1234client # [ 0.407545] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1235worker1 # [ 0.412206] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1236worker2 # [ 0.421271] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1237client # [ 0.407592] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1238worker1 # [ 0.412228] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1239worker2 # [ 0.421293] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1240client # [ 0.407613] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1241worker1 # [ 0.412250] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1242worker2 # [ 0.421315] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1243client # [ 0.407635] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1244worker1 # [ 0.412271] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1245worker2 # [ 0.421337] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1246client # [ 0.407657] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1247worker1 # [ 0.412293] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1248worker2 # [ 0.421362] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1249worker1 # [ 0.412315] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1250client # [ 0.407681] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1251lb # [ 0.494522] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1252worker2 # [ 0.421384] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1253worker1 # [ 0.412336] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1254client # [ 0.407703] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1255lb # [ 0.497997] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1256worker1 # [ 0.412357] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1257worker2 # [ 0.421406] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1258lb # [ 0.499999] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1259client # [ 0.407725] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1260worker1 # [ 0.412379] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1261worker2 # [ 0.421428] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1262lb # [ 0.501908] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1263client # [ 0.407747] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1264worker1 # [ 0.412401] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1265worker2 # [ 0.421450] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1266client # [ 0.407770] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1267worker1 # [ 0.412423] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1268worker2 # [ 0.421472] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1269client # [ 0.407792] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1270worker1 # [ 0.412448] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1271worker2 # [ 0.421494] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1272client # [ 0.407814] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1273worker1 # [ 0.412458] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1274worker2 # [ 0.421517] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1275client # [ 0.407837] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1276worker1 # [ 0.412462] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1277worker2 # [ 0.421538] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1278client # [ 0.407859] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1279worker1 # [ 0.413624] pci 0000:00:0a.0: enabling device (0000 -> 0002)1280worker2 # [ 0.421560] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1281client # [ 0.407880] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1282worker2 # [ 0.421581] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1283client # [ 0.407902] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1284worker2 # [ 0.421603] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1285client # [ 0.407923] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1286worker2 # [ 0.421624] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1287client # [ 0.407945] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1288worker2 # [ 0.421646] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1289client # [ 0.407967] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1290worker2 # [ 0.421668] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1291client # [ 0.407988] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1292worker2 # [ 0.421690] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1293client # [ 0.408010] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1294worker2 # [ 0.421712] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1295client # [ 0.408032] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1296lb # [ 0.512052] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1297worker2 # [ 0.421738] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1298client # [ 0.408059] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1299lb # [ 0.514254] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1300worker2 # [ 0.421747] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1301client # [ 0.408069] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1302worker2 # [ 0.421752] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1303client # [ 0.408074] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1304worker2 # [ 0.422917] pci 0000:00:0a.0: enabling device (0000 -> 0002)1305client # [ 0.469381] pci 0000:00:0a.0: enabling device (0000 -> 0002)1306lb # [ 0.525317] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1307lb # [ 0.531749] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1308worker1 # [ 0.489355] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1309lb # [ 0.533540] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1310worker2 # [ 0.486604] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1311worker1 # [ 0.495529] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1312worker1 # [ 0.497639] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1313lb # [ 0.543867] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1314client # [ 0.490621] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1315worker2 # [ 0.492606] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1316worker2 # [ 0.494568] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1317lb # [ 0.552829] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1318worker1 # [ 0.507454] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1319worker1 # [ 0.509423] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1320client # [ 0.500915] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1321client # [ 0.504352] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1322lb # [ 0.559494] msm_serial: driver initialized1323lb # [ 0.559635] SuperH (H)SCI(F) driver initialized1324lb # [ 0.559690] STM32 USART driver initialized1325worker2 # [ 0.504613] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1326worker2 # [ 0.506730] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1327worker2 # [ 0.508689] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1328worker2 # [ 0.510737] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1329worker1 # [ 0.519410] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1330client # [ 0.514155] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1331worker1 # [ 0.522324] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1332worker1 # [ 0.524349] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1333worker1 # [ 0.526397] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1334client # [ 0.518720] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1335client # [ 0.520688] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1336worker1 # [ 0.536273] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1337worker1 # [ 0.538801] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1338worker2 # [ 0.529109] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1339worker2 # [ 0.531489] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1340lb # [ 0.589244] loop: module loaded1341lb # [ 0.589423] virtio_blk virtio5: 1/0/0 default/read/poll queues1342worker2 # [ 0.534878] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1343lb # [ 0.590222] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1344client # [ 0.534482] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1345client # [ 0.536597] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1346client # [ 0.540417] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1347worker2 # [ 0.542781] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1348client # [ 0.543158] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1349worker1 # [ 0.564114] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1350lb # [ 0.602944] megasas: 07.734.00.00-rc11351lb # [ 0.603641] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1352client # [ 0.553477] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1353lb # [ 0.605630] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001354lb # [ 0.605657] Intel/Sharp Extended Query Table at 0x00311355worker2 # [ 0.557208] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1356lb # [ 0.607311] Using buffer write method1357worker2 # [ 0.559711] msm_serial: driver initialized1358worker1 # [ 0.566885] msm_serial: driver initialized1359lb # [ 0.607384] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1360worker2 # [ 0.559846] SuperH (H)SCI(F) driver initialized1361worker1 # [ 0.567025] SuperH (H)SCI(F) driver initialized1362worker2 # [ 0.559897] STM32 USART driver initialized1363worker1 # [ 0.567078] STM32 USART driver initialized1364lb # [ 0.609195] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001365lb # [ 0.609227] Intel/Sharp Extended Query Table at 0x00311366client # [ 0.562743] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1367client # [ 0.565891] msm_serial: driver initialized1368client # [ 0.566054] SuperH (H)SCI(F) driver initialized1369client # [ 0.566106] STM32 USART driver initialized1370lb # [ 0.627040] Using buffer write method1371lb # [ 0.627075] Concatenating MTD devices:1372lb # [ 0.627079] (0): "0.flash"1373lb # [ 0.627083] (1): "0.flash"1374lb # [ 0.627086] into device "0.flash"1375worker1 # [ 0.596683] loop: module loaded1376worker1 # [ 0.596870] virtio_blk virtio5: 1/0/0 default/read/poll queues1377worker1 # [ 0.597611] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1378worker2 # [ 0.592933] loop: module loaded1379worker2 # [ 0.593122] virtio_blk virtio5: 1/0/0 default/read/poll queues1380worker2 # [ 0.593865] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1381worker1 # [ 0.603457] megasas: 07.734.00.00-rc11382worker1 # [ 0.604164] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1383client # [ 0.602086] loop: module loaded1384client # [ 0.602286] virtio_blk virtio5: 1/0/0 default/read/poll queues1385client # [ 0.603069] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1386worker1 # [ 0.615482] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001387worker2 # [ 0.604644] megasas: 07.734.00.00-rc11388worker1 # [ 0.615537] Intel/Sharp Extended Query Table at 0x00311389client # [ 0.609549] megasas: 07.734.00.00-rc11390worker1 # [ 0.617109] Using buffer write method1391worker2 # [ 0.605362] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1392client # [ 0.610257] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1393worker1 # [ 0.617172] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1394worker2 # [ 0.607610] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001395worker2 # [ 0.607636] Intel/Sharp Extended Query Table at 0x00311396worker1 # [ 0.620037] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001397worker2 # [ 0.609138] Using buffer write method1398worker1 # [ 0.620062] Intel/Sharp Extended Query Table at 0x00311399worker1 # [ 0.621418] Using buffer write method1400worker2 # [ 0.609199] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1401worker1 # [ 0.621444] Concatenating MTD devices:1402worker1 # [ 0.621448] (0): "0.flash"1403worker1 # [ 0.621452] (1): "0.flash"1404worker1 # [ 0.621455] into device "0.flash"1405worker2 # [ 0.610828] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001406worker2 # [ 0.610857] Intel/Sharp Extended Query Table at 0x00311407worker2 # [ 0.624598] Using buffer write method1408worker2 # [ 0.624639] Concatenating MTD devices:1409worker2 # [ 0.624643] (0): "0.flash"1410worker2 # [ 0.624647] (1): "0.flash"1411worker2 # [ 0.624651] into device "0.flash"1412client # [ 0.620912] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001413client # [ 0.620942] Intel/Sharp Extended Query Table at 0x00311414client # [ 0.622759] Using buffer write method1415client # [ 0.622837] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1416client # [ 0.625618] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001417client # [ 0.625647] Intel/Sharp Extended Query Table at 0x00311418client # [ 0.626965] Using buffer write method1419client # [ 0.626992] Concatenating MTD devices:1420client # [ 0.626996] (0): "0.flash"1421client # [ 0.627000] (1): "0.flash"1422client # [ 0.627004] into device "0.flash"1423lb # [ 0.859581] Freeing initrd memory: 26140K1424lb # [ 0.865665] tun: Universal TUN/TAP device driver, 1.61425lb # [ 0.869331] thunder_xcv, ver 1.01426lb # [ 0.869380] thunder_bgx, ver 1.01427lb # [ 0.869402] nicpf, ver 1.01428lb # [ 0.869948] e1000: Intel(R) PRO/1000 Network Driver1429lb # [ 0.869955] e1000: Copyright (c) 1999-2006 Intel Corporation.1430lb # [ 0.869984] e1000e: Intel(R) PRO/1000 Network Driver1431lb # [ 0.869992] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1432lb # [ 0.870020] igb: Intel(R) Gigabit Ethernet Network Driver1433lb # [ 0.870026] igb: Copyright (c) 2007-2014 Intel Corporation.1434lb # [ 0.870050] igbvf: Intel(R) Gigabit Virtual Function Network Driver1435lb # [ 0.870055] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1436lb # [ 0.870189] sky2: driver version 1.301437lb # [ 0.878896] usbcore: registered new interface driver usb-storage1438lb # [ 0.878945] usbcore: registered new interface driver usbserial_generic1439lb # [ 0.878960] usbserial: USB Serial support registered for generic1440lb # [ 0.879562] hv_vmbus: registering driver hyperv_keyboard1441lb # [ 0.880753] ehci-pci 0000:00:0a.0: EHCI Host Controller1442lb # [ 0.880779] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11443lb # [ 0.880938] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001444lb # [ 0.886411] rtc-pl031 9010000.pl031: registered as rtc01445lb # [ 0.886439] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:33:12 UTC (1789896792)1446lb # [ 0.886788] i2c_dev: i2c /dev entries driver1447lb # [ 0.891713] sdhci: Secure Digital Host Controller Interface driver1448lb # [ 0.891724] sdhci: Copyright(c) Pierre Ossman1449lb # [ 0.891991] Synopsys Designware Multimedia Card Interface Driver1450lb # [ 0.892389] sdhci-pltfm: SDHCI platform and OF driver helper1451lb # [ 0.894045] hid: raw HID events driver (C) Jiri Kosina1452lb # [ 0.897584] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001453lb # [ 0.898651] hub 1-0:1.0: USB hub found1454lb # [ 0.898669] hub 1-0:1.0: 6 ports detected1455lb # [ 0.900009] usbcore: registered new interface driver usbhid1456lb # [ 0.900019] usbhid: USB HID core driver1457worker1 # [ 0.857164] Freeing initrd memory: 26148K1458lb # [ 0.902272] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1459lb # [ 0.904890] drop_monitor: Initializing network drop monitor service1460lb # [ 0.905045] NET: Registered PF_INET6 protocol family1461lb # [ 0.906950] Segment Routing with IPv61462lb # [ 0.906984] In-situ OAM (IOAM) with IPv61463lb # [ 0.907017] NET: Registered PF_PACKET protocol family1464worker1 # [ 0.863193] tun: Universal TUN/TAP device driver, 1.61465lb # [ 0.908685] 9pnet: Installing 9P2000 support1466worker2 # [ 0.858222] Freeing initrd memory: 26148K1467lb # [ 0.911431] Key type dns_resolver registered1468worker1 # [ 0.867037] thunder_xcv, ver 1.01469worker1 # [ 0.867080] thunder_bgx, ver 1.01470worker1 # [ 0.867103] nicpf, ver 1.01471worker1 # [ 0.867654] e1000: Intel(R) PRO/1000 Network Driver1472worker1 # [ 0.867661] e1000: Copyright (c) 1999-2006 Intel Corporation.1473worker1 # [ 0.867685] e1000e: Intel(R) PRO/1000 Network Driver1474lb # [ 0.917614] registered taskstats version 11475lb # [ 0.917765] Loading compiled-in X.509 certificates1476worker1 # [ 0.867692] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1477worker1 # [ 0.867723] igb: Intel(R) Gigabit Ethernet Network Driver1478worker2 # [ 0.864353] tun: Universal TUN/TAP device driver, 1.61479worker1 # [ 0.867729] igb: Copyright (c) 2007-2014 Intel Corporation.1480client # [ 0.864111] Freeing initrd memory: 26160K1481worker1 # [ 0.867752] igbvf: Intel(R) Gigabit Virtual Function Network Driver1482worker1 # [ 0.867758] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1483worker1 # [ 0.867892] sky2: driver version 1.301484worker1 # [ 0.869492] usbcore: registered new interface driver usb-storage1485worker1 # [ 0.869687] usbcore: registered new interface driver usbserial_generic1486worker1 # [ 0.869706] usbserial: USB Serial support registered for generic1487worker1 # [ 0.870325] hv_vmbus: registering driver hyperv_keyboard1488client # [ 0.870184] tun: Universal TUN/TAP device driver, 1.61489worker1 # [ 0.881672] ehci-pci 0000:00:0a.0: EHCI Host Controller1490lb # [ 0.926611] Demotion targets for Node 0: null1491lb # [ 0.926723] Key type .fscrypt registered1492worker1 # [ 0.881706] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11493worker2 # [ 0.868108] thunder_xcv, ver 1.01494lb # [ 0.926730] Key type fscrypt-provisioning registered1495worker2 # [ 0.868147] thunder_bgx, ver 1.01496worker1 # [ 0.881933] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001497worker2 # [ 0.868170] nicpf, ver 1.01498lb # [ 0.926824] ima: No TPM chip found, activating TPM-bypass!1499worker2 # [ 0.868713] e1000: Intel(R) PRO/1000 Network Driver1500lb # [ 0.926843] ima: Allocated hash algorithm: sha11501lb # [ 0.926866] ima: No architecture policies found1502worker2 # [ 0.868721] e1000: Copyright (c) 1999-2006 Intel Corporation.1503worker2 # [ 0.868746] e1000e: Intel(R) PRO/1000 Network Driver1504worker1 # [ 0.884655] rtc-pl031 9010000.pl031: registered as rtc01505worker2 # [ 0.868755] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1506lb # [ 0.931119] input: gpio-keys as /devices/platform/gpio-keys/input/input01507worker1 # [ 0.884682] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:33:13 UTC (1789896793)1508worker2 # [ 0.868784] igb: Intel(R) Gigabit Ethernet Network Driver1509worker1 # [ 0.885017] i2c_dev: i2c /dev entries driver1510worker2 # [ 0.868790] igb: Copyright (c) 2007-2014 Intel Corporation.1511client # [ 0.873999] thunder_xcv, ver 1.01512client # [ 0.874045] thunder_bgx, ver 1.01513worker2 # [ 0.868813] igbvf: Intel(R) Gigabit Virtual Function Network Driver1514client # [ 0.874068] nicpf, ver 1.01515client # [ 0.874608] e1000: Intel(R) PRO/1000 Network Driver1516worker2 # [ 0.868819] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1517worker2 # [ 0.868950] sky2: driver version 1.301518client # [ 0.874615] e1000: Copyright (c) 1999-2006 Intel Corporation.1519worker2 # [ 0.870497] usbcore: registered new interface driver usb-storage1520client # [ 0.874639] e1000e: Intel(R) PRO/1000 Network Driver1521worker2 # [ 0.870568] usbcore: registered new interface driver usbserial_generic1522client # [ 0.874646] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1523worker1 # [ 0.890001] sdhci: Secure Digital Host Controller Interface driver1524client # [ 0.874674] igb: Intel(R) Gigabit Ethernet Network Driver1525worker2 # [ 0.870582] usbserial: USB Serial support registered for generic1526worker1 # [ 0.890011] sdhci: Copyright(c) Pierre Ossman1527client # [ 0.874680] igb: Copyright (c) 2007-2014 Intel Corporation.1528worker2 # [ 0.871228] hv_vmbus: registering driver hyperv_keyboard1529worker1 # [ 0.890276] Synopsys Designware Multimedia Card Interface Driver1530worker2 # [ 0.872511] ehci-pci 0000:00:0a.0: EHCI Host Controller1531client # [ 0.874703] igbvf: Intel(R) Gigabit Virtual Function Network Driver1532worker1 # [ 0.890648] sdhci-pltfm: SDHCI platform and OF driver helper1533client # [ 0.874709] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1534worker2 # [ 0.872535] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11535worker1 # [ 0.890901] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001536client # [ 0.874839] sky2: driver version 1.301537worker1 # [ 0.891225] hub 1-0:1.0: USB hub found1538client # [ 0.876453] usbcore: registered new interface driver usb-storage1539worker1 # [ 0.891282] hub 1-0:1.0: 6 ports detected1540worker2 # [ 0.872733] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001541client # [ 0.876570] usbcore: registered new interface driver usbserial_generic1542worker2 # [ 0.884406] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001543client # [ 0.876584] usbserial: USB Serial support registered for generic1544worker2 # [ 0.884758] hub 1-0:1.0: USB hub found1545worker2 # [ 0.884774] hub 1-0:1.0: 6 ports detected1546client # [ 0.877563] ehci-pci 0000:00:0a.0: EHCI Host Controller1547client # [ 0.877588] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11548worker2 # [ 0.887656] rtc-pl031 9010000.pl031: registered as rtc01549worker1 # [ 0.897473] hid: raw HID events driver (C) Jiri Kosina1550client # [ 0.877782] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001551worker1 # [ 0.897744] usbcore: registered new interface driver usbhid1552worker2 # [ 0.887685] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:33:13 UTC (1789896793)1553worker1 # [ 0.897750] usbhid: USB HID core driver1554client # [ 0.889567] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001555worker2 # [ 0.889785] i2c_dev: i2c /dev entries driver1556client # [ 0.889896] hub 1-0:1.0: USB hub found1557client # [ 0.889922] hub 1-0:1.0: 6 ports detected1558worker1 # [ 0.900694] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1559client # [ 0.892339] hv_vmbus: registering driver hyperv_keyboard1560worker1 # [ 0.902286] drop_monitor: Initializing network drop monitor service1561worker1 # [ 0.902418] NET: Registered PF_INET6 protocol family1562client # [ 0.893918] rtc-pl031 9010000.pl031: registered as rtc01563lb # [ 0.948872] clk: Disabling unused clocks1564worker1 # [ 0.905469] Segment Routing with IPv61565worker1 # [ 0.905489] In-situ OAM (IOAM) with IPv61566lb # [ 0.948900] PM: genpd: Disabling unused power domains1567client # [ 0.893946] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:33:13 UTC (1789896793)1568worker1 # [ 0.905545] NET: Registered PF_PACKET protocol family1569worker2 # [ 0.892955] sdhci: Secure Digital Host Controller Interface driver1570client # [ 0.894248] i2c_dev: i2c /dev entries driver1571worker2 # [ 0.892965] sdhci: Copyright(c) Pierre Ossman1572worker2 # [ 0.893223] Synopsys Designware Multimedia Card Interface Driver1573worker2 # [ 0.893581] sdhci-pltfm: SDHCI platform and OF driver helper1574lb # [ 0.953079] Freeing unused kernel memory: 4736K1575lb # [ 0.953265] Run /init as init process1576worker2 # [ 0.895202] hid: raw HID events driver (C) Jiri Kosina1577worker2 # [ 0.895443] usbcore: registered new interface driver usbhid1578worker2 # [ 0.895449] usbhid: USB HID core driver1579worker1 # [ 0.907166] 9pnet: Installing 9P2000 support1580client # [ 0.899096] sdhci: Secure Digital Host Controller Interface driver1581worker1 # [ 0.909288] Key type dns_resolver registered1582client # [ 0.899107] sdhci: Copyright(c) Pierre Ossman1583client # [ 0.899379] Synopsys Designware Multimedia Card Interface Driver1584client # [ 0.899740] sdhci-pltfm: SDHCI platform and OF driver helper1585worker2 # [ 0.901010] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1586worker2 # [ 0.902530] drop_monitor: Initializing network drop monitor service1587client # [ 0.904144] hid: raw HID events driver (C) Jiri Kosina1588worker2 # [ 0.902673] NET: Registered PF_INET6 protocol family1589client # [ 0.904414] usbcore: registered new interface driver usbhid1590worker2 # [ 0.905707] Segment Routing with IPv61591client # [ 0.904421] usbhid: USB HID core driver1592worker2 # [ 0.905736] In-situ OAM (IOAM) with IPv61593worker2 # [ 0.905766] NET: Registered PF_PACKET protocol family1594worker2 # [ 0.907426] 9pnet: Installing 9P2000 support1595worker1 # [ 0.916275] registered taskstats version 11596worker1 # [ 0.916443] Loading compiled-in X.509 certificates1597client # [ 0.907310] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1598client # [ 0.908811] drop_monitor: Initializing network drop monitor service1599client # [ 0.910834] NET: Registered PF_INET6 protocol family1600client # [ 0.912041] Segment Routing with IPv61601worker2 # [ 0.910248] Key type dns_resolver registered1602client # [ 0.912059] In-situ OAM (IOAM) with IPv61603client # [ 0.912090] NET: Registered PF_PACKET protocol family1604lb # [ 0.968455] systemd[1]: Successfully made /usr/ read-only.1605worker1 # [ 0.924877] Demotion targets for Node 0: null1606worker1 # [ 0.924984] Key type .fscrypt registered1607worker1 # [ 0.924990] Key type fscrypt-provisioning registered1608client # [ 0.913958] 9pnet: Installing 9P2000 support1609worker1 # [ 0.925080] ima: No TPM chip found, activating TPM-bypass!1610client # [ 0.916026] Key type dns_resolver registered1611worker1 # [ 0.925099] ima: Allocated hash algorithm: sha11612worker1 # [ 0.925119] ima: No architecture policies found1613worker1 # [ 0.929179] input: gpio-keys as /devices/platform/gpio-keys/input/input01614worker2 # [ 0.916239] registered taskstats version 11615worker2 # [ 0.916397] Loading compiled-in X.509 certificates1616client # [ 0.922971] registered taskstats version 11617client # [ 0.923133] Loading compiled-in X.509 certificates1618worker2 # [ 0.924885] Demotion targets for Node 0: null1619worker2 # [ 0.924988] Key type .fscrypt registered1620worker2 # [ 0.924995] Key type fscrypt-provisioning registered1621worker2 # [ 0.925084] ima: No TPM chip found, activating TPM-bypass!1622worker2 # [ 0.925103] ima: Allocated hash algorithm: sha11623worker2 # [ 0.925124] ima: No architecture policies found1624worker2 # [ 0.929050] input: gpio-keys as /devices/platform/gpio-keys/input/input01625client # [ 0.931801] Demotion targets for Node 0: null1626client # [ 0.931908] Key type .fscrypt registered1627client # [ 0.931914] Key type fscrypt-provisioning registered1628client # [ 0.932006] ima: No TPM chip found, activating TPM-bypass!1629client # [ 0.932025] ima: Allocated hash algorithm: sha11630client # [ 0.932045] ima: No architecture policies found1631client # [ 0.936086] input: gpio-keys as /devices/platform/gpio-keys/input/input01632worker1 # [ 0.947259] clk: Disabling unused clocks1633worker1 # [ 0.947286] PM: genpd: Disabling unused power domains1634worker1 # [ 0.951504] Freeing unused kernel memory: 4736K1635worker1 # [ 0.951717] Run /init as init process1636worker2 # [ 0.947759] clk: Disabling unused clocks1637worker2 # [ 0.947788] PM: genpd: Disabling unused power domains1638worker2 # [ 0.952001] Freeing unused kernel memory: 4736K1639worker2 # [ 0.952769] Run /init as init process1640client # [ 0.954511] clk: Disabling unused clocks1641client # [ 0.954542] PM: genpd: Disabling unused power domains1642worker1 # [ 0.969043] systemd[1]: Successfully made /usr/ read-only.1643client # [ 0.958849] Freeing unused kernel memory: 4736K1644client # [ 0.959079] Run /init as init process1645worker2 # [ 0.966265] systemd[1]: Successfully made /usr/ read-only.1646client # [ 0.975049] systemd[1]: Successfully made /usr/ read-only.1647lb # [ 1.150366] usb 1-1: new high-speed USB device number 2 using ehci-pci1648worker1 # [ 1.138930] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker2 # [ 1.132080] usb 1-1: new high-speed USB device number 2 using ehci-pci1650client # [ 1.136939] usb 1-1: new high-speed USB device number 2 using ehci-pci1651lb # [ 1.302671] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652lb # [ 1.308427] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1653lb # [ 1.308486] systemd[1]: Detected virtualization qemu.1654lb # [ 1.308558] systemd[1]: Detected architecture arm64.1655lb # [ 1.308581] systemd[1]: Running in initrd.1656lb # [ 1.309471] systemd[1]: Initializing machine ID from random generator.1657lb # [ 1.309739] systemd[1]: Hostname set to <lb>.1658worker1 # [ 1.291146] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11659worker2 # [ 1.284265] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11660client # [ 1.289310] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11661worker1 # [ 1.304213] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1662worker1 # [ 1.316195] systemd[1]: Detected virtualization qemu.1663worker1 # [ 1.318243] systemd[1]: Detected architecture arm64.1664worker1 # [ 1.320307] systemd[1]: Running in initrd.1665worker2 # [ 1.301050] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1666worker1 # [ 1.322810] systemd[1]: Initializing machine ID from random generator.1667worker2 # [ 1.313095] systemd[1]: Detected virtualization qemu.1668worker1 # [ 1.325636] systemd[1]: Hostname set to <worker1>.1669worker2 # [ 1.315142] systemd[1]: Detected architecture arm64.1670worker2 # [ 1.317137] systemd[1]: Running in initrd.1671client # [ 1.309863] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1672worker2 # [ 1.319684] systemd[1]: Initializing machine ID from random generator.1673client # [ 1.322072] systemd[1]: Detected virtualization qemu.1674worker2 # [ 1.322771] systemd[1]: Hostname set to <worker2>.1675client # [ 1.324072] systemd[1]: Detected architecture arm64.1676client # [ 1.326050] systemd[1]: Running in initrd.1677lb # [ 1.382580] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01678client # [ 1.328590] systemd[1]: Initializing machine ID from random generator.1679client # [ 1.331564] systemd[1]: Hostname set to <client>.1680worker1 # [ 1.375177] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681worker2 # [ 1.372302] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682client # [ 1.377169] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683lb # [ 1.502339] usb 1-2: new high-speed USB device number 3 using ehci-pci1684worker1 # [ 1.494935] usb 1-2: new high-speed USB device number 3 using ehci-pci1685worker2 # [ 1.496095] usb 1-2: new high-speed USB device number 3 using ehci-pci1686client # [ 1.500966] usb 1-2: new high-speed USB device number 3 using ehci-pci1687lb # [ 1.629530] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688lb # [ 1.658921] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21689lb # [ 1.663947] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01690worker1 # [ 1.627274] systemd[1]: bpf-restrict-fs: LSM BPF program attached1691worker2 # [ 1.633039] systemd[1]: bpf-restrict-fs: LSM BPF program attached1692client # [ 1.633434] systemd[1]: bpf-restrict-fs: LSM BPF program attached1693worker1 # [ 1.651370] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21694worker1 # [ 1.656848] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01695worker2 # [ 1.650172] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21696worker2 # [ 1.660322] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01697client # [ 1.663403] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21698client # [ 1.670289] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01699lb # [ 1.746189] systemd[1]: Queued start job for default target Initrd Default Target.1700lb # [ 1.756489] systemd[1]: Created slice Slice /system/modprobe.1701lb # [ 1.757557] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1702lb # [ 1.758872] systemd[1]: Expecting device /dev/disk/by-label/nixos...1703lb # [ 1.759807] systemd[1]: Reached target Path Units.1704lb # [ 1.760524] systemd[1]: Reached target Slice Units.1705lb # [ 1.761254] systemd[1]: Reached target Swaps.1706lb # [ 1.761910] systemd[1]: Reached target Timer Units.1707lb # [ 1.762857] systemd[1]: Listening on D-Bus System Message Bus Socket.1708lb # [ 1.763932] systemd[1]: Listening on Journal Socket (/dev/log).1709lb # [ 1.765003] systemd[1]: Listening on Journal Sockets.1710lb # [ 1.765879] systemd[1]: Listening on udev Control Socket.1711lb # [ 1.766888] systemd[1]: Listening on udev Kernel Socket.1712lb # [ 1.766913] systemd[1]: Reached target Socket Units.1713lb # [ 1.769868] systemd[1]: Starting Create List of Static Device Nodes...1714lb # [ 1.778438] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1715lb # [ 1.779453] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1716worker1 # [ 1.744264] systemd[1]: Queued start job for default target Initrd Default Target.1717lb # [ 1.791753] systemd[1]: Mounting Kernel Configuration File System...1718worker1 # [ 1.753599] systemd[1]: Created slice Slice /system/modprobe.1719worker1 # [ 1.755092] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1720worker1 # [ 1.756736] systemd[1]: Expecting device /dev/disk/by-label/nixos...1721worker2 # [ 1.747124] systemd[1]: Queued start job for default target Initrd Default Target.1722worker1 # [ 1.758004] systemd[1]: Reached target Path Units.1723worker1 # [ 1.759021] systemd[1]: Reached target Slice Units.1724worker1 # [ 1.760001] systemd[1]: Reached target Swaps.1725worker1 # [ 1.760890] systemd[1]: Reached target Timer Units.1726client # [ 1.750967] systemd[1]: Queued start job for default target Initrd Default Target.1727worker1 # [ 1.762143] systemd[1]: Listening on D-Bus System Message Bus Socket.1728worker1 # [ 1.763637] systemd[1]: Listening on Journal Socket (/dev/log).1729worker1 # [ 1.764974] systemd[1]: Listening on Journal Sockets.1730lb # [ 1.810595] systemd[1]: Starting Journal Service...1731worker1 # [ 1.766161] systemd[1]: Listening on udev Control Socket.1732worker2 # [ 1.758382] systemd[1]: Created slice Slice /system/modprobe.1733worker1 # [ 1.767402] systemd[1]: Listening on udev Kernel Socket.1734client # [ 1.759241] systemd[1]: Created slice Slice /system/modprobe.1735worker1 # [ 1.767438] systemd[1]: Reached target Socket Units.1736worker2 # [ 1.759656] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1737client # [ 1.760467] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1738lb # [ 1.816640] systemd[1]: Starting Load Kernel Modules...1739client # [ 1.761914] systemd[1]: Expecting device /dev/disk/by-label/nixos...1740client # [ 1.762986] systemd[1]: Reached target Path Units.1741worker1 # [ 1.771416] systemd[1]: Starting Create List of Static Device Nodes...1742lb # [ 1.817606] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1743worker2 # [ 1.761085] systemd[1]: Expecting device /dev/disk/by-label/nixos...1744client # [ 1.763824] systemd[1]: Reached target Slice Units.1745worker2 # [ 1.761123] systemd[1]: Reached target Path Units.1746client # [ 1.764666] systemd[1]: Reached target Swaps.1747worker2 # [ 1.761145] systemd[1]: Reached target Slice Units.1748client # [ 1.765513] systemd[1]: Reached target Timer Units.1749worker2 # [ 1.761164] systemd[1]: Reached target Swaps.1750worker2 # [ 1.761185] systemd[1]: Reached target Timer Units.1751client # [ 1.766552] systemd[1]: Listening on D-Bus System Message Bus Socket.1752worker2 # [ 1.761377] systemd[1]: Listening on D-Bus System Message Bus Socket.1753client # [ 1.767807] systemd[1]: Listening on Journal Socket (/dev/log).1754worker2 # [ 1.761531] systemd[1]: Listening on Journal Socket (/dev/log).1755worker2 # [ 1.761664] systemd[1]: Listening on Journal Sockets.1756worker2 # [ 1.761798] systemd[1]: Listening on udev Control Socket.1757client # [ 1.769071] systemd[1]: Listening on Journal Sockets.1758worker2 # [ 1.761908] systemd[1]: Listening on udev Kernel Socket.1759client # [ 1.769217] systemd[1]: Listening on udev Control Socket.1760worker2 # [ 1.761931] systemd[1]: Reached target Socket Units.1761client # [ 1.769338] systemd[1]: Listening on udev Kernel Socket.1762worker1 # [ 1.782844] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1763client # [ 1.769362] systemd[1]: Reached target Socket Units.1764worker2 # [ 1.772965] systemd[1]: Starting Create List of Static Device Nodes...1765client # [ 1.774413] systemd[1]: Starting Create List of Static Device Nodes...1766worker1 # [ 1.784395] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1767lb # [ 1.834732] systemd[1]: Starting Coldplug All udev Devices...1768worker2 # [ 1.783415] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1769client # [ 1.785047] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1770worker2 # [ 1.784760] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1771client # [ 1.786216] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1772worker1 # [ 1.796530] systemd[1]: Mounting Kernel Configuration File System...1773client # [ 1.789649] systemd[1]: Mounting Kernel Configuration File System...1774lb # [ 1.854428] systemd[1]: Finished Create List of Static Device Nodes.1775worker2 # [ 1.797647] systemd[1]: Mounting Kernel Configuration File System...1776client # [ 1.801389] systemd[1]: Starting Journal Service...1777lb # [ 1.855596] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1778worker1 # [ 1.815863] systemd[1]: Starting Journal Service...1779worker1 # [ 1.823111] systemd[1]: Starting Load Kernel Modules...1780lb # [ 1.867861] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1781worker1 # [ 1.824183] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1782lb # [ 1.869760] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1783lb # [ 1.870180] systemd[1]: Mounted Kernel Configuration File System.1784lb # [ 1.872992] systemd-journald[73]: Collecting audit messages is disabled.1785worker2 # [ 1.820643] systemd[1]: Starting Journal Service...1786worker2 # [ 1.824193] systemd[1]: Starting Load Kernel Modules...1787worker2 # [ 1.825134] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1788worker1 # [ 1.836107] systemd[1]: Starting Coldplug All udev Devices...1789lb # [ 1.878760] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1790client # [ 1.833094] systemd[1]: Starting Load Kernel Modules...1791client # [ 1.834061] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1792lb # [ 1.894371] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1793lb # [ 1.898909] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01794lb # [ 1.899141] [drm] features: -virgl +edid -resource_blob -host_visible1795lb # [ 1.899150] [drm] features: -context_init1796lb # [ 1.899848] [drm] number of scanouts: 11797lb # [ 1.899865] [drm] number of cap sets: 01798worker2 # [ 1.852208] systemd[1]: Starting Coldplug All udev Devices...1799worker1 # [ 1.867003] systemd[1]: Finished Create List of Static Device Nodes.1800worker1 # [ 1.868215] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1801worker1 # [ 1.868524] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1802client # [ 1.856514] systemd-journald[73]: Collecting audit messages is disabled.1803lb # [ 1.920043] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1804worker2 # [ 1.867360] systemd-journald[73]: Collecting audit messages is disabled.1805lb # [ 1.920069] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01806worker1 # [ 1.879667] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1807client # [ 1.869170] systemd[1]: Starting Coldplug All udev Devices...1808lb # [ 1.924676] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1809worker1 # [ 1.883239] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1810lb # [ 1.930653] systemd[1]: Starting Create Static Device Nodes in /dev...1811worker2 # [ 1.876141] systemd[1]: Finished Create List of Static Device Nodes.1812client # [ 1.877029] systemd[1]: Finished Create List of Static Device Nodes.1813worker2 # [ 1.877378] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1814client # [ 1.877870] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1815worker2 # [ 1.877680] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1816client # [ 1.878171] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1817client # [ 1.878398] systemd[1]: Mounted Kernel Configuration File System.1818client # [ 1.885239] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1819worker1 # [ 1.896304] systemd-journald[73]: Collecting audit messages is disabled.1820worker1 # [ 1.897251] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1821worker2 # [ 1.888489] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1822worker2 # [ 1.889703] systemd[1]: Mounted Kernel Configuration File System.1823worker1 # [ 1.903246] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01824worker1 # [ 1.903473] [drm] features: -virgl +edid -resource_blob -host_visible1825worker1 # [ 1.903484] [drm] features: -context_init1826worker1 # [ 1.904180] [drm] number of scanouts: 11827worker1 # [ 1.904197] [drm] number of cap sets: 01828worker2 # [ 1.895471] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1829lb # [ 1.950626] Console: switching to colour frame buffer device 160x501830client # [ 1.904912] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1831worker1 # [ 1.919895] systemd[1]: Mounted Kernel Configuration File System.1832worker2 # [ 1.908083] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1833worker2 # [ 1.912691] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01834worker2 # [ 1.912919] [drm] features: -virgl +edid -resource_blob -host_visible1835worker2 # [ 1.912928] [drm] features: -context_init1836worker2 # [ 1.913629] [drm] number of scanouts: 11837worker2 # [ 1.913647] [drm] number of cap sets: 01838client # [ 1.920699] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1839lb # [ 1.977085] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1840lb # [ 1.978756] systemd[1]: Finished Create Static Device Nodes in /dev.1841lb # [ 1.978974] systemd[1]: Reached target Preparation for Local File Systems.1842lb # [ 1.979008] systemd[1]: Reached target Local File Systems.1843client # [ 1.925545] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1844worker1 # [ 1.931215] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1845worker1 # [ 1.931236] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01846lb # [ 1.982951] systemd[1]: Starting Rule-based Manager for Device Events and Files...1847client # [ 1.929279] systemd[1]: Starting Create Static Device Nodes in /dev...1848worker1 # [ 1.943444] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1849worker2 # [ 1.932360] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1850worker1 # [ 1.946009] systemd[1]: Starting Create Static Device Nodes in /dev...1851worker2 # [ 1.932380] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01852client # [ 1.939720] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01853client # [ 1.939956] [drm] features: -virgl +edid -resource_blob -host_visible1854client # [ 1.939965] [drm] features: -context_init1855client # [ 1.940675] [drm] number of scanouts: 11856client # [ 1.940692] [drm] number of cap sets: 01857client # [ 1.948764] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1858client # [ 1.948784] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01859worker2 # [ 1.953716] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1860worker1 # [ 1.959328] Console: switching to colour frame buffer device 160x501861worker2 # [ 1.956341] systemd[1]: Starting Create Static Device Nodes in /dev...1862lb # [ 2.010875] systemd[1]: Finished Load Kernel Modules.1863lb # [ 2.014019] systemd[1]: Starting Apply Kernel Variables...1864worker2 # [ 1.968426] Console: switching to colour frame buffer device 160x501865worker1 # [ 1.987447] systemd[1]: Finished Create Static Device Nodes in /dev.1866worker1 # [ 1.987618] systemd[1]: Reached target Preparation for Local File Systems.1867worker1 # [ 1.987642] systemd[1]: Reached target Local File Systems.1868client # [ 1.981514] systemd[1]: Finished Create Static Device Nodes in /dev.1869client # [ 1.981848] systemd[1]: Reached target Preparation for Local File Systems.1870client # [ 1.981875] systemd[1]: Reached target Local File Systems.1871worker1 # [ 1.991495] systemd[1]: Starting Rule-based Manager for Device Events and Files...1872worker2 # [ 1.988585] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1873client # [ 1.985853] systemd[1]: Starting Rule-based Manager for Device Events and Files...1874worker1 # [ 1.999531] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1875client # [ 1.993225] Console: switching to colour frame buffer device 160x501876lb # [ 2.054904] systemd[1]: Finished Apply Kernel Variables.1877client # [ 1.999687] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1878lb # [ 2.062535] systemd[1]: Started Journal Service.1879worker2 # [ 2.008727] systemd[1]: Finished Load Kernel Modules.1880worker1 # [ 2.023123] systemd[1]: Finished Load Kernel Modules.1881worker2 # [ 2.011772] systemd[1]: Starting Apply Kernel Variables...1882worker1 # [ 2.026276] systemd[1]: Starting Apply Kernel Variables...1883lb # [ 2.060000] systemd-modules-load[74]: Inserted module 'dm_mod'1884lb # [ 2.061711] systemd-modules-load[74]: Module 'virtio_balloon' is built in1885lb # [ 2.062816] systemd-modules-load[74]: Module 'virtio_console' is built in1886lb # [ 2.063835] systemd-modules-load[74]: Inserted module 'virtio_gpu'1887client # [ 2.025607] systemd[1]: Finished Load Kernel Modules.1888lb # [ 2.072355] systemd-modules-load[74]: Module 'virtio_rng' is built in1889worker2 # [ 2.029318] systemd[1]: Finished Create Static Device Nodes in /dev.1890worker2 # [ 2.029509] systemd[1]: Reached target Preparation for Local File Systems.1891worker2 # [ 2.029542] systemd[1]: Reached target Local File Systems.1892worker2 # [ 2.034583] systemd[1]: Starting Rule-based Manager for Device Events and Files...1893lb # [ 2.082037] systemd[1]: Starting Create System Files and Directories...1894client # [ 2.037346] systemd[1]: Starting Apply Kernel Variables...1895lb # [ 2.084228] systemd-udevd[80]: Using default interface naming scheme 'v261'.1896worker2 # [ 2.056380] systemd[1]: Finished Apply Kernel Variables.1897lb # [ 2.100562] systemd[1]: Finished Create System Files and Directories.1898worker1 # [ 2.071507] systemd[1]: Finished Apply Kernel Variables.1899worker2 # [ 2.052362] systemd-modules-load[74]: Inserted module 'dm_mod'1900worker2 # [ 2.053469] systemd-modules-load[74]: Module 'virtio_balloon' is built in1901worker2 # [ 2.054539] systemd-modules-load[74]: Module 'virtio_console' is built in1902worker2 # [ 2.055628] systemd-modules-load[74]: Inserted module 'virtio_gpu'1903client # [ 2.056320] systemd-modules-load[74]: Inserted module 'dm_mod'1904worker2 # [ 2.072635] systemd[1]: Started Journal Service.1905client # [ 2.074262] systemd[1]: Started Journal Service.1906client # [ 2.060624] systemd-modules-load[74]: Module 'virtio_balloon' is built in1907client # [ 2.061721] systemd-modules-load[74]: Module 'virtio_console' is built in1908lb # [ 2.119598] systemd[1]: Started Rule-based Manager for Device Events and Files.1909client # [ 2.062806] systemd-modules-load[74]: Inserted module 'virtio_gpu'1910client # [ 2.063804] systemd-modules-load[74]: Module 'virtio_rng' is built in1911worker1 # [ 2.080587] systemd-modules-load[74]: Inserted module 'dm_mod'1912worker1 # [ 2.096529] systemd[1]: Started Journal Service.1913worker2 # [ 2.072440] systemd-modules-load[74]: Module 'virtio_rng' is built in1914worker1 # [ 2.085062] systemd-modules-load[74]: Module 'virtio_balloon' is built in1915worker2 # [ 2.073488] systemd[1]: Starting Create System Files and Directories...1916worker1 # [ 2.086167] systemd-modules-load[74]: Module 'virtio_console' is built in1917worker1 # [ 2.087218] systemd-modules-load[74]: Inserted module 'virtio_gpu'1918client # [ 2.081759] systemd[1]: Starting Create System Files and Directories...1919client # [ 2.083144] systemd-udevd[79]: Using default interface naming scheme 'v261'.1920worker1 # [ 2.096479] systemd-modules-load[74]: Module 'virtio_rng' is built in1921worker1 # [ 2.097837] systemd-udevd[80]: Using default interface naming scheme 'v261'.1922worker1 # [ 2.101555] systemd[1]: Starting Create System Files and Directories...1923client # [ 2.097797] systemd[1]: Finished Apply Kernel Variables.1924worker2 # [ 2.107719] systemd[1]: Finished Create System Files and Directories.1925client # [ 2.112688] systemd[1]: Finished Create System Files and Directories.1926worker2 # [ 2.113290] systemd-udevd[81]: Using default interface naming scheme 'v261'.1927worker1 # [ 2.136977] systemd[1]: Finished Create System Files and Directories.1928lb # [ 2.184169] systemd[1]: Starting Virtual Console Setup...1929worker1 # [ 2.141195] systemd[1]: Started Rule-based Manager for Device Events and Files.1930client # [ 2.129725] systemd[1]: Started Rule-based Manager for Device Events and Files.1931worker2 # [ 2.144738] systemd[1]: Started Rule-based Manager for Device Events and Files.1932lb # [ 2.232521] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1933client # [ 2.177193] systemd[1]: Starting Virtual Console Setup...1934lb # [ 2.235923] systemd[1]: Finished Virtual Console Setup.1935worker1 # [ 2.200543] systemd[1]: Starting Virtual Console Setup...1936worker2 # [ 2.199816] systemd[1]: Starting Virtual Console Setup...1937client # [ 2.232553] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1938client # [ 2.236007] systemd[1]: Finished Virtual Console Setup.1939worker1 # [ 2.248505] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1940worker1 # [ 2.252073] systemd[1]: Finished Virtual Console Setup.1941worker2 # [ 2.248512] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1942worker2 # [ 2.251960] systemd[1]: Finished Virtual Console Setup.1943lb # [ 2.864929] systemd[1]: Finished Coldplug All udev Devices.1944lb # [ 2.865851] systemd[1]: Reached target System Initialization.1945lb # [ 2.866637] systemd[1]: Reached target Basic System.1946client # [ 2.835603] systemd[1]: Finished Coldplug All udev Devices.1947client # [ 2.836649] systemd[1]: Reached target System Initialization.1948client # [ 2.837467] systemd[1]: Reached target Basic System.1949worker2 # [ 2.839902] systemd[1]: Finished Coldplug All udev Devices.1950worker2 # [ 2.840998] systemd[1]: Reached target System Initialization.1951worker2 # [ 2.841810] systemd[1]: Reached target Basic System.1952worker1 # [ 2.864596] systemd[1]: Finished Coldplug All udev Devices.1953worker1 # [ 2.865578] systemd[1]: Reached target System Initialization.1954worker1 # [ 2.866403] systemd[1]: Reached target Basic System.1955client # [ 2.959633] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1956lb # [ 3.019273] (udev-worker)[106]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1957lb # [ 3.024000] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line.1958worker2 # [ 2.967790] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1959lb # [ 3.031571] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1960worker2 # [ 3.006920] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1961client # [ 3.009196] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1962worker1 # [ 3.022802] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1963client # [ 3.015280] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1964worker2 # [ 3.015927] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1965worker1 # [ 3.029350] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1966worker1 # [ 3.036261] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1967lb # [ 3.124959] systemd[1]: Found device /dev/disk/by-label/nixos.1968worker2 # [ 3.068851] systemd[1]: Found device /dev/disk/by-label/nixos.1969worker2 # [ 3.071919] systemd[1]: Reached target Initrd Root Device.1970lb # [ 3.132097] systemd[1]: Reached target Initrd Root Device.1971worker2 # [ 3.077326] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1972lb # [ 3.136189] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1973client # [ 3.092394] systemd[1]: Found device /dev/disk/by-label/nixos.1974client # [ 3.095341] systemd[1]: Reached target Initrd Root Device.1975client # [ 3.099799] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1976worker1 # [ 3.116925] systemd[1]: Found device /dev/disk/by-label/nixos.1977worker1 # [ 3.122566] systemd[1]: Reached target Initrd Root Device.1978worker1 # [ 3.126445] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1979lb # [ 3.181632] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1980worker2 # [ 3.128536] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1981lb # [ 3.189778] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1982lb # [ 3.191221] systemd[1]: Mounting /sysroot...1983worker2 # [ 3.137683] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1984worker2 # [ 3.143815] systemd[1]: Mounting /sysroot...1985client # [ 3.148843] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1986client # [ 3.157998] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1987worker1 # [ 3.172118] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1988client # [ 3.163963] systemd[1]: Mounting /sysroot...1989worker1 # [ 3.179970] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1990lb # [ 3.242711] EXT4-fs (vda): mounted filesystem 9a7d33cb-18f2-414b-89aa-03e28df7bb41 r/w with ordered data mode. Quota mode: none.1991worker1 # [ 3.185831] systemd[1]: Mounting /sysroot...1992worker2 # [ 3.187938] EXT4-fs (vda): mounted filesystem 8d07ccb2-4d6c-4ccb-990c-ef1c4533358e r/w with ordered data mode. Quota mode: none.1993worker2 # [ 3.177367] systemd[1]: Mounted /sysroot.1994lb # [ 3.234587] systemd[1]: Mounted /sysroot.1995lb # [ 3.236104] systemd[1]: Reached target Initrd Root File System.1996worker2 # [ 3.180104] systemd[1]: Reached target Initrd Root File System.1997worker2 # [ 3.182712] systemd[1]: Starting Mountpoints Configured in the Real Root...1998lb # [ 3.241185] systemd[1]: Starting Mountpoints Configured in the Real Root...1999client # [ 3.214140] EXT4-fs (vda): mounted filesystem 4fdcd810-d708-4a81-a787-4e4edda4767b r/w with ordered data mode. Quota mode: none.2000client # [ 3.203108] systemd[1]: Mounted /sysroot.3287lb # [ 13.848257] cfg80211: Loading compiled-in X.509 certificates for regulatory database3288lb # [ 13.860234] (udev-worker)[686]: Network interface NamePolicy= disabled on kernel command line.3289lb # [ 13.902774] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3290lb # [ 13.903356] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3291lb # [ 13.908119] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23292lb # [ 13.908449] cfg80211: failed to load regulatory.db3293lb # [ 13.911987] systemd-vconsole-setup[708]: Configuration of first virtual console was skipped, ignoring remaining ones.3294lb # [ 13.924887] systemd[1]: Finished Virtual Console Setup.3295client # [ 13.995461] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33296worker2 # [ 13.998292] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33297lb # [ 14.097012] systemd[1]: Condition check resulted in Virtio network device being skipped.3298worker1 # [ 14.059781] dhcpcd[642]: eth0: soliciting a DHCP lease3299lb # [ 14.108315] systemd[1]: Starting Address configuration of eth1...3300worker1 # [ 14.064558] dhcpcd[642]: eth0: offered 10.0.2.15 from 10.0.2.23301worker1 # [ 14.084237] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33302worker1 # [ 14.072431] dhcpcd[642]: eth0: probing address 10.0.2.15/243303lb # [ 14.221127] 8021q: adding VLAN 0 to HW filter on device eth03304lb # [ 14.210049] dhcpcd[654]: eth0: waiting for carrier3305lb # [ 14.211037] dhcpcd[654]: eth0: carrier acquired3306lb # [ 14.230858] dhcpcd[654]: DUID 00:01:00:01:32:42:64:e5:52:54:00:12:34:563307lb # [ 14.233562] dhcpcd[654]: eth0: IAID 00:12:34:563308lb # [ 14.236070] dhcpcd[654]: eth0: adding address fe80::5054:ff:fe12:34563309lb # [ 14.253213] 8021q: adding VLAN 0 to HW filter on device eth13310lb # [ 14.261735] network-addresses-eth1-start[736]: adding address 192.168.1.2/24... done3311lb # [ 14.279169] network-addresses-eth1-start[736]: adding address 2001:db8:1::2/64... done3312lb # [ 14.296994] systemd-logind[523]: Watching system buttons on /dev/input/event0 (gpio-keys)3313lb # [ 14.305496] systemd[1]: Finished Address configuration of eth1.3314worker2 # [ 14.264759] dhcpcd[642]: eth0: soliciting a DHCP lease3315worker2 # [ 14.272540] dhcpcd[642]: eth0: offered 10.0.2.15 from 10.0.2.23316worker2 # [ 14.280578] dhcpcd[642]: eth0: probing address 10.0.2.15/243317client # [ 14.300834] systemd[1]: Starting Virtual Console Setup...3318worker2 # [ 14.313308] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3319client # [ 14.318509] dhcpcd[543]: eth0: soliciting a DHCP lease3320client # [ 14.328626] dhcpcd[543]: eth0: offered 10.0.2.15 from 10.0.2.23321client # [ 14.336741] dhcpcd[543]: eth0: probing address 10.0.2.15/243322worker2 # [ 14.346499] systemd[1]: Starting Virtual Console Setup...3323lb # [ 14.428612] mousedev: PS/2 mouse device common for all mice3324client # [ 14.358808] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3325worker2 # [ 14.366396] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3326worker2 # [ 14.368310] systemd[1]: Stopped Virtual Console Setup.3327client # [ 14.368986] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3328client # [ 14.371239] systemd[1]: Stopped Virtual Console Setup.3329worker2 # [ 14.371368] systemd[1]: Starting Virtual Console Setup...3330worker1 # [ 14.389283] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3331client # [ 14.382004] systemd[1]: Starting Virtual Console Setup...3332worker1 # [ 14.418400] systemd[1]: Starting Virtual Console Setup...3333worker2 # [ 14.414794] systemd-logind[509]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3334client # [ 14.416485] systemd-logind[431]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3335worker1 # [ 14.444111] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3336worker1 # [ 14.445231] systemd[1]: Stopped Virtual Console Setup.3337worker1 # [ 14.448493] systemd[1]: Starting Virtual Console Setup...3338worker1 # [ 14.498931] systemd-logind[517]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3339lb # [ 14.581589] systemd-logind[523]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3340worker2 # [ 14.805900] systemd-vconsole-setup[698]: Configuration of first virtual console was skipped, ignoring remaining ones.3341worker2 # [ 14.812323] systemd[1]: Finished Virtual Console Setup.3342client # [ 14.812838] systemd-vconsole-setup[651]: Configuration of first virtual console was skipped, ignoring remaining ones.3343client # [ 14.816790] systemd[1]: Finished Virtual Console Setup.3344worker1 # [ 14.885468] systemd-vconsole-setup[699]: Configuration of first virtual console was skipped, ignoring remaining ones.3345worker1 # [ 14.890769] systemd[1]: Finished Virtual Console Setup.3346worker2 # [ 14.972823] dhcpcd[642]: eth0: soliciting an IPv6 router3347worker2 # [ 14.976615] dhcpcd[642]: eth0: Router Advertisement from fe80::23348worker2 # [ 14.979259] dhcpcd[642]: eth0: adding address fec0::5054:ff:fe12:3456/643349worker2 # [ 14.982228] dhcpcd[642]: eth0: adding route to fec0::/643350worker2 # [ 14.984549] dhcpcd[642]: eth0: adding default route via fe80::23351lb: (finished: waiting for unit network-addresses-eth1.service, in 1.55 seconds)3352lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3353lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.07 seconds)3354worker1: waiting for unit network-addresses-eth1.service3355worker1: waiting for the VM to finish booting3356worker1: Guest shell says: b'Spawning backdoor root shell...\n'3357worker1: connected to guest root shell3358worker1: (connecting took 0.00 seconds)3359worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3360worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.12 seconds)3361worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3362worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3363worker2: waiting for unit network-addresses-eth1.service3364worker2: waiting for the VM to finish booting3365worker2: Guest shell says: b'Spawning backdoor root shell...\n'3366worker2: connected to guest root shell3367worker2: (connecting took 0.00 seconds)3368worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3369worker1 # [ 15.339154] dhcpcd[642]: eth0: soliciting an IPv6 router3370worker1 # [ 15.343023] dhcpcd[642]: eth0: Router Advertisement from fe80::23371worker1 # [ 15.345825] dhcpcd[642]: eth0: adding address fec0::5054:ff:fe12:3456/643372worker1 # [ 15.348775] dhcpcd[642]: eth0: adding route to fec0::/643373worker1 # [ 15.351070] dhcpcd[642]: eth0: adding default route via fe80::23374worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.12 seconds)3375worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3376worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3377lb: waiting for unit niks3.service3378lb # [ 15.536960] dhcpcd[654]: eth0: soliciting a DHCP lease3379lb # [ 15.544892] dhcpcd[654]: eth0: offered 10.0.2.15 from 10.0.2.23380lb # [ 15.552270] dhcpcd[654]: eth0: probing address 10.0.2.15/243381client # [ 15.889744] dhcpcd[543]: eth0: soliciting an IPv6 router3382client # [ 15.893663] dhcpcd[543]: eth0: Router Advertisement from fe80::23383client # [ 15.896693] dhcpcd[543]: eth0: adding address fec0::5054:ff:fe12:3456/643384client # [ 15.899468] dhcpcd[543]: eth0: adding route to fec0::/643385client # [ 15.901905] dhcpcd[543]: eth0: adding default route via fe80::23386lb # [ 16.302506] postgresql-pre-start[689]: selecting default time zone ... UTC3387lb # [ 16.306919] postgresql-pre-start[689]: creating configuration files ... ok3388lb # [ 16.319275] dhcpcd[654]: eth0: soliciting an IPv6 router3389lb # [ 16.321550] dhcpcd[654]: eth0: Router Advertisement from fe80::23390lb # [ 16.323960] dhcpcd[654]: eth0: adding address fec0::5054:ff:fe12:3456/643391lb # [ 16.327721] dhcpcd[654]: eth0: adding route to fec0::/643392lb # [ 16.328736] dhcpcd[654]: eth0: adding default route via fe80::23393lb # [ 16.528513] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3394lb # [ 16.529670] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3395lb # [ 16.530641] systemd[1]: Stopped Virtual Console Setup.3396lb # [ 16.531339] systemd[1]: Stopping Virtual Console Setup...3397lb # [ 16.540839] systemd[1]: Starting Virtual Console Setup...3398lb # [ 16.567620] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3399lb # [ 16.570201] systemd[1]: Stopped Virtual Console Setup.3400lb # [ 16.580786] systemd[1]: Starting Virtual Console Setup...3401lb # [ 16.637964] systemd-logind[523]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3402lb # [ 16.861861] postgresql-pre-start[689]: running bootstrap script ... ok3403lb # [ 17.033667] systemd-vconsole-setup[790]: Configuration of first virtual console was skipped, ignoring remaining ones.3404lb # [ 17.041860] systemd[1]: Finished Virtual Console Setup.3405lb # [ 17.538745] postgresql-pre-start[689]: performing post-bootstrap initialization ... ok3406lb # [ 17.668138] postgresql-pre-start[689]: syncing data to disk ... ok3407lb # [ 17.670270] postgresql-pre-start[689]: initdb: warning: enabling "trust" authentication for local connections3408lb # [ 17.671663] postgresql-pre-start[689]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3409lb # [ 17.673957] postgresql-pre-start[689]: Success. You can now start the database server using:3410lb # [ 17.675086] postgresql-pre-start[689]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3411lb # [ 17.818111] postgres[808]: [808] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3412lb # [ 17.822515] postgres[808]: [808] LOG: listening on IPv6 address "::1", port 54323413lb # [ 17.823930] postgres[808]: [808] LOG: listening on IPv4 address "127.0.0.1", port 54323414lb # [ 17.826333] postgres[808]: [808] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3415lb # [ 17.844355] postgres[825]: [825] LOG: database system was shut down at 2026-09-20 09:33:29 GMT3416lb # [ 17.851274] postgres[808]: [808] LOG: database system is ready to accept connections3417lb # [ 17.858394] systemd[1]: Started PostgreSQL Server.3418lb # [ 17.862865] systemd[1]: Starting PostgreSQL Setup Scripts...3419lb # [ 18.090597] postgresql-setup-start[837]: CREATE DATABASE3420lb # [ 18.147332] postgresql-setup-start[842]: CREATE ROLE3421lb # [ 18.171422] postgresql-setup-start[844]: ALTER DATABASE3422lb # [ 18.177897] systemd[1]: Finished PostgreSQL Setup Scripts.3423lb # [ 18.179723] systemd[1]: Reached target PostgreSQL.3424worker2 # [ 18.708290] dhcpcd[642]: eth0: leased 10.0.2.15 for 86400 seconds3425worker2 # [ 18.711445] dhcpcd[642]: eth0: adding route to 10.0.2.0/243426worker2 # [ 18.714792] dhcpcd[642]: eth0: adding default route via 10.0.2.23427worker2 # [ 18.873690] systemd[1]: Started DHCP Client.3428worker2 # [ 18.875796] systemd[1]: Reached target Multi-User System.3429worker2 # [ 18.877164] systemd[1]: Startup finished in 940ms (kernel) + 5.533s (initrd) + 12.401s (userspace) = 18.875s.3430worker1 # [ 19.056533] dhcpcd[642]: eth0: leased 10.0.2.15 for 86400 seconds3431worker1 # [ 19.059859] dhcpcd[642]: eth0: adding route to 10.0.2.0/243432worker1 # [ 19.063118] dhcpcd[642]: eth0: adding default route via 10.0.2.23433worker1 # [ 19.220078] systemd[1]: Started DHCP Client.3434worker1 # [ 19.222111] systemd[1]: Reached target Multi-User System.3435worker1 # [ 19.223005] systemd[1]: Startup finished in 941ms (kernel) + 5.547s (initrd) + 12.733s (userspace) = 19.221s.3436client # [ 19.221342] dhcpcd[543]: eth0: leased 10.0.2.15 for 86400 seconds3437client # [ 19.225241] dhcpcd[543]: eth0: adding route to 10.0.2.0/243438client # [ 19.228665] dhcpcd[543]: eth0: adding default route via 10.0.2.23439client # [ 19.388500] systemd[1]: Started DHCP Client.3440client # [ 19.390585] systemd[1]: Reached target Multi-User System.3441client # [ 19.392426] systemd[1]: Startup finished in 946ms (kernel) + 5.545s (initrd) + 12.899s (userspace) = 19.391s.3442lb # [ 20.851174] dhcpcd[654]: eth0: leased 10.0.2.15 for 86400 seconds3443lb # [ 20.855639] dhcpcd[654]: eth0: adding route to 10.0.2.0/243444lb # [ 20.858816] dhcpcd[654]: eth0: adding default route via 10.0.2.23445lb # [ 21.020764] systemd[1]: Started DHCP Client.3446lb # [ 21.023118] systemd[1]: Reached target Network is Online.3447lb # [ 21.029016] systemd[1]: Started Envoy reverse proxy.3448lb # [ 21.036640] systemd[1]: Started mock-oidc.service.3449lb # [ 21.134706] mock-oidc-server[927]: Mock OIDC Server running3450lb # [ 21.136507] mock-oidc-server[927]: OIDC Address: 192.168.1.2:80803451lb # [ 21.138228] mock-oidc-server[927]: Issue Address: 0.0.0.0:80813452lb # [ 21.139830] mock-oidc-server[927]: Issuer: http://192.168.1.2:8080/oidc3453lb # [ 21.142107] mock-oidc-server[927]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3454lb # [ 21.144367] mock-oidc-server[927]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3455lb # [ 21.146592] mock-oidc-server[927]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3456lb # [ 21.689760] envoy[926]: [2026-09-20 09:33:33.317][926][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3457lb # [ 21.692711] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:469] statically linked extensions:3458lb # [ 21.694321] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3459lb # [ 21.696901] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3460lb # [ 21.715037] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3461lb # [ 21.720116] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3462lb # [ 21.723642] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3463lb # [ 21.727524] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3464lb # [ 21.730063] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83465lb # [ 21.731979] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3466lb # [ 21.734900] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3467lb # [ 21.766126] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3468lb # [ 21.769005] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3469lb # [ 21.777139] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3470lb # [ 21.779335] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3471lb # [ 21.781629] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3472lb # [ 21.783500] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3473lb # [ 21.790934] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3474lb # [ 21.793695] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3475lb # [ 21.796457] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3476lb # [ 21.805393] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3477lb # [ 21.807941] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3478lb # [ 21.810483] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3479lb # [ 21.815909] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3480lb # [ 21.818115] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3481lb # [ 21.824508] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3482lb # [ 21.826850] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3483lb # [ 21.829858] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3484lb # [ 21.831659] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3485lb # [ 21.834843] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3486lb # [ 21.837527] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3487lb # [ 21.840607] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3488lb # [ 21.842695] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3489lb # [ 21.851787] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3490lb # [ 21.858767] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3491lb # [ 21.862386] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3492lb # [ 21.867575] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3493lb # [ 21.870098] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3494lb # [ 21.873551] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23495lb # [ 21.875327] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3496lb # [ 21.882885] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3497lb # [ 21.886502] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3498lb # [ 21.889286] envoy[926]: [2026-09-20 09:33:33.319][926][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3499lb # [ 21.891761] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3500lb # [ 21.894768] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3501lb # [ 21.897805] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3502lb # [ 21.899701] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3503lb # [ 21.904730] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3504lb # [ 21.913120] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3505lb # [ 21.915436] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3506lb # [ 21.917679] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3507lb # [ 21.920484] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3508lb # [ 21.922952] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3509lb # [ 21.927729] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3510lb # [ 21.929926] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3511lb # [ 21.931612] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3512lb # [ 21.935685] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3513lb # [ 21.937941] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3514lb # [ 21.940662] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3515lb # [ 21.942531] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3516lb # [ 21.945313] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3517lb # [ 21.950130] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3518lb # [ 21.952205] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3519lb # [ 21.954459] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3520lb # [ 21.959575] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3521lb # [ 21.962715] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3522lb # [ 21.964591] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3523lb # [ 21.966453] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3524lb # [ 21.969502] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3525lb # [ 21.971377] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3526lb # [ 21.973320] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3527lb # [ 21.978324] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3528lb # [ 21.980373] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3529lb # [ 21.982683] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3530lb # [ 21.984826] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3531lb # [ 21.987134] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3532lb # [ 21.992866] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3533lb # [ 21.995061] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3534lb # [ 21.997580] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3535lb # [ 22.001260] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3536lb # [ 22.006228] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3537lb # [ 22.008405] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3538lb # [ 22.010422] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3539lb # [ 22.025313] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23540lb # [ 22.027141] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3541lb # [ 22.030374] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3542lb # [ 22.032487] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3543lb # [ 22.034269] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23544lb # [ 22.037219] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13545lb # [ 22.039421] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3546lb # [ 22.041479] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3547lb # [ 22.044865] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3548lb # [ 22.047700] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3549lb # [ 22.050244] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3550lb # [ 22.053256] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3551lb # [ 22.056567] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3552lb # [ 22.058397] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3553lb # [ 22.062061] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3554lb # [ 22.064346] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3555lb # [ 22.066750] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3556lb # [ 22.069085] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3557lb # [ 22.080158] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3558lb # [ 22.082183] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3559lb # [ 22.085172] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3560lb # [ 22.087040] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3561lb # [ 22.089210] envoy[926]: [2026-09-20 09:33:33.320][926][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3562lb # [ 22.091321] envoy[926]: [2026-09-20 09:33:33.338][926][info][main] [source/server/server.cc:531] HTTP header map info:3563lb # [ 22.093495] envoy[926]: [2026-09-20 09:33:33.340][926][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3564lb # [ 22.109929] envoy[926]: [2026-09-20 09:33:33.340][926][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3565lb # [ 22.111537] envoy[926]: [2026-09-20 09:33:33.340][926][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3566lb # [ 22.121100] envoy[926]: [2026-09-20 09:33:33.340][926][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3567lb # [ 22.123111] envoy[926]: [2026-09-20 09:33:33.590][926][info][main] [source/server/server.cc:968] runtime: {}3568lb # [ 22.124776] envoy[926]: [2026-09-20 09:33:33.605][926][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3569lb # [ 22.126704] envoy[926]: [2026-09-20 09:33:33.605][926][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013570lb # [ 22.128951] envoy[926]: [2026-09-20 09:33:33.605][926][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013571lb # [ 22.130688] envoy[926]: [2026-09-20 09:33:33.612][926][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3572lb # [ 22.132546] envoy[926]: [2026-09-20 09:33:33.612][926][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3573lb # [ 22.134199] envoy[926]: [2026-09-20 09:33:33.612][926][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3574lb # [ 22.154469] envoy[926]: [2026-09-20 09:33:33.782][926][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3575lb # [ 22.165929] envoy[926]: [2026-09-20 09:33:33.793][926][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3576worker2 # [ 22.112323] systemd[1]: Starting Nix worker-protocol over gRPC...3577worker1 # [ 22.124256] systemd[1]: Starting Nix worker-protocol over gRPC...3578lb # [ 22.168941] envoy[926]: [2026-09-20 09:33:33.796][926][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3579lb # [ 22.172435] envoy[926]: [2026-09-20 09:33:33.796][926][info][main] [source/server/server.cc:1077] starting main dispatch loop3580worker1 # [ 22.371116] nix-grpc-daemon[773]: ts=2026-09-20T09:33:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3581worker2 # [ 22.361830] nix-grpc-daemon[772]: ts=2026-09-20T09:33:34Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3582worker1 # [ 22.383022] nix-grpc-daemon[773]: ts=2026-09-20T09:33:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13583worker2 # [ 22.373391] nix-grpc-daemon[772]: ts=2026-09-20T09:33:34Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13584worker1 # [ 22.425628] nix-grpc-daemon[773]: ts=2026-09-20T09:33:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3585worker2 # [ 22.415649] nix-grpc-daemon[772]: ts=2026-09-20T09:33:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3586worker1 # [ 22.430228] systemd[1]: Started Nix worker-protocol over gRPC.3587worker2 # [ 22.419920] systemd[1]: Started Nix worker-protocol over gRPC.3588lb # [ 22.510621] envoy[926]: [2026-09-20 09:33:34.137][926][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3589lb # [ 22.518163] envoy[926]: [2026-09-20 09:33:34.137][926][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3590lb # [ 22.528367] envoy[926]: [2026-09-20 09:33:34.137][926][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3591lb # [ 22.540269] envoy[926]: [2026-09-20 09:33:34.137][926][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3592worker1 # [ 22.505412] nix-grpc-daemon[773]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500513593worker2 # [ 22.495244] nix-grpc-daemon[772]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500513594worker1 # [ 22.508998] nix-grpc-daemon[773]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3595worker2 # [ 22.497747] nix-grpc-daemon[772]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3596worker1 # [ 22.710417] nix-grpc-daemon[773]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500513597worker2 # [ 22.699083] nix-grpc-daemon[772]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500513598worker1 # [ 22.715887] nix-grpc-daemon[773]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3599worker2 # [ 22.704482] nix-grpc-daemon[772]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3600worker1 # [ 22.916657] nix-grpc-daemon[773]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500513601worker2 # [ 22.905223] nix-grpc-daemon[772]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500513602worker1 # [ 22.921771] nix-grpc-daemon[773]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3603worker2 # [ 22.910289] nix-grpc-daemon[772]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3604worker1 # [ 23.122401] nix-grpc-daemon[773]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500513605worker2 # [ 23.111382] nix-grpc-daemon[772]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500513606worker1 # [ 23.125121] nix-grpc-daemon[773]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3607worker2 # [ 23.120391] nix-grpc-daemon[772]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3608worker1 # [ 23.326175] nix-grpc-daemon[773]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500513609worker2 # [ 23.316372] nix-grpc-daemon[772]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:500513610worker1 # [ 23.331360] nix-grpc-daemon[773]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3611worker2 # [ 23.321152] nix-grpc-daemon[772]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3612worker2 # [ 23.519875] nix-grpc-daemon[772]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:500513613worker1 # [ 23.534518] nix-grpc-daemon[773]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:500513614worker2 # [ 23.524631] nix-grpc-daemon[772]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3615worker1 # [ 23.539175] nix-grpc-daemon[773]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3616worker2 # [ 23.720536] nix-grpc-daemon[772]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:500513617worker1 # [ 23.734691] nix-grpc-daemon[773]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:500513618worker2 # [ 23.725781] nix-grpc-daemon[772]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3619worker1 # [ 23.740128] nix-grpc-daemon[773]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3620worker2 # [ 23.926269] nix-grpc-daemon[772]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:500513621worker2 # [ 23.929061] nix-grpc-daemon[772]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3622worker1 # [ 23.941127] nix-grpc-daemon[773]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:500513623worker1 # [ 23.946216] nix-grpc-daemon[773]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3624worker2 # [ 24.130025] nix-grpc-daemon[772]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:500513625worker1 # [ 24.147045] nix-grpc-daemon[773]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:500513626worker2 # [ 24.135271] nix-grpc-daemon[772]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3627worker1 # [ 24.152350] nix-grpc-daemon[773]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3628worker2 # [ 24.336531] nix-grpc-daemon[772]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:500513629worker1 # [ 24.353514] nix-grpc-daemon[773]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:500513630worker2 # [ 24.341949] nix-grpc-daemon[772]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3631worker1 # [ 24.358649] nix-grpc-daemon[773]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3632worker2 # [ 24.544646] nix-grpc-daemon[772]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:500513633worker1 # [ 24.561057] nix-grpc-daemon[773]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:500513634worker2 # [ 24.548853] nix-grpc-daemon[772]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3635worker1 # [ 24.564986] nix-grpc-daemon[773]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3636worker2 # [ 24.745424] nix-grpc-daemon[772]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:500513637worker1 # [ 24.761718] nix-grpc-daemon[773]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:500513638worker2 # [ 24.750851] nix-grpc-daemon[772]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3639worker1 # [ 24.766868] nix-grpc-daemon[773]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3640worker2 # [ 24.951560] nix-grpc-daemon[772]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:500513641worker1 # [ 24.967761] nix-grpc-daemon[773]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:500513642worker2 # [ 24.956862] nix-grpc-daemon[772]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3643worker1 # [ 24.973016] nix-grpc-daemon[773]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3644worker2 # [ 25.157919] nix-grpc-daemon[772]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:500513645worker1 # [ 25.174120] nix-grpc-daemon[773]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:500513646worker2 # [ 25.163149] nix-grpc-daemon[772]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3647worker1 # [ 25.179263] nix-grpc-daemon[773]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3648worker2 # [ 25.364183] nix-grpc-daemon[772]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:500513649worker1 # [ 25.380144] nix-grpc-daemon[773]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:500513650worker2 # [ 25.369432] nix-grpc-daemon[772]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3651worker1 # [ 25.385264] nix-grpc-daemon[773]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3652worker2 # [ 25.572190] nix-grpc-daemon[772]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:500513653worker1 # [ 25.587852] nix-grpc-daemon[773]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:500513654worker2 # [ 25.576527] nix-grpc-daemon[772]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3655worker1 # [ 25.592221] nix-grpc-daemon[773]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3656worker2 # [ 25.773235] nix-grpc-daemon[772]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:500513657worker1 # [ 25.788984] nix-grpc-daemon[773]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:500513658worker2 # [ 25.778551] nix-grpc-daemon[772]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3659worker1 # [ 25.794317] nix-grpc-daemon[773]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3660worker2 # [ 25.979592] nix-grpc-daemon[772]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:500513661worker1 # [ 25.995496] nix-grpc-daemon[773]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:500513662worker2 # [ 25.985516] nix-grpc-daemon[772]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3663worker1 # [ 26.000890] nix-grpc-daemon[773]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3664worker2 # [ 26.186336] nix-grpc-daemon[772]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:500513665worker1 # [ 26.201800] nix-grpc-daemon[773]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:500513666worker2 # [ 26.191719] nix-grpc-daemon[772]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3667worker1 # [ 26.207299] nix-grpc-daemon[773]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3668worker2 # [ 26.392824] nix-grpc-daemon[772]: ts=2026-09-20T09:33:39Z level=info event=scheduler_connected addr=lb:500513669worker1 # [ 26.408353] nix-grpc-daemon[773]: ts=2026-09-20T09:33:39Z level=info event=scheduler_connected addr=lb:500513670worker1 # [ 26.415140] nix-grpc-daemon[773]: ts=2026-09-20T09:33:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3671worker2 # [ 26.404682] nix-grpc-daemon[772]: ts=2026-09-20T09:33:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3672worker2 # [ 26.602260] nix-grpc-daemon[772]: ts=2026-09-20T09:33:39Z level=info event=scheduler_connected addr=lb:500513673worker1 # [ 26.615558] nix-grpc-daemon[773]: ts=2026-09-20T09:33:39Z level=info event=scheduler_connected addr=lb:500513674worker2 # [ 26.606483] nix-grpc-daemon[772]: ts=2026-09-20T09:33:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3675worker1 # [ 26.619830] nix-grpc-daemon[773]: ts=2026-09-20T09:33:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3676worker2 # [ 26.803125] nix-grpc-daemon[772]: ts=2026-09-20T09:33:39Z level=info event=scheduler_connected addr=lb:500513677worker1 # [ 26.816260] nix-grpc-daemon[773]: ts=2026-09-20T09:33:39Z level=info event=scheduler_connected addr=lb:500513678worker2 # [ 26.808709] nix-grpc-daemon[772]: ts=2026-09-20T09:33:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3679worker1 # [ 26.821141] nix-grpc-daemon[773]: ts=2026-09-20T09:33:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3680worker1 # [ 27.018085] nix-grpc-daemon[773]: ts=2026-09-20T09:33:39Z level=info event=scheduler_connected addr=lb:500513681worker2 # [ 27.009595] nix-grpc-daemon[772]: ts=2026-09-20T09:33:39Z level=info event=scheduler_connected addr=lb:500513682worker1 # [ 27.023481] nix-grpc-daemon[773]: ts=2026-09-20T09:33:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3683worker2 # [ 27.014702] nix-grpc-daemon[772]: ts=2026-09-20T09:33:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3684worker1 # [ 27.224515] nix-grpc-daemon[773]: ts=2026-09-20T09:33:39Z level=info event=scheduler_connected addr=lb:500513685worker2 # [ 27.215646] nix-grpc-daemon[772]: ts=2026-09-20T09:33:39Z level=info event=scheduler_connected addr=lb:500513686worker1 # [ 27.229820] nix-grpc-daemon[773]: ts=2026-09-20T09:33:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3687worker2 # [ 27.220992] nix-grpc-daemon[772]: ts=2026-09-20T09:33:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3688worker1 # [ 27.430733] nix-grpc-daemon[773]: ts=2026-09-20T09:33:40Z level=info event=scheduler_connected addr=lb:500513689worker2 # [ 27.421807] nix-grpc-daemon[772]: ts=2026-09-20T09:33:40Z level=info event=scheduler_connected addr=lb:500513690worker1 # [ 27.436218] nix-grpc-daemon[773]: ts=2026-09-20T09:33:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3691worker2 # [ 27.427103] nix-grpc-daemon[772]: ts=2026-09-20T09:33:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3692worker1 # [ 27.639069] nix-grpc-daemon[773]: ts=2026-09-20T09:33:40Z level=info event=scheduler_connected addr=lb:500513693worker2 # [ 27.629777] nix-grpc-daemon[772]: ts=2026-09-20T09:33:40Z level=info event=scheduler_connected addr=lb:500513694worker1 # [ 27.643476] nix-grpc-daemon[773]: ts=2026-09-20T09:33:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3695worker2 # [ 27.633951] nix-grpc-daemon[772]: ts=2026-09-20T09:33:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3696worker1 # [ 27.839591] nix-grpc-daemon[773]: ts=2026-09-20T09:33:40Z level=info event=scheduler_connected addr=lb:500513697worker2 # [ 27.830309] nix-grpc-daemon[772]: ts=2026-09-20T09:33:40Z level=info event=scheduler_connected addr=lb:500513698worker1 # [ 27.845265] nix-grpc-daemon[773]: ts=2026-09-20T09:33:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3699worker2 # [ 27.835214] nix-grpc-daemon[772]: ts=2026-09-20T09:33:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3700worker2 # [ 28.032275] nix-grpc-daemon[772]: ts=2026-09-20T09:33:40Z level=info event=scheduler_connected addr=lb:500513701worker1 # [ 28.046203] nix-grpc-daemon[773]: ts=2026-09-20T09:33:40Z level=info event=scheduler_connected addr=lb:500513702worker2 # [ 28.037390] nix-grpc-daemon[772]: ts=2026-09-20T09:33:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3703worker1 # [ 28.051213] nix-grpc-daemon[773]: ts=2026-09-20T09:33:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3704worker2 # [ 28.238366] nix-grpc-daemon[772]: ts=2026-09-20T09:33:40Z level=info event=scheduler_connected addr=lb:500513705worker1 # [ 28.252104] nix-grpc-daemon[773]: ts=2026-09-20T09:33:40Z level=info event=scheduler_connected addr=lb:500513706worker2 # [ 28.243723] nix-grpc-daemon[772]: ts=2026-09-20T09:33:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3707worker1 # [ 28.257332] nix-grpc-daemon[773]: ts=2026-09-20T09:33:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3708worker2 # [ 28.444779] nix-grpc-daemon[772]: ts=2026-09-20T09:33:41Z level=info event=scheduler_connected addr=lb:500513709worker1 # [ 28.458371] nix-grpc-daemon[773]: ts=2026-09-20T09:33:41Z level=info event=scheduler_connected addr=lb:500513710worker2 # [ 28.450204] nix-grpc-daemon[772]: ts=2026-09-20T09:33:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3711worker1 # [ 28.463621] nix-grpc-daemon[773]: ts=2026-09-20T09:33:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3712worker2 # [ 28.653112] nix-grpc-daemon[772]: ts=2026-09-20T09:33:41Z level=info event=scheduler_connected addr=lb:500513713worker1 # [ 28.666708] nix-grpc-daemon[773]: ts=2026-09-20T09:33:41Z level=info event=scheduler_connected addr=lb:500513714worker2 # [ 28.657381] nix-grpc-daemon[772]: ts=2026-09-20T09:33:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3715worker1 # [ 28.671034] nix-grpc-daemon[773]: ts=2026-09-20T09:33:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3716worker2 # [ 28.854332] nix-grpc-daemon[772]: ts=2026-09-20T09:33:41Z level=info event=scheduler_connected addr=lb:500513717worker1 # [ 28.867343] nix-grpc-daemon[773]: ts=2026-09-20T09:33:41Z level=info event=scheduler_connected addr=lb:500513718worker2 # [ 28.860311] nix-grpc-daemon[772]: ts=2026-09-20T09:33:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3719worker1 # [ 28.873467] nix-grpc-daemon[773]: ts=2026-09-20T09:33:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3720worker2 # [ 29.060877] nix-grpc-daemon[772]: ts=2026-09-20T09:33:41Z level=info event=scheduler_connected addr=lb:500513721worker1 # [ 29.074136] nix-grpc-daemon[773]: ts=2026-09-20T09:33:41Z level=info event=scheduler_connected addr=lb:500513722worker2 # [ 29.066270] nix-grpc-daemon[772]: ts=2026-09-20T09:33:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3723worker1 # [ 29.079518] nix-grpc-daemon[773]: ts=2026-09-20T09:33:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3724worker2 # [ 29.267161] nix-grpc-daemon[772]: ts=2026-09-20T09:33:41Z level=info event=scheduler_connected addr=lb:500513725worker1 # [ 29.280617] nix-grpc-daemon[773]: ts=2026-09-20T09:33:41Z level=info event=scheduler_connected addr=lb:500513726worker2 # [ 29.272773] nix-grpc-daemon[772]: ts=2026-09-20T09:33:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3727worker1 # [ 29.285842] nix-grpc-daemon[773]: ts=2026-09-20T09:33:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3728worker2 # [ 29.473792] nix-grpc-daemon[772]: ts=2026-09-20T09:33:42Z level=info event=scheduler_connected addr=lb:500513729worker1 # [ 29.486596] nix-grpc-daemon[773]: ts=2026-09-20T09:33:42Z level=info event=scheduler_connected addr=lb:500513730worker2 # [ 29.479382] nix-grpc-daemon[772]: ts=2026-09-20T09:33:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3731worker1 # [ 29.491947] nix-grpc-daemon[773]: ts=2026-09-20T09:33:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3732worker1 # [ 29.694809] nix-grpc-daemon[773]: ts=2026-09-20T09:33:42Z level=info event=scheduler_connected addr=lb:500513733worker2 # [ 29.683186] nix-grpc-daemon[772]: ts=2026-09-20T09:33:42Z level=info event=scheduler_connected addr=lb:500513734worker2 # [ 29.687920] nix-grpc-daemon[772]: ts=2026-09-20T09:33:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3735worker1 # [ 29.700633] nix-grpc-daemon[773]: ts=2026-09-20T09:33:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3736worker2 # [ 29.883365] nix-grpc-daemon[772]: ts=2026-09-20T09:33:42Z level=info event=scheduler_connected addr=lb:500513737worker1 # [ 29.895151] nix-grpc-daemon[773]: ts=2026-09-20T09:33:42Z level=info event=scheduler_connected addr=lb:500513738worker2 # [ 29.888904] nix-grpc-daemon[772]: ts=2026-09-20T09:33:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3739worker1 # [ 29.900645] nix-grpc-daemon[773]: ts=2026-09-20T09:33:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3740worker1 # [ 30.101435] nix-grpc-daemon[773]: ts=2026-09-20T09:33:42Z level=info event=scheduler_connected addr=lb:500513741worker2 # [ 30.089881] nix-grpc-daemon[772]: ts=2026-09-20T09:33:42Z level=info event=scheduler_connected addr=lb:500513742worker1 # [ 30.106818] nix-grpc-daemon[773]: ts=2026-09-20T09:33:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3743worker2 # [ 30.095222] nix-grpc-daemon[772]: ts=2026-09-20T09:33:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3744worker2 # [ 30.296113] nix-grpc-daemon[772]: ts=2026-09-20T09:33:42Z level=info event=scheduler_connected addr=lb:500513745worker1 # [ 30.307688] nix-grpc-daemon[773]: ts=2026-09-20T09:33:42Z level=info event=scheduler_connected addr=lb:500513746worker2 # [ 30.301367] nix-grpc-daemon[772]: ts=2026-09-20T09:33:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3747worker1 # [ 30.313892] nix-grpc-daemon[773]: ts=2026-09-20T09:33:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3748worker2 # [ 30.502324] nix-grpc-daemon[772]: ts=2026-09-20T09:33:43Z level=info event=scheduler_connected addr=lb:500513749worker1 # [ 30.514161] nix-grpc-daemon[773]: ts=2026-09-20T09:33:43Z level=info event=scheduler_connected addr=lb:500513750worker2 # [ 30.508703] nix-grpc-daemon[772]: ts=2026-09-20T09:33:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3751worker1 # [ 30.519657] nix-grpc-daemon[773]: ts=2026-09-20T09:33:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3752worker1 # [ 30.722192] nix-grpc-daemon[773]: ts=2026-09-20T09:33:43Z level=info event=scheduler_connected addr=lb:500513753worker2 # [ 30.711076] nix-grpc-daemon[772]: ts=2026-09-20T09:33:43Z level=info event=scheduler_connected addr=lb:500513754worker2 # [ 30.715327] nix-grpc-daemon[772]: ts=2026-09-20T09:33:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3755worker1 # [ 30.727005] nix-grpc-daemon[773]: ts=2026-09-20T09:33:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3756worker2 # [ 30.911880] nix-grpc-daemon[772]: ts=2026-09-20T09:33:43Z level=info event=scheduler_connected addr=lb:500513757worker1 # [ 30.927912] nix-grpc-daemon[773]: ts=2026-09-20T09:33:43Z level=info event=scheduler_connected addr=lb:500513758worker2 # [ 30.917214] nix-grpc-daemon[772]: ts=2026-09-20T09:33:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3759worker1 # [ 30.933124] nix-grpc-daemon[773]: ts=2026-09-20T09:33:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3760lb # [ 31.118160] rustfs-bucket-start[1026]: mb s3://farm3761lb # [ 31.130164] systemd[1]: Finished rustfs-bucket.service.3762lb # [ 31.143885] systemd[1]: Starting niks3 server...3763worker2 # [ 31.117907] nix-grpc-daemon[772]: ts=2026-09-20T09:33:43Z level=info event=scheduler_connected addr=lb:500513764worker1 # [ 31.134156] nix-grpc-daemon[773]: ts=2026-09-20T09:33:43Z level=info event=scheduler_connected addr=lb:500513765worker2 # [ 31.123168] nix-grpc-daemon[772]: ts=2026-09-20T09:33:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3766worker1 # [ 31.139286] nix-grpc-daemon[773]: ts=2026-09-20T09:33:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3767lb # [ 31.380795] postgres[1046]: [1046] ERROR: relation "goose_db_version" does not exist at character 363768lb # [ 31.383250] postgres[1046]: [1046] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3769worker2 # [ 31.324289] nix-grpc-daemon[772]: ts=2026-09-20T09:33:43Z level=info event=scheduler_connected addr=lb:500513770worker1 # [ 31.340394] nix-grpc-daemon[773]: ts=2026-09-20T09:33:43Z level=info event=scheduler_connected addr=lb:500513771worker2 # [ 31.329646] nix-grpc-daemon[772]: ts=2026-09-20T09:33:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3772worker1 # [ 31.345472] nix-grpc-daemon[773]: ts=2026-09-20T09:33:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3773lb # [ 31.418498] niks3-server[1037]: 2026/09/20 09:33:43 OK 20241026095416_initial_model.sql (21.18ms)3774lb # [ 31.422008] niks3-server[1037]: 2026/09/20 09:33:43 OK 20251210153512_drop_unused_gin_index.sql (1.86ms)3775lb # [ 31.427172] niks3-server[1037]: 2026/09/20 09:33:43 OK 20251218171726_add_pins.sql (5.11ms)3776lb # [ 31.431853] niks3-server[1037]: 2026/09/20 09:33:43 OK 20260628120000_add_object_size_and_stats.sql (4.62ms)3777lb # [ 31.437166] niks3-server[1037]: 2026/09/20 09:33:43 OK 20260905000000_add_claims.sql (5.28ms)3778lb # [ 31.441624] niks3-server[1037]: 2026/09/20 09:33:43 OK 20260920000000_drop_claims.sql (4.35ms)3779lb # [ 31.442840] niks3-server[1037]: 2026/09/20 09:33:43 goose: successfully migrated database to version: 202609200000003780lb # [ 31.447784] niks3-server[1037]: 2026/09/20 09:33:43 OK 1_commit_pending_closure.sql (6.1ms)3781lb # [ 31.450665] niks3-server[1037]: 2026/09/20 09:33:43 OK 2_object_stats_trigger.sql (2.76ms)3782lb # [ 31.452105] niks3-server[1037]: 2026/09/20 09:33:43 goose: up to current file version: 23783lb # [ 31.455943] niks3-server[1037]: 2026/09/20 09:33:43 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3784lb # [ 31.499142] niks3-server[1037]: 2026/09/20 09:33:43 INFO Read proxy enabled — serving cache objects from S33785lb # [ 31.501506] niks3-server[1037]: 2026/09/20 09:33:43 INFO Using socket-activated listener address=0.0.0.0:57513786lb # [ 31.505691] niks3-server[1037]: 2026/09/20 09:33:43 INFO systemd watchdog enabled interval=15s3787lb # [ 31.506926] systemd[1]: Started niks3 server.3788lb # [ 31.509377] systemd[1]: Reached target Multi-User System.3789lb # [ 31.511980] niks3-server[1037]: 2026/09/20 09:33:43 INFO Starting HTTP server address=0.0.0.0:57513790lb # [ 31.514168] systemd[1]: Startup finished in 943ms (kernel) + 4.648s (initrd) + 25.916s (userspace) = 31.508s.3791lb # [ 31.518718] niks3-server[1037]: 2026/09/20 09:33:43 INFO lead: acquired remote=192.168.1.3:463503792worker1 # [ 31.474737] nix-grpc-daemon[773]: ts=2026-09-20T09:33:44Z level=info event=scheduler_take_over3793worker2 # [ 31.530182] nix-grpc-daemon[772]: ts=2026-09-20T09:33:44Z level=info event=scheduler_connected addr=lb:500513794worker1 # [ 31.546150] nix-grpc-daemon[773]: ts=2026-09-20T09:33:44Z level=info event=scheduler_connected addr=lb:500513795worker1 # [ 31.560679] nix-grpc-daemon[773]: ts=2026-09-20T09:33:44Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03796worker1 # [ 31.566677] nix-grpc-daemon[773]: ts=2026-09-20T09:33:44Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03797lb: (finished: waiting for unit niks3.service, in 16.90 seconds)3798lb: waiting for TCP port 5751 on localhost3799lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3800lb: (finished: waiting for TCP port 5751 on localhost, in 0.10 seconds)3801lb: waiting for unit envoy.service3802lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3803lb: waiting for TCP port 50051 on localhost3804lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3805lb # [ 32.561490] envoy[926]: conn peer=[::1]:47686 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33806lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds)3807lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3808lb: must succeed: curl -sf localhost:9901/clusters3809lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)3810lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds)3811subtest: one node schedules and both builders hold a WorkerSession on it3812lb: must succeed: curl -sf localhost:9901/clusters3813lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3814worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true3815worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)3816(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.15 seconds)3817subtest: balancer auth: client cert, bearer token, nothing, unknown CN3818worker1 # [ 33.323933] nix-grpc-daemon[773]: ts=2026-09-20T09:33:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:362423819worker1 # [ 33.341282] systemd[1]: Started Nix Daemon.3820worker1 # [ 33.620941] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3821worker1 # [ 33.662206] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 1/5)3822worker1 # [ 33.702354] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 64 ms (attempt 2/5)3823worker1 # [ 33.771888] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 3/5)3824worker1 # [ 33.790503] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 676 ms (attempt 4/5)3825worker1 # [ 34.470039] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3826worker2 # [ 34.501101] nix-grpc-daemon[772]: ts=2026-09-20T09:33:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:606943827worker2 # [ 34.519234] systemd[1]: Started Nix Daemon.3828worker2 # [ 34.801623] nix-daemon[830]: accepted connection from pid 772, user nix-grpc-daemon (trusted)3829worker2 # [ 34.828144] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 1/5)3830worker2 # [ 34.892727] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 66 ms (attempt 2/5)3831worker2 # [ 34.959089] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 111 ms (attempt 3/5)3832worker2 # [ 35.077869] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 348 ms (attempt 4/5)3833worker2 # [ 35.435570] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3834worker2 # [ 35.451616] nix-grpc-daemon[772]: ts=2026-09-20T09:33:48Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3835worker2 # [ 35.465110] nix-grpc-daemon[772]: ts=2026-09-20T09:33:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:606943836worker2 # [ 35.477820] nix-grpc-daemon[772]: ts=2026-09-20T09:33:48Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3837client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3838client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.11 seconds)3839client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3840client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3841worker2 # [ 35.929344] nix-grpc-daemon[772]: ts=2026-09-20T09:33:48Z level=info event=oidc_jwks provider=mock keys=13842worker2 # [ 35.935496] nix-grpc-daemon[772]: ts=2026-09-20T09:33:48Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:606943843worker1 # [ 35.977225] nix-grpc-daemon[773]: ts=2026-09-20T09:33:48Z level=info event=oidc_jwks provider=mock keys=13844worker1 # [ 35.983350] nix-grpc-daemon[773]: ts=2026-09-20T09:33:48Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:362423845worker1 # [ 35.996119] nix-grpc-daemon[773]: ts=2026-09-20T09:33:48Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3846worker2 # [ 36.001638] nix-grpc-daemon[772]: ts=2026-09-20T09:33:48Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:606943847worker2 # [ 36.014061] nix-grpc-daemon[772]: ts=2026-09-20T09:33:48Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3848client: must succeed: rm -r /var/lib/nix-grpc-store3849client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds)3850worker1 # [ 38.344336] nix-grpc-daemon[773]: ts=2026-09-20T09:33:50Z level=info event=denied method=QueryMissing cn=- role=none3851worker2 # [ 38.577649] nix-grpc-daemon[772]: ts=2026-09-20T09:33:51Z level=info event=denied method=QueryMissing cn=stranger role=none3852(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.68 seconds)3853subtest: DAG build is scheduled across workers and lands in the cache3854client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23855worker1 # [ 38.829880] nix-grpc-daemon[773]: ts=2026-09-20T09:33:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:362423856client # don't know how to build these paths:3857client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3858worker2 # [ 38.828723] nix-grpc-daemon[772]: ts=2026-09-20T09:33:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:606943859worker1 # [ 38.878145] nix-grpc-daemon[773]: ts=2026-09-20T09:33:51Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03860worker1 # [ 38.885496] nix-grpc-daemon[773]: ts=2026-09-20T09:33:51Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13861worker1 # [ 38.928225] nix-grpc-daemon[773]: ts=2026-09-20T09:33:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362423862worker1 # [ 38.947991] nix-grpc-daemon[773]: ts=2026-09-20T09:33:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362423863client # copying 1 paths to 'lb:50051'...3864worker1 # [ 38.964092] nix-grpc-daemon[773]: ts=2026-09-20T09:33:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:362423865client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3866worker1 # [ 38.995293] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3867worker1 # [ 39.028742] nix-grpc-daemon[773]: ts=2026-09-20T09:33:51Z level=info event=niks3_push_started pid=8483868worker1 # [ 39.488696] nix-daemon[836]: accepted connection from pid 861, user nix-grpc-daemon (trusted)3869worker1 # [ 39.507715] nix-daemon[836]: reaped child process 864, status = succeeded3870worker1 # [ 39.691047] nix-daemon[836]: accepted connection from pid 866, user nix-grpc-daemon (trusted)3871worker1 # [ 39.718258] nix-daemon[836]: reaped child process 869, status = succeeded3872lb # [ 39.777822] niks3-server[1037]: 2026/09/20 09:33:51 INFO Received uploads request method=POST path=/api/pending_closures3873worker1 # [ 39.758516] nix-grpc-daemon[848]: time=2026-09-20T09:33:52.386Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3874worker1 # [ 39.759994] nix-grpc-daemon[848]: time=2026-09-20T09:33:52.386Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3875lb # [ 39.852186] niks3-server[1037]: 2026/09/20 09:33:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3876lb # [ 39.862323] niks3-server[1037]: 2026/09/20 09:33:51 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3877lb # [ 39.891527] niks3-server[1037]: 2026/09/20 09:33:51 INFO Signed narinfos id=1 count=13878worker1 # [ 39.850403] nix-grpc-daemon[848]: time=2026-09-20T09:33:52.479Z level=INFO msg="Uploading 1 narinfos"3879lb # [ 39.907068] niks3-server[1037]: 2026/09/20 09:33:51 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3880lb # [ 39.915220] niks3-server[1037]: 2026/09/20 09:33:51 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3881lb # [ 39.918012] niks3-server[1037]: 2026/09/20 09:33:51 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3882lb # [ 39.927711] niks3-server[1037]: 2026/09/20 09:33:51 INFO Completed upload id=13883worker1 # [ 39.882914] nix-grpc-daemon[848]: time=2026-09-20T09:33:52.512Z level=INFO msg="Upload complete. (577ms)"3884worker1 # [ 39.897236] nix-grpc-daemon[773]: ts=2026-09-20T09:33:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=0 paths=1 nar_bytes_in=5043885worker1 # [ 39.908726] nix-grpc-daemon[773]: ts=2026-09-20T09:33:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362423886worker1 # [ 39.922658] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3887worker1 # [ 39.932172] nix-daemon[836]: reaped child process 846, status = succeeded3888client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3889client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3890worker1 # [ 39.939596] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3891client # farm-a> LOG-farm-a-t13892worker1 # [ 40.782592] nix-daemon[836]: reaped child process 874, status = succeeded3893worker1 # [ 40.969157] nix-daemon[836]: accepted connection from pid 890, user nix-grpc-daemon (trusted)3894worker1 # [ 40.986760] nix-daemon[836]: reaped child process 893, status = succeeded3895lb # [ 41.046298] niks3-server[1037]: 2026/09/20 09:33:52 INFO Received uploads request method=POST path=/api/pending_closures3896worker1 # [ 41.015272] nix-grpc-daemon[848]: time=2026-09-20T09:33:53.643Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3897worker1 # [ 41.018193] nix-grpc-daemon[848]: time=2026-09-20T09:33:53.643Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3898lb # [ 41.104158] niks3-server[1037]: 2026/09/20 09:33:52 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3899lb # [ 41.113239] niks3-server[1037]: 2026/09/20 09:33:52 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3900worker1 # [ 41.075757] nix-grpc-daemon[848]: time=2026-09-20T09:33:53.705Z level=INFO msg="Uploading 1 narinfos"3901lb # [ 41.122817] niks3-server[1037]: 2026/09/20 09:33:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3902lb # [ 41.127283] niks3-server[1037]: 2026/09/20 09:33:52 INFO Signed narinfos id=2 count=13903lb # [ 41.130884] niks3-server[1037]: 2026/09/20 09:33:52 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3904lb # [ 41.140564] niks3-server[1037]: 2026/09/20 09:33:52 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3905lb # [ 41.150873] niks3-server[1037]: 2026/09/20 09:33:52 INFO Completed upload id=23906worker1 # [ 41.105901] nix-grpc-daemon[848]: time=2026-09-20T09:33:53.735Z level=INFO msg="Upload complete. (352ms)"3907lb # [ 41.153981] niks3-server[1037]: 2026/09/20 09:33:52 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3908worker1 # [ 41.130243] nix-grpc-daemon[773]: ts=2026-09-20T09:33:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13909worker1 # [ 41.147540] nix-grpc-daemon[773]: ts=2026-09-20T09:33:53Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03910worker1 # [ 41.152734] nix-grpc-daemon[773]: ts=2026-09-20T09:33:53Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13911worker1 # [ 41.157639] nix-daemon[836]: reaped child process 872, status = succeeded3912worker1 # [ 41.181476] nix-grpc-daemon[773]: ts=2026-09-20T09:33:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362423913worker1 # [ 41.197851] nix-grpc-daemon[773]: ts=2026-09-20T09:33:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362423914worker1 # [ 41.214897] nix-grpc-daemon[848]: time=2026-09-20T09:33:53.844Z level=INFO msg="All 1 paths already cached"3915client # copying 1 paths to 'lb:50051'...3916worker1 # [ 41.223871] nix-grpc-daemon[773]: ts=2026-09-20T09:33:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:362423917client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3918worker1 # [ 41.247160] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3919worker1 # [ 41.455900] nix-daemon[836]: accepted connection from pid 899, user nix-grpc-daemon (trusted)3920worker1 # [ 41.474008] nix-daemon[836]: reaped child process 902, status = succeeded3921worker1 # [ 41.646386] nix-daemon[836]: accepted connection from pid 904, user nix-grpc-daemon (trusted)3922worker1 # [ 41.663215] nix-daemon[836]: reaped child process 907, status = succeeded3923lb # [ 41.719278] niks3-server[1037]: 2026/09/20 09:33:53 INFO Received uploads request method=POST path=/api/pending_closures3924worker1 # [ 41.688393] nix-grpc-daemon[848]: time=2026-09-20T09:33:54.318Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3925worker1 # [ 41.689871] nix-grpc-daemon[848]: time=2026-09-20T09:33:54.318Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3926lb # [ 41.754351] niks3-server[1037]: 2026/09/20 09:33:53 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3927worker1 # [ 41.726019] nix-grpc-daemon[848]: time=2026-09-20T09:33:54.355Z level=INFO msg="Uploading 1 narinfos"3928lb # [ 41.774670] niks3-server[1037]: 2026/09/20 09:33:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3929lb # [ 41.783656] niks3-server[1037]: 2026/09/20 09:33:53 INFO Signed narinfos id=3 count=13930lb # [ 41.788263] niks3-server[1037]: 2026/09/20 09:33:53 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3931lb # [ 41.799337] niks3-server[1037]: 2026/09/20 09:33:53 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3932lb # [ 41.805429] niks3-server[1037]: 2026/09/20 09:33:53 INFO Completed upload id=33933worker1 # [ 41.760336] nix-grpc-daemon[848]: time=2026-09-20T09:33:54.390Z level=INFO msg="Upload complete. (495ms)"3934lb # [ 41.808324] niks3-server[1037]: 2026/09/20 09:33:53 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3935worker1 # [ 41.768152] nix-grpc-daemon[773]: ts=2026-09-20T09:33:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=0 paths=1 nar_bytes_in=6243936worker1 # [ 41.782514] nix-grpc-daemon[773]: ts=2026-09-20T09:33:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362423937worker1 # [ 41.790527] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3938worker1 # [ 41.795862] nix-daemon[836]: reaped child process 897, status = succeeded3939client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3940worker1 # [ 41.808175] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3941client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3942lb # [ 42.161381] envoy[926]: conn peer=[2001:db8:1::1]:57974 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=22173943lb # [ 42.166664] envoy[926]: conn peer=[2001:db8:1::1]:57988 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=1133944lb # [ 42.171310] envoy[926]: conn peer=[2001:db8:1::1]:57990 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=123945lb # [ 42.175812] envoy[926]: conn peer=[2001:db8:1::1]:58002 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=133946client # farm-b> LOG-farm-b-t13947worker1 # [ 43.052693] nix-daemon[836]: reaped child process 911, status = succeeded3948worker1 # [ 43.204958] nix-daemon[836]: accepted connection from pid 926, user nix-grpc-daemon (trusted)3949worker1 # [ 43.222457] nix-daemon[836]: reaped child process 930, status = succeeded3950lb # [ 43.281732] niks3-server[1037]: 2026/09/20 09:33:54 INFO Received uploads request method=POST path=/api/pending_closures3951worker1 # [ 43.246212] nix-grpc-daemon[848]: time=2026-09-20T09:33:55.875Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3952worker1 # [ 43.247692] nix-grpc-daemon[848]: time=2026-09-20T09:33:55.875Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3953lb # [ 43.315446] niks3-server[1037]: 2026/09/20 09:33:54 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3954lb # [ 43.328392] niks3-server[1037]: 2026/09/20 09:33:54 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3955lb # [ 43.336232] niks3-server[1037]: 2026/09/20 09:33:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3956worker1 # [ 43.295922] nix-grpc-daemon[848]: time=2026-09-20T09:33:55.925Z level=INFO msg="Uploading 1 narinfos"3957lb # [ 43.346508] niks3-server[1037]: 2026/09/20 09:33:54 INFO Signed narinfos id=4 count=13958lb # [ 43.351073] niks3-server[1037]: 2026/09/20 09:33:54 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3959lb # [ 43.357495] niks3-server[1037]: 2026/09/20 09:33:54 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3960lb # [ 43.363697] niks3-server[1037]: 2026/09/20 09:33:54 INFO Completed upload id=43961worker1 # [ 43.318151] nix-grpc-daemon[848]: time=2026-09-20T09:33:55.948Z level=INFO msg="Upload complete. (298ms)"3962lb # [ 43.366266] niks3-server[1037]: 2026/09/20 09:33:54 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3963worker1 # [ 43.331243] nix-grpc-daemon[773]: ts=2026-09-20T09:33:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13964worker1 # [ 43.348827] nix-grpc-daemon[773]: ts=2026-09-20T09:33:55Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03965worker1 # [ 43.353336] nix-grpc-daemon[773]: ts=2026-09-20T09:33:55Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=13966worker1 # [ 43.357155] nix-daemon[836]: reaped child process 909, status = succeeded3967worker1 # [ 43.387853] nix-grpc-daemon[773]: ts=2026-09-20T09:33:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362423968worker1 # [ 43.410390] nix-grpc-daemon[773]: ts=2026-09-20T09:33:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362423969worker1 # [ 43.425219] nix-grpc-daemon[848]: time=2026-09-20T09:33:56.055Z level=INFO msg="All 2 paths already cached"3970client # copying 1 paths to 'lb:50051'...3971worker1 # [ 43.435698] nix-grpc-daemon[773]: ts=2026-09-20T09:33:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:362423972client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3973worker1 # [ 43.459064] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3974worker1 # [ 43.664036] nix-daemon[836]: accepted connection from pid 936, user nix-grpc-daemon (trusted)3975worker1 # [ 43.683813] nix-daemon[836]: reaped child process 939, status = succeeded3976worker1 # [ 43.856136] nix-daemon[836]: accepted connection from pid 941, user nix-grpc-daemon (trusted)3977worker1 # [ 43.874874] nix-daemon[836]: reaped child process 944, status = succeeded3978lb # [ 43.930870] niks3-server[1037]: 2026/09/20 09:33:55 INFO Received uploads request method=POST path=/api/pending_closures3979worker1 # [ 43.896707] nix-grpc-daemon[848]: time=2026-09-20T09:33:56.526Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3980worker1 # [ 43.898296] nix-grpc-daemon[848]: time=2026-09-20T09:33:56.526Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3981lb # [ 43.959611] niks3-server[1037]: 2026/09/20 09:33:55 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3982worker1 # [ 43.928032] nix-grpc-daemon[848]: time=2026-09-20T09:33:56.557Z level=INFO msg="Uploading 1 narinfos"3983lb # [ 43.975352] niks3-server[1037]: 2026/09/20 09:33:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3984lb # [ 43.983538] niks3-server[1037]: 2026/09/20 09:33:55 INFO Signed narinfos id=5 count=13985lb # [ 43.994503] niks3-server[1037]: 2026/09/20 09:33:55 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3986lb # [ 44.001417] niks3-server[1037]: 2026/09/20 09:33:55 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3987lb # [ 44.004418] niks3-server[1037]: 2026/09/20 09:33:55 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3988lb # [ 44.007694] niks3-server[1037]: 2026/09/20 09:33:55 INFO Completed upload id=53989worker1 # [ 43.962521] nix-grpc-daemon[848]: time=2026-09-20T09:33:56.592Z level=INFO msg="Upload complete. (485ms)"3990worker1 # [ 43.969881] nix-grpc-daemon[773]: ts=2026-09-20T09:33:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=0 paths=1 nar_bytes_in=7523991worker1 # [ 43.983715] nix-grpc-daemon[773]: ts=2026-09-20T09:33:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362423992worker1 # [ 43.991064] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3993worker1 # [ 43.995678] nix-daemon[836]: reaped child process 934, status = succeeded3994client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3995client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3996worker1 # [ 44.009086] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)3997client # farm-top> LOG-farm-top-t13998worker1 # [ 45.653739] nix-daemon[836]: reaped child process 948, status = succeeded3999worker1 # [ 45.840673] nix-daemon[836]: accepted connection from pid 963, user nix-grpc-daemon (trusted)4000worker1 # [ 45.860445] nix-daemon[836]: reaped child process 966, status = succeeded4001lb # [ 45.917650] niks3-server[1037]: 2026/09/20 09:33:57 INFO Received uploads request method=POST path=/api/pending_closures4002worker1 # [ 45.884419] nix-grpc-daemon[848]: time=2026-09-20T09:33:58.512Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4003worker1 # [ 45.885947] nix-grpc-daemon[848]: time=2026-09-20T09:33:58.512Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4004lb # [ 45.958635] niks3-server[1037]: 2026/09/20 09:33:57 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4005lb # [ 45.970472] niks3-server[1037]: 2026/09/20 09:33:57 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4006worker1 # [ 45.937931] nix-grpc-daemon[848]: time=2026-09-20T09:33:58.567Z level=INFO msg="Uploading 1 narinfos"4007lb # [ 45.984150] niks3-server[1037]: 2026/09/20 09:33:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4008lb # [ 45.987387] niks3-server[1037]: 2026/09/20 09:33:57 INFO Signed narinfos id=6 count=14009worker1 # [ 45.953965] nix-grpc-daemon[848]: time=2026-09-20T09:33:58.583Z level=INFO msg="Upload complete. (333ms)"4010lb # [ 45.999620] niks3-server[1037]: 2026/09/20 09:33:57 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4011lb # [ 46.003294] niks3-server[1037]: 2026/09/20 09:33:57 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4012lb # [ 46.007132] niks3-server[1037]: 2026/09/20 09:33:57 INFO Completed upload id=64013lb # [ 46.009312] niks3-server[1037]: 2026/09/20 09:33:57 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4014worker1 # [ 45.965609] nix-grpc-daemon[773]: ts=2026-09-20T09:33:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14015worker1 # [ 45.982824] nix-daemon[836]: reaped child process 946, status = succeeded4016client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.41 seconds)4017client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4018client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds)4019client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4020client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.02 seconds)4021client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4022client # copying 3 paths...4023client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4024client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4025client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4026client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds)4027(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.10 seconds)4028subtest: repeat is answered Cached by the scheduler without building4029worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4030worker1 # finding garbage collector roots...4031worker1 # deleting specified paths...4032worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4033worker1 # deleting unused links...4034worker1 # note: hard linking is currently saving 0.0 KiB4035worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds)4036worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4037worker2 # finding garbage collector roots...4038worker2 # deleting specified paths...4039worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4040worker2 # deleting unused links...4041worker2 # note: hard linking is currently saving 0.0 KiB4042worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)4043client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24044worker2 # [ 47.534112] nix-grpc-daemon[772]: ts=2026-09-20T09:34:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:606944045client # don't know how to build these paths:4046client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4047worker1 # [ 47.559505] nix-grpc-daemon[773]: ts=2026-09-20T09:34:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362424048worker1 # [ 47.571081] nix-grpc-daemon[848]: time=2026-09-20T09:34:00.200Z level=INFO msg="All 2 paths already cached"4049worker1 # [ 47.589404] nix-grpc-daemon[773]: ts=2026-09-20T09:34:00Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14050client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.33 seconds)4051client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4052client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.21 seconds)4053lb: must succeed: curl -sf localhost:9901/clusters4054lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4055lb: must succeed: curl -sf localhost:9901/clusters4056lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4057worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4058worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.09 seconds)4059(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.46 seconds)4060subtest: inputs already in the cache are not sent to the scheduler4061lb: must succeed: curl -sf localhost:9901/clusters4062lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4063lb: must succeed: curl -sf localhost:9901/clusters4064lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4065worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4066worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4067client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24068worker1 # [ 48.657882] nix-grpc-daemon[773]: ts=2026-09-20T09:34:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:362424069client # don't know how to build these paths:4070client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4071worker1 # [ 48.671745] nix-grpc-daemon[773]: ts=2026-09-20T09:34:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362424072worker1 # [ 48.687901] nix-grpc-daemon[848]: time=2026-09-20T09:34:01.315Z level=INFO msg="All 2 paths already cached"4073worker1 # [ 48.702543] nix-grpc-daemon[773]: ts=2026-09-20T09:34:01Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04074worker1 # [ 48.710417] nix-grpc-daemon[773]: ts=2026-09-20T09:34:01Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=14075worker1 # [ 48.749538] nix-grpc-daemon[773]: ts=2026-09-20T09:34:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362424076worker1 # [ 48.774755] nix-grpc-daemon[773]: ts=2026-09-20T09:34:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362424077worker1 # [ 48.794846] nix-grpc-daemon[848]: time=2026-09-20T09:34:01.424Z level=INFO msg="All 2 paths already cached"4078client # copying 1 paths to 'lb:50051'...4079client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4080worker1 # [ 48.808875] nix-grpc-daemon[773]: ts=2026-09-20T09:34:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:362424081worker1 # [ 48.827004] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4082worker1 # [ 49.089152] nix-daemon[836]: accepted connection from pid 998, user nix-grpc-daemon (trusted)4083worker1 # [ 49.111275] nix-daemon[836]: reaped child process 1001, status = succeeded4084worker1 # [ 49.296597] nix-daemon[836]: accepted connection from pid 1003, user nix-grpc-daemon (trusted)4085worker1 # [ 49.317886] nix-daemon[836]: reaped child process 1006, status = succeeded4086lb # [ 49.377032] niks3-server[1037]: 2026/09/20 09:34:01 INFO Received uploads request method=POST path=/api/pending_closures4087worker1 # [ 49.344820] nix-grpc-daemon[848]: time=2026-09-20T09:34:01.974Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4088worker1 # [ 49.346396] nix-grpc-daemon[848]: time=2026-09-20T09:34:01.974Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4089lb # [ 49.421651] niks3-server[1037]: 2026/09/20 09:34:01 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4090lb # [ 49.446148] niks3-server[1037]: 2026/09/20 09:34:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4091worker1 # [ 49.407901] nix-grpc-daemon[848]: time=2026-09-20T09:34:02.037Z level=INFO msg="Uploading 1 narinfos"4092lb # [ 49.460487] niks3-server[1037]: 2026/09/20 09:34:01 INFO Signed narinfos id=7 count=14093lb # [ 49.467263] niks3-server[1037]: 2026/09/20 09:34:01 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4094lb # [ 49.475295] niks3-server[1037]: 2026/09/20 09:34:01 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4095lb # [ 49.489131] niks3-server[1037]: 2026/09/20 09:34:01 INFO Completed upload id=74096worker1 # [ 49.444055] nix-grpc-daemon[848]: time=2026-09-20T09:34:02.074Z level=INFO msg="Upload complete. (595ms)"4097lb # [ 49.493550] niks3-server[1037]: 2026/09/20 09:34:01 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4098worker1 # [ 49.459390] nix-grpc-daemon[773]: ts=2026-09-20T09:34:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=0 paths=1 nar_bytes_in=7524099worker1 # [ 49.472976] nix-grpc-daemon[773]: ts=2026-09-20T09:34:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362424100worker1 # [ 49.490657] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4101worker1 # [ 49.493519] nix-daemon[836]: reaped child process 996, status = succeeded4102client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4103client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4104worker1 # [ 49.513475] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4105client # farm-top> LOG-farm-top-t1b4106worker1 # [ 51.174997] nix-daemon[836]: reaped child process 1010, status = succeeded4107worker1 # [ 51.374357] nix-daemon[836]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4108worker1 # [ 51.394203] nix-daemon[836]: reaped child process 1028, status = succeeded4109lb # [ 51.454486] niks3-server[1037]: 2026/09/20 09:34:03 INFO Received uploads request method=POST path=/api/pending_closures4110worker1 # [ 51.436549] nix-grpc-daemon[848]: time=2026-09-20T09:34:04.062Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4111worker1 # [ 51.438194] nix-grpc-daemon[848]: time=2026-09-20T09:34:04.062Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4112lb # [ 51.510831] niks3-server[1037]: 2026/09/20 09:34:03 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4113lb # [ 51.526394] niks3-server[1037]: 2026/09/20 09:34:03 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4114lb # [ 51.537486] niks3-server[1037]: 2026/09/20 09:34:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4115lb # [ 51.542558] niks3-server[1037]: 2026/09/20 09:34:03 INFO Signed narinfos id=8 count=14116worker1 # [ 51.496144] nix-grpc-daemon[848]: time=2026-09-20T09:34:04.125Z level=INFO msg="Uploading 1 narinfos"4117lb # [ 51.545673] niks3-server[1037]: 2026/09/20 09:34:03 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4118lb # [ 51.555696] niks3-server[1037]: 2026/09/20 09:34:03 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4119lb # [ 51.563569] niks3-server[1037]: 2026/09/20 09:34:03 INFO Completed upload id=84120worker1 # [ 51.518722] nix-grpc-daemon[848]: time=2026-09-20T09:34:04.148Z level=INFO msg="Upload complete. (383ms)"4121lb # [ 51.566787] niks3-server[1037]: 2026/09/20 09:34:03 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4122worker1 # [ 51.533325] nix-grpc-daemon[773]: ts=2026-09-20T09:34:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=2 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14123worker1 # [ 51.553866] nix-daemon[836]: reaped child process 1008, status = succeeded4124client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 3.20 seconds)4125client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4126client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.28 seconds)4127lb: must succeed: curl -sf localhost:9901/clusters4128lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4129lb: must succeed: curl -sf localhost:9901/clusters4130lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4131worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4132worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4133(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.90 seconds)4134subtest: two clients wanting the same drv build it once4135client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4136lb # [ 52.154757] envoy[926]: conn peer=[2001:db8:1::1]:58008 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9536 tx=3858 ms=71634137lb # [ 52.159890] envoy[926]: conn peer=[2001:db8:1::1]:59806 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=481 ms=664138lb # [ 52.164717] envoy[926]: conn peer=[2001:db8:1::1]:59812 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4185 tx=1728 ms=28934139client # [ 52.135570] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4140client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.09 seconds)4141client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4142worker1 # [ 52.404757] nix-grpc-daemon[773]: ts=2026-09-20T09:34:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:362424143client # Running as unit: dedup1.service; invocation ID: 8b538524dddb4e5fac202862b30085d24144client # [ 52.400719] nix[888]: don't know how to build these paths:4145client # [ 52.403365] nix[888]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4146worker1 # [ 52.425716] nix-grpc-daemon[773]: ts=2026-09-20T09:34:05Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04147worker1 # [ 52.432839] nix-grpc-daemon[773]: ts=2026-09-20T09:34:05Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14148worker2 # [ 52.429507] nix-grpc-daemon[772]: ts=2026-09-20T09:34:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:606944149worker2 # [ 52.452141] nix-grpc-daemon[772]: ts=2026-09-20T09:34:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:606944150client # [ 52.468796] nix[888]: copying 1 paths to 'lb:50051'...4151worker2 # [ 52.468057] nix-grpc-daemon[772]: ts=2026-09-20T09:34:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:606944152client # [ 52.471237] nix[888]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4153worker2 # [ 52.486392] nix-daemon[830]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4154worker2 # [ 52.524445] nix-grpc-daemon[772]: ts=2026-09-20T09:34:05Z level=info event=niks3_push_started pid=8564155worker2 # [ 52.998611] nix-daemon[830]: accepted connection from pid 869, user nix-grpc-daemon (trusted)4156worker2 # [ 53.017847] nix-daemon[830]: reaped child process 872, status = succeeded4157worker2 # [ 53.195979] nix-daemon[830]: accepted connection from pid 874, user nix-grpc-daemon (trusted)4158worker2 # [ 53.213047] nix-daemon[830]: reaped child process 877, status = succeeded4159lb # [ 53.282837] niks3-server[1037]: 2026/09/20 09:34:04 INFO Received uploads request method=POST path=/api/pending_closures4160worker2 # [ 53.240047] nix-grpc-daemon[856]: time=2026-09-20T09:34:05.866Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4161worker2 # [ 53.241596] nix-grpc-daemon[856]: time=2026-09-20T09:34:05.866Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4162client # [ 53.253398] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4163lb # [ 53.321616] niks3-server[1037]: 2026/09/20 09:34:04 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4164client # Running as unit: dedup2.service; invocation ID: 230022704e2e4b74a4c9a17b3c12752c4165lb # [ 53.333453] niks3-server[1037]: 2026/09/20 09:34:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4166worker2 # [ 53.285120] nix-grpc-daemon[856]: time=2026-09-20T09:34:05.912Z level=INFO msg="Uploading 1 narinfos"4167lb # [ 53.346073] niks3-server[1037]: 2026/09/20 09:34:04 INFO Signed narinfos id=9 count=14168client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.14 seconds)4169lb # [ 53.353933] niks3-server[1037]: 2026/09/20 09:34:04 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4170lb # [ 53.367765] niks3-server[1037]: 2026/09/20 09:34:04 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4171lb # [ 53.373182] niks3-server[1037]: 2026/09/20 09:34:05 INFO Completed upload id=94172worker2 # [ 53.316531] nix-grpc-daemon[856]: time=2026-09-20T09:34:05.944Z level=INFO msg="Upload complete. (505ms)"4173lb # [ 53.376115] niks3-server[1037]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4174worker2 # [ 53.324413] nix-grpc-daemon[772]: ts=2026-09-20T09:34:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60694 duration_s=0 paths=1 nar_bytes_in=4324175worker2 # [ 53.338590] nix-grpc-daemon[772]: ts=2026-09-20T09:34:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:606944176worker2 # [ 53.345168] nix-daemon[830]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4177worker2 # [ 53.350219] nix-daemon[830]: reaped child process 854, status = succeeded4178client # [ 53.359438] nix[888]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4179worker2 # [ 53.364386] nix-daemon[830]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4180worker2 # [ 53.604894] nix-grpc-daemon[772]: ts=2026-09-20T09:34:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:606944181client # [ 53.618308] nix[904]: this derivation will be built:4182worker1 # [ 53.638655] nix-grpc-daemon[773]: ts=2026-09-20T09:34:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:362424183worker1 # [ 53.654284] nix-grpc-daemon[773]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' from 'http://lb:5751'...4184client # [ 53.665694] nix[904]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4185worker1 # [ 53.691545] nix-grpc-daemon[773]: ts=2026-09-20T09:34:06Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04186worker2 # [ 53.689439] nix-grpc-daemon[772]: ts=2026-09-20T09:34:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:606944187client # [ 53.696121] nix[904]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4188client: must succeed: sleep 24189client: (finished: must succeed: sleep 2, in 2.06 seconds)4190client: waiting for success: ! systemctl is-active dedup1 dedup24191worker2 # [ 57.015213] nix-daemon[830]: reaped child process 881, status = succeeded4192worker2 # [ 57.195068] nix-daemon[830]: accepted connection from pid 910, user nix-grpc-daemon (trusted)4193worker2 # [ 57.211463] nix-daemon[830]: reaped child process 913, status = succeeded4194lb # [ 57.281077] niks3-server[1037]: 2026/09/20 09:34:08 INFO Received uploads request method=POST path=/api/pending_closures4195worker2 # [ 57.235092] nix-grpc-daemon[856]: time=2026-09-20T09:34:09.861Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4196worker2 # [ 57.237514] nix-grpc-daemon[856]: time=2026-09-20T09:34:09.861Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4197lb # [ 57.319489] niks3-server[1037]: 2026/09/20 09:34:08 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4198lb # [ 57.334310] niks3-server[1037]: 2026/09/20 09:34:08 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4199lb # [ 57.349566] niks3-server[1037]: 2026/09/20 09:34:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4200worker2 # [ 57.300193] nix-grpc-daemon[856]: time=2026-09-20T09:34:09.926Z level=INFO msg="Uploading 1 narinfos"4201lb # [ 57.357627] niks3-server[1037]: 2026/09/20 09:34:08 INFO Signed narinfos id=10 count=14202lb # [ 57.361906] niks3-server[1037]: 2026/09/20 09:34:08 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4203lb # [ 57.375423] niks3-server[1037]: 2026/09/20 09:34:09 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4204lb # [ 57.386677] niks3-server[1037]: 2026/09/20 09:34:09 INFO Completed upload id=104205worker2 # [ 57.329657] nix-grpc-daemon[856]: time=2026-09-20T09:34:09.957Z level=INFO msg="Upload complete. (351ms)"4206lb # [ 57.389982] niks3-server[1037]: 2026/09/20 09:34:09 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4207worker2 # [ 57.341198] nix-grpc-daemon[772]: ts=2026-09-20T09:34:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60694 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14208worker2 # [ 57.360536] nix-grpc-daemon[772]: ts=2026-09-20T09:34:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60694 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14209worker2 # [ 57.368576] nix-daemon[830]: reaped child process 879, status = succeeded4210client # [ 57.400612] systemd[1]: dedup2.service: Deactivated successfully.4211client # [ 57.405272] systemd[1]: dedup2.service: Consumed 206ms CPU time over 4.152s wall clock time, 31M memory peak, 7.8K incoming IP traffic, 6.5K outgoing IP traffic.4212client # [ 57.416818] systemd[1]: dedup1.service: Deactivated successfully.4213client # [ 57.418963] systemd[1]: dedup1.service: Consumed 167ms CPU time over 5.278s wall clock time, 37.2M memory peak, 8.4K incoming IP traffic, 9K outgoing IP traffic.4214client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.15 seconds)4215client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4216client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4217worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4218worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4219worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4220worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4221worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4222worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.08 seconds)4223worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4224worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4225(finished: subtest: two clients wanting the same drv build it once, in 6.29 seconds)4226subtest: build hook: nix-daemon with builders = grpc://lb4227client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4228client # [ 58.579275] systemd[1]: Started Nix Daemon.4229client # [ 58.770874] nix-daemon[946]: accepted connection from pid 943, user root (trusted)4230worker1 # [ 58.983846] nix-grpc-daemon[773]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:362424231worker2 # [ 58.978741] nix-grpc-daemon[772]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:606944232worker1 # [ 59.002126] nix-grpc-daemon[773]: ts=2026-09-20T09:34:11Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04233worker1 # [ 59.009330] nix-grpc-daemon[773]: ts=2026-09-20T09:34:11Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14234worker1 # [ 59.046860] nix-grpc-daemon[773]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362424235worker1 # [ 59.062872] nix-grpc-daemon[773]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362424236worker1 # [ 59.078020] nix-grpc-daemon[773]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:362424237worker1 # [ 59.094691] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4238worker1 # [ 59.307018] nix-daemon[836]: accepted connection from pid 1067, user nix-grpc-daemon (trusted)4239worker1 # [ 59.328995] nix-daemon[836]: reaped child process 1070, status = succeeded4240worker1 # [ 59.498587] nix-daemon[836]: accepted connection from pid 1072, user nix-grpc-daemon (trusted)4241worker1 # [ 59.516687] nix-daemon[836]: reaped child process 1075, status = succeeded4242lb # [ 59.577341] niks3-server[1037]: 2026/09/20 09:34:11 INFO Received uploads request method=POST path=/api/pending_closures4243worker1 # [ 59.541623] nix-grpc-daemon[848]: time=2026-09-20T09:34:12.171Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4244worker1 # [ 59.543583] nix-grpc-daemon[848]: time=2026-09-20T09:34:12.173Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4245lb # [ 59.608377] niks3-server[1037]: 2026/09/20 09:34:11 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4246worker1 # [ 59.575744] nix-grpc-daemon[848]: time=2026-09-20T09:34:12.205Z level=INFO msg="Uploading 1 narinfos"4247lb # [ 59.623365] niks3-server[1037]: 2026/09/20 09:34:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4248lb # [ 59.635771] niks3-server[1037]: 2026/09/20 09:34:11 INFO Signed narinfos id=11 count=14249worker1 # [ 59.599058] nix-grpc-daemon[848]: time=2026-09-20T09:34:12.229Z level=INFO msg="Upload complete. (486ms)"4250lb # [ 59.640824] niks3-server[1037]: 2026/09/20 09:34:11 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4251lb # [ 59.650716] niks3-server[1037]: 2026/09/20 09:34:11 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4252worker1 # [ 59.605420] nix-grpc-daemon[773]: ts=2026-09-20T09:34:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=0 paths=1 nar_bytes_in=5124253lb # [ 59.655074] niks3-server[1037]: 2026/09/20 09:34:11 INFO Completed upload id=114254lb # [ 59.657164] niks3-server[1037]: 2026/09/20 09:34:11 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4255worker1 # [ 59.618192] nix-grpc-daemon[773]: ts=2026-09-20T09:34:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362424256worker1 # [ 59.624945] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4257worker1 # [ 59.629418] nix-daemon[836]: reaped child process 1065, status = succeeded4258worker1 # [ 59.639576] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4259worker1 # [ 61.077432] nix-daemon[836]: reaped child process 1079, status = succeeded4260worker1 # [ 61.243930] nix-daemon[836]: accepted connection from pid 1094, user nix-grpc-daemon (trusted)4261worker1 # [ 61.260715] nix-daemon[836]: reaped child process 1097, status = succeeded4262lb # [ 61.321100] niks3-server[1037]: 2026/09/20 09:34:12 INFO Received uploads request method=POST path=/api/pending_closures4263worker1 # [ 61.288448] nix-grpc-daemon[848]: time=2026-09-20T09:34:13.915Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4264worker1 # [ 61.290090] nix-grpc-daemon[848]: time=2026-09-20T09:34:13.915Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4265lb # [ 61.355573] niks3-server[1037]: 2026/09/20 09:34:12 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4266lb # [ 61.375741] niks3-server[1037]: 2026/09/20 09:34:13 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4267lb # [ 61.386971] niks3-server[1037]: 2026/09/20 09:34:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4268worker1 # [ 61.346757] nix-grpc-daemon[848]: time=2026-09-20T09:34:13.976Z level=INFO msg="Uploading 1 narinfos"4269lb # [ 61.394194] niks3-server[1037]: 2026/09/20 09:34:13 INFO Signed narinfos id=12 count=14270lb # [ 61.400079] niks3-server[1037]: 2026/09/20 09:34:13 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4271lb # [ 61.408108] niks3-server[1037]: 2026/09/20 09:34:13 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4272lb # [ 61.414819] niks3-server[1037]: 2026/09/20 09:34:13 INFO Completed upload id=124273worker1 # [ 61.369453] nix-grpc-daemon[848]: time=2026-09-20T09:34:13.999Z level=INFO msg="Upload complete. (317ms)"4274lb # [ 61.417780] niks3-server[1037]: 2026/09/20 09:34:13 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4275worker1 # [ 61.384884] nix-grpc-daemon[773]: ts=2026-09-20T09:34:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14276worker1 # [ 61.400555] nix-grpc-daemon[773]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:362424277worker1 # [ 61.406207] nix-daemon[836]: reaped child process 1077, status = succeeded4278worker1 # [ 61.414744] nix-grpc-daemon[773]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:362424279worker1 # [ 61.420568] nix-grpc-daemon[773]: ts=2026-09-20T09:34:14Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=0 paths=1 nar_bytes_out=1284280worker2 # [ 61.721265] nix-grpc-daemon[772]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:606944281worker2 # [ 61.728963] nix-grpc-daemon[772]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:606944282worker1 # [ 61.761487] nix-grpc-daemon[773]: ts=2026-09-20T09:34:14Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04283worker1 # [ 61.768913] nix-grpc-daemon[773]: ts=2026-09-20T09:34:14Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14284worker1 # [ 61.777584] nix-grpc-daemon[773]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362424285worker1 # [ 61.789061] nix-grpc-daemon[773]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362424286worker1 # [ 61.807782] nix-grpc-daemon[848]: time=2026-09-20T09:34:14.437Z level=INFO msg="All 1 paths already cached"4287worker1 # [ 61.817561] nix-grpc-daemon[773]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:362424288worker1 # [ 61.831275] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4289worker1 # [ 62.037897] nix-daemon[836]: accepted connection from pid 1103, user nix-grpc-daemon (trusted)4290worker1 # [ 62.055279] nix-daemon[836]: reaped child process 1106, status = succeeded4291lb # [ 62.161578] envoy[926]: conn peer=[2001:db8:1::1]:32924 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1579 tx=1511 ms=37564292lb # [ 62.166510] envoy[926]: conn peer=[2001:db8:1::1]:32918 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1374 ms=49684293lb # [ 62.171596] envoy[926]: conn peer=[2001:db8:1::1]:32930 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3414 tx=1634 ms=24974294lb # [ 62.176586] envoy[926]: conn peer=[2001:db8:1::1]:32844 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=754295worker1 # [ 62.224655] nix-daemon[836]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)4296worker1 # [ 62.241078] nix-daemon[836]: reaped child process 1111, status = succeeded4297lb # [ 62.299825] niks3-server[1037]: 2026/09/20 09:34:13 INFO Received uploads request method=POST path=/api/pending_closures4298worker1 # [ 62.263929] nix-grpc-daemon[848]: time=2026-09-20T09:34:14.893Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4299worker1 # [ 62.265536] nix-grpc-daemon[848]: time=2026-09-20T09:34:14.893Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4300lb # [ 62.330103] niks3-server[1037]: 2026/09/20 09:34:13 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4301lb # [ 62.344931] niks3-server[1037]: 2026/09/20 09:34:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4302worker1 # [ 62.307975] nix-grpc-daemon[848]: time=2026-09-20T09:34:14.937Z level=INFO msg="Uploading 1 narinfos"4303lb # [ 62.356734] niks3-server[1037]: 2026/09/20 09:34:13 INFO Signed narinfos id=13 count=14304lb # [ 62.359239] niks3-server[1037]: 2026/09/20 09:34:13 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4305lb # [ 62.368318] niks3-server[1037]: 2026/09/20 09:34:13 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4306worker1 # [ 62.328724] nix-grpc-daemon[848]: time=2026-09-20T09:34:14.958Z level=INFO msg="Upload complete. (480ms)"4307lb # [ 62.374439] niks3-server[1037]: 2026/09/20 09:34:14 INFO Completed upload id=134308lb # [ 62.377205] niks3-server[1037]: 2026/09/20 09:34:14 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4309worker1 # [ 62.336246] nix-grpc-daemon[773]: ts=2026-09-20T09:34:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=0 paths=1 nar_bytes_in=6244310worker1 # [ 62.350071] nix-grpc-daemon[773]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362424311worker1 # [ 62.356894] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4312worker1 # [ 62.361636] nix-daemon[836]: reaped child process 1101, status = succeeded4313worker1 # [ 62.375078] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4314worker1 # [ 63.421550] nix-daemon[836]: reaped child process 1115, status = succeeded4315worker1 # [ 63.603541] nix-daemon[836]: accepted connection from pid 1130, user nix-grpc-daemon (trusted)4316worker1 # [ 63.620621] nix-daemon[836]: reaped child process 1133, status = succeeded4317lb # [ 63.680975] niks3-server[1037]: 2026/09/20 09:34:15 INFO Received uploads request method=POST path=/api/pending_closures4318worker1 # [ 63.647563] nix-grpc-daemon[848]: time=2026-09-20T09:34:16.275Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4319worker1 # [ 63.649191] nix-grpc-daemon[848]: time=2026-09-20T09:34:16.275Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4320worker1 # [ 63.691715] nix-grpc-daemon[848]: time=2026-09-20T09:34:16.321Z level=INFO msg="Uploading 1 narinfos"4321lb # [ 63.725685] niks3-server[1037]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4322lb # [ 63.740757] niks3-server[1037]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4323lb # [ 63.748690] niks3-server[1037]: 2026/09/20 09:34:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4324worker1 # [ 63.709134] nix-grpc-daemon[848]: time=2026-09-20T09:34:16.339Z level=INFO msg="Upload complete. (323ms)"4325lb # [ 63.756184] niks3-server[1037]: 2026/09/20 09:34:15 INFO Signed narinfos id=14 count=14326lb # [ 63.759713] niks3-server[1037]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4327lb # [ 63.763824] niks3-server[1037]: 2026/09/20 09:34:15 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4328worker1 # [ 63.716854] nix-grpc-daemon[773]: ts=2026-09-20T09:34:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14329lb # [ 63.767453] niks3-server[1037]: 2026/09/20 09:34:15 INFO Completed upload id=144330lb # [ 63.769755] niks3-server[1037]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4331worker1 # [ 63.733207] nix-grpc-daemon[773]: ts=2026-09-20T09:34:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:362424332worker1 # [ 63.736890] nix-daemon[836]: reaped child process 1113, status = succeeded4333worker2 # [ 63.746941] nix-grpc-daemon[772]: ts=2026-09-20T09:34:16Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:606944334worker2 # [ 63.760328] nix-grpc-daemon[772]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4335worker2 # [ 63.778022] nix-grpc-daemon[772]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4336worker2 # [ 63.791465] nix-grpc-daemon[772]: ts=2026-09-20T09:34:16Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60694 duration_s=0 paths=1 nar_bytes_out=1764337worker1 # [ 64.107363] nix-grpc-daemon[773]: ts=2026-09-20T09:34:16Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:362424338worker2 # [ 64.099419] nix-grpc-daemon[772]: ts=2026-09-20T09:34:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:606944339worker2 # [ 64.110795] nix-grpc-daemon[856]: time=2026-09-20T09:34:16.738Z level=INFO msg="All 2 paths already cached"4340worker1 # [ 64.140146] nix-grpc-daemon[773]: ts=2026-09-20T09:34:16Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04341worker1 # [ 64.147144] nix-grpc-daemon[773]: ts=2026-09-20T09:34:16Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14342worker1 # [ 64.156677] nix-grpc-daemon[773]: ts=2026-09-20T09:34:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362424343worker1 # [ 64.168139] nix-grpc-daemon[773]: ts=2026-09-20T09:34:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362424344worker1 # [ 64.181683] nix-grpc-daemon[848]: time=2026-09-20T09:34:16.811Z level=INFO msg="All 2 paths already cached"4345worker1 # [ 64.191247] nix-grpc-daemon[773]: ts=2026-09-20T09:34:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:362424346worker1 # [ 64.205792] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4347worker1 # [ 64.408680] nix-daemon[836]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)4348worker1 # [ 64.426921] nix-daemon[836]: reaped child process 1142, status = succeeded4349worker1 # [ 64.607868] nix-daemon[836]: accepted connection from pid 1144, user nix-grpc-daemon (trusted)4350worker1 # [ 64.625134] nix-daemon[836]: reaped child process 1147, status = succeeded4351lb # [ 64.684812] niks3-server[1037]: 2026/09/20 09:34:16 INFO Received uploads request method=POST path=/api/pending_closures4352worker1 # [ 64.649554] nix-grpc-daemon[848]: time=2026-09-20T09:34:17.279Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4353worker1 # [ 64.651046] nix-grpc-daemon[848]: time=2026-09-20T09:34:17.279Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4354lb # [ 64.711155] niks3-server[1037]: 2026/09/20 09:34:16 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4355worker1 # [ 64.680275] nix-grpc-daemon[848]: time=2026-09-20T09:34:17.310Z level=INFO msg="Uploading 1 narinfos"4356lb # [ 64.725244] niks3-server[1037]: 2026/09/20 09:34:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4357lb # [ 64.738401] niks3-server[1037]: 2026/09/20 09:34:16 INFO Signed narinfos id=15 count=14358lb # [ 64.745225] niks3-server[1037]: 2026/09/20 09:34:16 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4359lb # [ 64.752200] niks3-server[1037]: 2026/09/20 09:34:16 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4360lb # [ 64.760635] niks3-server[1037]: 2026/09/20 09:34:16 INFO Completed upload id=154361lb # [ 64.764123] niks3-server[1037]: 2026/09/20 09:34:16 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4362worker1 # [ 64.714127] nix-grpc-daemon[848]: time=2026-09-20T09:34:17.344Z level=INFO msg="Upload complete. (491ms)"4363worker1 # [ 64.725246] nix-grpc-daemon[773]: ts=2026-09-20T09:34:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=0 paths=1 nar_bytes_in=7524364worker1 # [ 64.735946] nix-grpc-daemon[773]: ts=2026-09-20T09:34:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362424365worker1 # [ 64.743362] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4366worker1 # [ 64.748309] nix-daemon[836]: reaped child process 1137, status = succeeded4367worker1 # [ 64.763034] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4368worker1 # [ 65.604388] nix-daemon[836]: reaped child process 1151, status = succeeded4369worker1 # [ 65.788111] nix-daemon[836]: accepted connection from pid 1166, user nix-grpc-daemon (trusted)4370worker1 # [ 65.808586] nix-daemon[836]: reaped child process 1169, status = succeeded4371lb # [ 65.866061] niks3-server[1037]: 2026/09/20 09:34:17 INFO Received uploads request method=POST path=/api/pending_closures4372worker1 # [ 65.832495] nix-grpc-daemon[848]: time=2026-09-20T09:34:18.460Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4373worker1 # [ 65.834026] nix-grpc-daemon[848]: time=2026-09-20T09:34:18.460Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4374lb # [ 65.909872] niks3-server[1037]: 2026/09/20 09:34:17 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4375worker1 # [ 65.879778] nix-grpc-daemon[848]: time=2026-09-20T09:34:18.509Z level=INFO msg="Uploading 1 narinfos"4376lb # [ 65.921513] niks3-server[1037]: 2026/09/20 09:34:17 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4377lb # [ 65.934856] niks3-server[1037]: 2026/09/20 09:34:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4378lb # [ 65.940068] niks3-server[1037]: 2026/09/20 09:34:17 INFO Signed narinfos id=16 count=14379lb # [ 65.947387] niks3-server[1037]: 2026/09/20 09:34:17 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4380lb # [ 65.950599] niks3-server[1037]: 2026/09/20 09:34:17 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4381lb # [ 65.954901] niks3-server[1037]: 2026/09/20 09:34:17 INFO Completed upload id=164382worker1 # [ 65.909921] nix-grpc-daemon[848]: time=2026-09-20T09:34:18.539Z level=INFO msg="Upload complete. (336ms)"4383lb # [ 65.957612] niks3-server[1037]: 2026/09/20 09:34:17 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4384worker1 # [ 65.921083] nix-grpc-daemon[773]: ts=2026-09-20T09:34:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14385worker1 # [ 65.940531] nix-grpc-daemon[773]: ts=2026-09-20T09:34:18Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:362424386worker1 # [ 65.945344] nix-daemon[836]: reaped child process 1149, status = succeeded4387worker2 # [ 65.948542] nix-grpc-daemon[772]: ts=2026-09-20T09:34:18Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:606944388worker2 # [ 65.953614] nix-grpc-daemon[772]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4389worker2 # [ 65.968422] nix-grpc-daemon[772]: ts=2026-09-20T09:34:18Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60694 duration_s=0 paths=1 nar_bytes_out=2324390client # [ 66.098184] nix-daemon[946]: reaped child process 948, status = succeeded4391client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.76 seconds)4392client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4393client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds)4394client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4395client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4396client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4397client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4398(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.89 seconds)4399subtest: an input only one worker has still reaches the builder4400client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4401client # this derivation will be built:4402client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4403client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4404client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.45 seconds)4405client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4406client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.21 seconds)4407worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4408worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.24 seconds)4409worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4410worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4411client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24412client # [ 67.409193] nix-daemon[946]: accepted connection from pid 1028, user root (trusted)4413client # this derivation will be built:4414client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4415worker2 # [ 67.606913] nix-grpc-daemon[772]: ts=2026-09-20T09:34:20Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:606944416client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4417worker1 # [ 67.623289] nix-grpc-daemon[773]: ts=2026-09-20T09:34:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362424418worker1 # [ 67.841032] nix-daemon[836]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)4419worker1 # [ 67.859764] nix-daemon[836]: reaped child process 1179, status = succeeded4420lb # [ 67.918614] niks3-server[1037]: 2026/09/20 09:34:19 INFO Received uploads request method=POST path=/api/pending_closures4421worker1 # [ 67.885419] nix-grpc-daemon[848]: time=2026-09-20T09:34:20.514Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4422worker1 # [ 67.887078] nix-grpc-daemon[848]: time=2026-09-20T09:34:20.514Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4423lb # [ 67.949167] niks3-server[1037]: 2026/09/20 09:34:19 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4424lb # [ 67.966367] niks3-server[1037]: 2026/09/20 09:34:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4425worker1 # [ 67.926331] nix-grpc-daemon[848]: time=2026-09-20T09:34:20.556Z level=INFO msg="Uploading 1 narinfos"4426lb # [ 67.977410] niks3-server[1037]: 2026/09/20 09:34:19 INFO Signed narinfos id=17 count=14427lb # [ 67.983566] niks3-server[1037]: 2026/09/20 09:34:19 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4428lb # [ 67.993468] niks3-server[1037]: 2026/09/20 09:34:19 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4429lb # [ 68.000285] niks3-server[1037]: 2026/09/20 09:34:19 INFO Completed upload id=174430worker1 # [ 67.953964] nix-grpc-daemon[848]: time=2026-09-20T09:34:20.584Z level=INFO msg="Upload complete. (325ms)"4431lb # [ 68.003882] niks3-server[1037]: 2026/09/20 09:34:19 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4432worker1 # [ 67.981449] nix-grpc-daemon[773]: ts=2026-09-20T09:34:20Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04433worker1 # [ 67.987819] nix-grpc-daemon[773]: ts=2026-09-20T09:34:20Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14434worker2 # [ 68.016404] nix-grpc-daemon[772]: ts=2026-09-20T09:34:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:606944435worker2 # [ 68.032349] nix-grpc-daemon[772]: ts=2026-09-20T09:34:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:606944436client # copying 2 paths to 'lb:50051'...4437client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4438worker2 # [ 68.052676] nix-grpc-daemon[772]: ts=2026-09-20T09:34:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:606944439client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4440worker2 # [ 68.069422] nix-daemon[830]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4441worker2 # [ 68.296140] nix-daemon[830]: accepted connection from pid 934, user nix-grpc-daemon (trusted)4442worker2 # [ 68.316152] nix-daemon[830]: reaped child process 937, status = succeeded4443worker2 # [ 68.485411] nix-daemon[830]: accepted connection from pid 939, user nix-grpc-daemon (trusted)4444worker2 # [ 68.502948] nix-daemon[830]: reaped child process 942, status = succeeded4445lb # [ 68.575128] niks3-server[1037]: 2026/09/20 09:34:20 INFO Received uploads request method=POST path=/api/pending_closures4446lb # [ 68.585338] niks3-server[1037]: 2026/09/20 09:34:20 INFO Received uploads request method=POST path=/api/pending_closures4447worker2 # [ 68.537959] nix-grpc-daemon[856]: time=2026-09-20T09:34:21.165Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4448worker2 # [ 68.539443] nix-grpc-daemon[856]: time=2026-09-20T09:34:21.165Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4449worker2 # [ 68.541338] nix-grpc-daemon[856]: time=2026-09-20T09:34:21.165Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4450lb # [ 68.620101] niks3-server[1037]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4451lb # [ 68.634038] niks3-server[1037]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4452worker2 # [ 68.598950] nix-grpc-daemon[856]: time=2026-09-20T09:34:21.226Z level=INFO msg="Uploading 3 narinfos"4453lb # [ 68.646395] niks3-server[1037]: 2026/09/20 09:34:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4454lb # [ 68.659616] niks3-server[1037]: 2026/09/20 09:34:20 INFO Signed narinfos id=19 count=24455lb # [ 68.666193] niks3-server[1037]: 2026/09/20 09:34:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4456lb # [ 68.673810] niks3-server[1037]: 2026/09/20 09:34:20 INFO Signed narinfos id=18 count=14457lb # [ 68.680188] niks3-server[1037]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4458lb # [ 68.683320] niks3-server[1037]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4459lb # [ 68.695009] niks3-server[1037]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4460lb # [ 68.699888] niks3-server[1037]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4461lb # [ 68.706276] niks3-server[1037]: 2026/09/20 09:34:20 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4462lb # [ 68.710793] niks3-server[1037]: 2026/09/20 09:34:20 INFO Completed upload id=184463lb # [ 68.712961] niks3-server[1037]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4464worker2 # [ 68.656126] nix-grpc-daemon[856]: time=2026-09-20T09:34:21.284Z level=INFO msg="Upload complete. (566ms)"4465lb # [ 68.715482] niks3-server[1037]: 2026/09/20 09:34:20 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4466lb # [ 68.718364] niks3-server[1037]: 2026/09/20 09:34:20 INFO Completed upload id=194467worker2 # [ 68.669159] nix-grpc-daemon[772]: ts=2026-09-20T09:34:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60694 duration_s=0 paths=2 nar_bytes_in=9844468worker2 # [ 68.684645] nix-grpc-daemon[772]: ts=2026-09-20T09:34:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:606944469worker2 # [ 68.696254] nix-daemon[830]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4470worker2 # [ 68.701705] nix-daemon[830]: reaped child process 932, status = succeeded4471worker2 # [ 68.717213] nix-grpc-daemon[772]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4472client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4473worker2 # [ 68.732443] nix-daemon[830]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4474client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4475worker2 # [ 69.979877] nix-daemon[830]: reaped child process 947, status = succeeded4476worker2 # [ 70.154309] nix-daemon[830]: accepted connection from pid 962, user nix-grpc-daemon (trusted)4477worker2 # [ 70.173242] nix-daemon[830]: reaped child process 965, status = succeeded4478lb # [ 70.244683] niks3-server[1037]: 2026/09/20 09:34:21 INFO Received uploads request method=POST path=/api/pending_closures4479worker2 # [ 70.198050] nix-grpc-daemon[856]: time=2026-09-20T09:34:22.825Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4480lb # [ 70.277477] niks3-server[1037]: 2026/09/20 09:34:21 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4481worker2 # [ 70.229716] nix-grpc-daemon[856]: time=2026-09-20T09:34:22.857Z level=INFO msg="Uploading 1 narinfos"4482lb # [ 70.290382] niks3-server[1037]: 2026/09/20 09:34:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4483lb # [ 70.299830] niks3-server[1037]: 2026/09/20 09:34:21 INFO Signed narinfos id=20 count=14484lb # [ 70.304283] niks3-server[1037]: 2026/09/20 09:34:21 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4485worker2 # [ 70.258082] nix-grpc-daemon[856]: time=2026-09-20T09:34:22.885Z level=INFO msg="Upload complete. (309ms)"4486lb # [ 70.313779] niks3-server[1037]: 2026/09/20 09:34:21 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4487lb # [ 70.318599] niks3-server[1037]: 2026/09/20 09:34:21 INFO Completed upload id=204488lb # [ 70.321458] niks3-server[1037]: 2026/09/20 09:34:21 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4489worker2 # [ 70.264871] nix-grpc-daemon[772]: ts=2026-09-20T09:34:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60694 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14490worker2 # [ 70.278574] nix-daemon[830]: reaped child process 944, status = succeeded4491client # copying 1 paths...4492worker2 # [ 70.311112] nix-grpc-daemon[772]: ts=2026-09-20T09:34:22Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:606944493client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4494worker2 # [ 70.348133] nix-grpc-daemon[772]: ts=2026-09-20T09:34:22Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:606944495worker2 # [ 70.353849] nix-grpc-daemon[772]: ts=2026-09-20T09:34:22Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60694 duration_s=0 paths=1 nar_bytes_out=1204496client # [ 70.479302] nix-daemon[946]: reaped child process 1031, status = succeeded4497client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.31 seconds)4498client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24499client # [ 70.711002] nix-daemon[946]: accepted connection from pid 1050, user root (trusted)4500client # this derivation will be built:4501client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4502worker2 # [ 70.909295] nix-grpc-daemon[772]: ts=2026-09-20T09:34:23Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:606944503client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4504worker1 # [ 70.929967] nix-grpc-daemon[773]: ts=2026-09-20T09:34:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362424505worker1 # [ 70.937034] nix-grpc-daemon[848]: time=2026-09-20T09:34:23.566Z level=INFO msg="All 1 paths already cached"4506worker1 # [ 70.955464] nix-grpc-daemon[773]: ts=2026-09-20T09:34:23Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04507worker1 # [ 70.963306] nix-grpc-daemon[773]: ts=2026-09-20T09:34:23Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14508worker1 # [ 70.973244] nix-grpc-daemon[773]: ts=2026-09-20T09:34:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362424509worker1 # [ 70.985172] nix-grpc-daemon[773]: ts=2026-09-20T09:34:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:362424510client # copying 1 paths to 'lb:50051'...4511client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4512worker1 # [ 71.006225] nix-grpc-daemon[773]: ts=2026-09-20T09:34:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:362424513worker1 # [ 71.021398] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4514worker1 # [ 71.041598] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 1/5)4515worker1 # [ 71.119403] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 104 ms (attempt 2/5)4516worker1 # [ 71.231207] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 3/5)4517worker1 # [ 71.310276] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 95 ms (attempt 4/5)4518worker1 # [ 71.413155] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4519worker1 # [ 71.423540] nix-grpc-daemon[773]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4520worker1 # [ 71.643557] nix-daemon[836]: accepted connection from pid 1191, user nix-grpc-daemon (trusted)4521worker1 # [ 71.664129] nix-daemon[836]: reaped child process 1194, status = succeeded4522worker1 # [ 71.840868] nix-daemon[836]: accepted connection from pid 1196, user nix-grpc-daemon (trusted)4523worker1 # [ 71.858543] nix-daemon[836]: reaped child process 1199, status = succeeded4524lb # [ 71.916836] niks3-server[1037]: 2026/09/20 09:34:23 INFO Received uploads request method=POST path=/api/pending_closures4525worker1 # [ 71.881341] nix-grpc-daemon[848]: time=2026-09-20T09:34:24.511Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4526worker1 # [ 71.882838] nix-grpc-daemon[848]: time=2026-09-20T09:34:24.511Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4527lb # [ 71.945750] niks3-server[1037]: 2026/09/20 09:34:23 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4528lb # [ 71.958566] niks3-server[1037]: 2026/09/20 09:34:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4529worker1 # [ 71.920046] nix-grpc-daemon[848]: time=2026-09-20T09:34:24.549Z level=INFO msg="Uploading 1 narinfos"4530lb # [ 71.968912] niks3-server[1037]: 2026/09/20 09:34:23 INFO Signed narinfos id=21 count=14531lb # [ 71.975300] niks3-server[1037]: 2026/09/20 09:34:23 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4532lb # [ 71.982816] niks3-server[1037]: 2026/09/20 09:34:23 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4533lb # [ 71.989320] niks3-server[1037]: 2026/09/20 09:34:23 INFO Completed upload id=214534worker1 # [ 71.944470] nix-grpc-daemon[848]: time=2026-09-20T09:34:24.573Z level=INFO msg="Upload complete. (499ms)"4535lb # [ 71.992080] niks3-server[1037]: 2026/09/20 09:34:23 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4536worker1 # [ 71.952395] nix-grpc-daemon[773]: ts=2026-09-20T09:34:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=0 paths=1 nar_bytes_in=5684537worker1 # [ 71.964238] nix-grpc-daemon[773]: ts=2026-09-20T09:34:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:362424538worker1 # [ 71.970620] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4539worker1 # [ 71.975096] nix-daemon[836]: reaped child process 1185, status = succeeded4540client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4541worker1 # [ 71.987956] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4542client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4543lb # [ 72.162552] envoy[926]: conn peer=[2001:db8:1::1]:32858 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=1104544lb # [ 72.167671] envoy[926]: conn peer=[2001:db8:1::1]:32856 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3888 tx=1852 ms=21344545lb # [ 72.172667] envoy[926]: conn peer=[2001:db8:1::1]:32866 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=407 ms=854546lb # [ 72.177536] envoy[926]: conn peer=[2001:db8:1::1]:32864 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4313 tx=2111 ms=19324547lb # [ 72.182541] envoy[926]: conn peer=[2001:db8:1::1]:32880 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3849 tx=1790 ms=28064548lb # [ 72.188163] envoy[926]: conn peer=[2001:db8:1::1]:32894 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=704549worker1 # [ 73.035674] nix-daemon[836]: reaped child process 1203, status = succeeded4550worker1 # [ 73.223621] nix-daemon[836]: accepted connection from pid 1218, user nix-grpc-daemon (trusted)4551worker1 # [ 73.241275] nix-daemon[836]: reaped child process 1221, status = succeeded4552lb # [ 73.300826] niks3-server[1037]: 2026/09/20 09:34:24 INFO Received uploads request method=POST path=/api/pending_closures4553worker1 # [ 73.268473] nix-grpc-daemon[848]: time=2026-09-20T09:34:25.897Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4554lb # [ 73.333748] niks3-server[1037]: 2026/09/20 09:34:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4555worker1 # [ 73.298309] nix-grpc-daemon[848]: time=2026-09-20T09:34:25.928Z level=INFO msg="Uploading 1 narinfos"4556lb # [ 73.348906] niks3-server[1037]: 2026/09/20 09:34:24 INFO Signed narinfos id=22 count=14557lb # [ 73.351862] niks3-server[1037]: 2026/09/20 09:34:24 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4558lb # [ 73.363297] niks3-server[1037]: 2026/09/20 09:34:24 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4559worker1 # [ 73.326454] nix-grpc-daemon[848]: time=2026-09-20T09:34:25.956Z level=INFO msg="Upload complete. (327ms)"4560lb # [ 73.372258] niks3-server[1037]: 2026/09/20 09:34:24 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4561lb # [ 73.375576] niks3-server[1037]: 2026/09/20 09:34:24 INFO Completed upload id=224562lb # [ 73.377928] niks3-server[1037]: 2026/09/20 09:34:24 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4563worker1 # [ 73.337692] nix-grpc-daemon[773]: ts=2026-09-20T09:34:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36242 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14564worker1 # [ 73.351349] nix-daemon[836]: reaped child process 1201, status = succeeded4565client # copying 1 paths...4566worker1 # [ 73.384139] nix-grpc-daemon[773]: ts=2026-09-20T09:34:26Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:362424567client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4568worker2 # [ 73.403411] nix-grpc-daemon[772]: ts=2026-09-20T09:34:26Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:606944569worker2 # [ 73.417890] nix-grpc-daemon[772]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4570worker2 # [ 73.435700] nix-grpc-daemon[772]: ts=2026-09-20T09:34:26Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60694 duration_s=0 paths=1 nar_bytes_out=1204571client # [ 73.567753] nix-daemon[946]: reaped child process 1053, status = succeeded4572client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.08 seconds)4573client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24574client # [ 73.786795] nix-daemon[946]: accepted connection from pid 1072, user root (trusted)4575client # this derivation will be built:4576client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4577client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4578worker2 # [ 73.982792] nix-grpc-daemon[772]: ts=2026-09-20T09:34:26Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:606944579worker2 # [ 73.990961] nix-grpc-daemon[772]: ts=2026-09-20T09:34:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:606944580worker2 # [ 73.998966] nix-grpc-daemon[856]: time=2026-09-20T09:34:26.625Z level=INFO msg="All 1 paths already cached"4581worker1 # [ 74.022733] nix-grpc-daemon[773]: ts=2026-09-20T09:34:26Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04582worker1 # [ 74.023178] nix-grpc-daemon[773]: ts=2026-09-20T09:34:26Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14583worker2 # [ 74.059183] nix-grpc-daemon[772]: ts=2026-09-20T09:34:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:606944584worker2 # [ 74.075455] nix-grpc-daemon[772]: ts=2026-09-20T09:34:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:606944585worker2 # [ 74.090642] nix-grpc-daemon[856]: time=2026-09-20T09:34:26.718Z level=INFO msg="All 1 paths already cached"4586client # copying 1 paths to 'lb:50051'...4587worker2 # [ 74.101891] nix-grpc-daemon[772]: ts=2026-09-20T09:34:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:606944588client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4589worker2 # [ 74.122245] nix-daemon[830]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4590worker2 # [ 74.332539] nix-daemon[830]: accepted connection from pid 970, user nix-grpc-daemon (trusted)4591worker2 # [ 74.350302] nix-daemon[830]: reaped child process 973, status = succeeded4592worker2 # [ 74.527492] nix-daemon[830]: accepted connection from pid 975, user nix-grpc-daemon (trusted)4593worker2 # [ 74.545027] nix-daemon[830]: reaped child process 978, status = succeeded4594lb # [ 74.617874] niks3-server[1037]: 2026/09/20 09:34:26 INFO Received uploads request method=POST path=/api/pending_closures4595worker2 # [ 74.568884] nix-grpc-daemon[856]: time=2026-09-20T09:34:27.196Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4596worker2 # [ 74.570435] nix-grpc-daemon[856]: time=2026-09-20T09:34:27.196Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4597lb # [ 74.643966] niks3-server[1037]: 2026/09/20 09:34:26 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4598worker2 # [ 74.600519] nix-grpc-daemon[856]: time=2026-09-20T09:34:27.228Z level=INFO msg="Uploading 1 narinfos"4599lb # [ 74.661130] niks3-server[1037]: 2026/09/20 09:34:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4600lb # [ 74.672451] niks3-server[1037]: 2026/09/20 09:34:26 INFO Signed narinfos id=23 count=14601lb # [ 74.674950] niks3-server[1037]: 2026/09/20 09:34:26 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4602lb # [ 74.684433] niks3-server[1037]: 2026/09/20 09:34:26 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4603lb # [ 74.689849] niks3-server[1037]: 2026/09/20 09:34:26 INFO Completed upload id=234604worker2 # [ 74.633092] nix-grpc-daemon[856]: time=2026-09-20T09:34:27.261Z level=INFO msg="Upload complete. (493ms)"4605lb # [ 74.692661] niks3-server[1037]: 2026/09/20 09:34:26 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4606worker2 # [ 74.640834] nix-grpc-daemon[772]: ts=2026-09-20T09:34:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60694 duration_s=0 paths=1 nar_bytes_in=5684607worker2 # [ 74.654247] nix-grpc-daemon[772]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:606944608worker2 # [ 74.660974] nix-daemon[830]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4609worker2 # [ 74.665795] nix-daemon[830]: reaped child process 968, status = succeeded4610client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4611worker2 # [ 74.678926] nix-daemon[830]: accepted connection from pid 772, user nix-grpc-daemon (trusted)4612client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4613worker2 # [ 75.724972] nix-daemon[830]: reaped child process 982, status = succeeded4614worker2 # [ 75.903638] nix-daemon[830]: accepted connection from pid 997, user nix-grpc-daemon (trusted)4615worker2 # [ 75.920781] nix-daemon[830]: reaped child process 1000, status = succeeded4616lb # [ 75.993842] niks3-server[1037]: 2026/09/20 09:34:27 INFO Received uploads request method=POST path=/api/pending_closures4617worker2 # [ 75.946938] nix-grpc-daemon[856]: time=2026-09-20T09:34:28.573Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4618lb # [ 76.023039] niks3-server[1037]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4619worker2 # [ 75.980084] nix-grpc-daemon[856]: time=2026-09-20T09:34:28.607Z level=INFO msg="Uploading 1 narinfos"4620lb # [ 76.038637] niks3-server[1037]: 2026/09/20 09:34:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4621lb # [ 76.049081] niks3-server[1037]: 2026/09/20 09:34:27 INFO Signed narinfos id=24 count=14622lb # [ 76.051593] niks3-server[1037]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4623lb # [ 76.059581] niks3-server[1037]: 2026/09/20 09:34:27 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4624lb # [ 76.064991] niks3-server[1037]: 2026/09/20 09:34:27 INFO Completed upload id=244625worker2 # [ 76.008180] nix-grpc-daemon[856]: time=2026-09-20T09:34:28.636Z level=INFO msg="Upload complete. (318ms)"4626lb # [ 76.067766] niks3-server[1037]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4627worker2 # [ 76.020809] nix-grpc-daemon[772]: ts=2026-09-20T09:34:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60694 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14628worker2 # [ 76.032682] nix-daemon[830]: reaped child process 980, status = succeeded4629client # copying 1 paths...4630worker2 # [ 76.064235] nix-grpc-daemon[772]: ts=2026-09-20T09:34:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:606944631client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4632worker2 # [ 76.098367] nix-grpc-daemon[772]: ts=2026-09-20T09:34:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:606944633worker2 # [ 76.104255] nix-grpc-daemon[772]: ts=2026-09-20T09:34:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60694 duration_s=0 paths=1 nar_bytes_out=1204634client # [ 76.233351] nix-daemon[946]: reaped child process 1075, status = succeeded4635client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.67 seconds)4636(finished: subtest: an input only one worker has still reaches the builder, in 10.00 seconds)4637subtest: upload whose reference the worker lacks is completed from the cache4638client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4639client # this derivation will be built:4640client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4641client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4642client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.45 seconds)4643client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4644client # this derivation will be built:4645client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4646client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4647client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.44 seconds)4648client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4649client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds)4650worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4651worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.24 seconds)4652worker2 # [ 77.664720] systemd[1]: Stopping Nix worker-protocol over gRPC...4653worker2 # [ 78.447642] nix-grpc-daemon[772]: ts=2026-09-20T09:34:31Z level=info event=signal_exit4654worker2 # [ 79.701608] nix-grpc-daemon[772]: ts=2026-09-20T09:34:32Z level=info event=scheduler_restarting4655worker1 # [ 79.720451] nix-grpc-daemon[773]: ts=2026-09-20T09:34:32Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:362404656worker1 # [ 79.720814] nix-grpc-daemon[773]: ts=2026-09-20T09:34:32Z level=info event=worker_gone addr=192.168.1.4:500514657worker2 # [ 79.732795] nix-grpc-daemon[772]: ts=2026-09-20T09:34:32Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4658worker2 # [ 79.757975] nix-daemon[830]: reaped child process 832, status = succeeded4659worker2 # [ 80.414914] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4660worker2 # [ 80.418406] systemd[1]: Stopped Nix worker-protocol over gRPC.4661worker2 # [ 80.426350] systemd[1]: nix-grpc-daemon.service: Consumed 1.780s CPU time over 58.301s wall clock time, 51M memory peak, 47.1K incoming IP traffic, 81.9K outgoing IP traffic.4662worker2 # [ 80.438432] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4663worker2 # [ 80.443272] systemd[1]: Closed Nix worker-protocol over gRPC.4664worker2 # [ 80.446526] systemd[1]: nix-grpc-daemon.socket: Consumed 711us CPU time over 1min 8.626s wall clock time, 256K memory peak, 58.6K incoming IP traffic, 53.4K outgoing IP traffic.4665lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4666lb: must succeed: curl -sf localhost:9901/clusters4667lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4668lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4669client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24670worker1 # [ 80.790282] nix-grpc-daemon[773]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:362424671client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4672worker1 # [ 80.797543] nix-grpc-daemon[773]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:362424673client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.28 seconds)4674worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4675worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4676worker2 # [ 80.918191] systemd[1]: Listening on Nix worker-protocol over gRPC.4677worker1 # [ 81.006584] systemd[1]: Stopping Nix worker-protocol over gRPC...4678worker1 # [ 81.467907] nix-grpc-daemon[773]: ts=2026-09-20T09:34:34Z level=info event=signal_exit4679worker2 # [ 81.645064] systemd[1]: Starting Nix worker-protocol over gRPC...4680worker1 # [ 81.712641] nix-grpc-daemon[773]: ts=2026-09-20T09:34:34Z level=info event=scheduler_yield4681worker1 # [ 81.719579] nix-grpc-daemon[773]: ts=2026-09-20T09:34:34Z level=info event=scheduler_restarting addr=lb:500514682worker1 # [ 81.723784] nix-grpc-daemon[773]: ts=2026-09-20T09:34:34Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:362404683lb # [ 81.764281] niks3-server[1037]: 2026/09/20 09:34:33 INFO lead: released remote=192.168.1.3:463504684worker1 # [ 81.728400] nix-grpc-daemon[773]: ts=2026-09-20T09:34:34Z level=info event=worker_gone addr=192.168.1.3:500514685worker2 # [ 81.863018] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:34Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4686worker2 # [ 81.866481] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:34Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14687worker2 # [ 81.875527] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:34Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4688worker2 # [ 81.885680] systemd[1]: Started Nix worker-protocol over gRPC.4689lb # [ 81.950610] niks3-server[1037]: 2026/09/20 09:34:33 INFO lead: acquired remote=192.168.1.4:502144690worker2 # [ 81.906630] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:34Z level=info event=scheduler_take_over4691worker1 # [ 81.922099] nix-grpc-daemon[773]: ts=2026-09-20T09:34:34Z level=info event=scheduler_connected addr=lb:500514692worker1 # [ 81.926423] nix-grpc-daemon[773]: ts=2026-09-20T09:34:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4693worker2 # [ 81.919726] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:34Z level=info event=scheduler_connected addr=lb:500514694worker2 # [ 81.921657] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4695lb # [ 82.161930] envoy[926]: conn peer=[2001:db8:1::1]:45276 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3723 tx=1799 ms=25864696worker1 # [ 82.122734] nix-grpc-daemon[773]: ts=2026-09-20T09:34:34Z level=info event=scheduler_connected addr=lb:500514697lb # [ 82.167323] envoy[926]: conn peer=[2001:db8:1::1]:45278 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1004698lb # [ 82.173469] envoy[926]: conn peer=[2001:db8:1::1]:45286 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3728 tx=1798 ms=21804699worker1 # [ 82.128728] nix-grpc-daemon[773]: ts=2026-09-20T09:34:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4700lb # [ 82.178543] envoy[926]: conn peer=[2001:db8:1::1]:45300 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=704701worker2 # [ 82.122798] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:34Z level=info event=scheduler_connected addr=lb:500514702lb # [ 82.184198] envoy[926]: conn peer=[2001:db8:1::4]:44056 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6831 tx=1932 ms=572284703lb # [ 82.190248] envoy[926]: conn peer=[2001:db8:1::1]:45316 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=234704worker2 # [ 82.134084] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4705worker1 # [ 82.329826] nix-grpc-daemon[773]: ts=2026-09-20T09:34:34Z level=info event=scheduler_connected addr=lb:500514706worker1 # [ 82.334983] nix-grpc-daemon[773]: ts=2026-09-20T09:34:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4707worker2 # [ 82.335344] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:34Z level=info event=scheduler_connected addr=lb:500514708worker2 # [ 82.340772] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4709worker1 # [ 82.535834] nix-grpc-daemon[773]: ts=2026-09-20T09:34:35Z level=info event=scheduler_connected addr=lb:500514710worker1 # [ 82.541106] nix-grpc-daemon[773]: ts=2026-09-20T09:34:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4711worker2 # [ 82.541589] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:35Z level=info event=scheduler_connected addr=lb:500514712worker2 # [ 82.546766] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4713worker1 # [ 82.718431] nix-grpc-daemon[773]: ts=2026-09-20T09:34:35Z level=info event=scheduler_restarting4714worker2 # [ 82.747518] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:35Z level=info event=scheduler_connected addr=lb:500514715worker2 # [ 82.752800] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4716worker1 # [ 82.769720] nix-grpc-daemon[773]: ts=2026-09-20T09:34:35Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4717worker1 # [ 82.785607] nix-daemon[836]: reaped child process 838, status = succeeded4718worker2 # [ 82.954707] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:35Z level=info event=scheduler_connected addr=lb:500514719worker2 # [ 82.963318] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:35Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04720worker1 # [ 83.568685] nix-grpc-daemon[773]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4721worker1 # [ 83.573289] nix-grpc-daemon[773]: E0000 00:00:1789896876.197250 816 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4722worker1 # [ 83.596570] nix-grpc-daemon[773]: E0000 00:00:1789896876.226441 816 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4723worker1 # [ 84.341816] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4724worker1 # [ 84.348825] systemd[1]: Stopped Nix worker-protocol over gRPC.4725worker1 # [ 84.351401] systemd[1]: nix-grpc-daemon.service: Consumed 3.846s CPU time over 1min 2.218s wall clock time, 64.5M memory peak, 93.4K incoming IP traffic, 178.7K outgoing IP traffic.4726worker1 # [ 84.368765] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4727worker1 # [ 84.370842] systemd[1]: Closed Nix worker-protocol over gRPC.4728worker1 # [ 84.372736] systemd[1]: nix-grpc-daemon.socket: Consumed 605us CPU time over 1min 12.508s wall clock time, 256K memory peak, 93.8K incoming IP traffic, 77.6K outgoing IP traffic.4729lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4730lb: must succeed: curl -sf localhost:9901/clusters4731lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4732lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4733client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24734worker2 # [ 84.707535] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520224735worker2 # [ 84.722578] nix-daemon[830]: accepted connection from pid 1021, user nix-grpc-daemon (trusted)4736worker2 # [ 84.750048] nix-grpc-daemon[1021]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5)4737worker2 # [ 84.793834] nix-grpc-daemon[1021]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 118 ms (attempt 2/5)4738worker2 # [ 84.919551] nix-grpc-daemon[1021]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 112 ms (attempt 3/5)4739worker2 # [ 85.039463] nix-grpc-daemon[1021]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 286 ms (attempt 4/5)4740worker2 # [ 85.334303] nix-grpc-daemon[1021]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4741client # copying 2 paths...4742client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4743worker2 # [ 85.362526] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520224744client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4745worker2 # [ 85.379867] nix-daemon[830]: accepted connection from pid 1021, user nix-grpc-daemon (trusted)4746worker2 # [ 85.409645] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:38Z level=info event=niks3_push_started pid=10774747worker2 # [ 85.803944] nix-daemon[830]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)4748worker2 # [ 85.825529] nix-daemon[830]: reaped child process 1093, status = succeeded4749lb # [ 85.897849] niks3-server[1037]: 2026/09/20 09:34:37 INFO Received uploads request method=POST path=/api/pending_closures4750lb # [ 85.906586] niks3-server[1037]: 2026/09/20 09:34:37 INFO Received uploads request method=POST path=/api/pending_closures4751worker2 # [ 85.860456] nix-grpc-daemon[1077]: time=2026-09-20T09:34:38.486Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4752worker2 # [ 85.862008] nix-grpc-daemon[1077]: time=2026-09-20T09:34:38.486Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4753worker2 # [ 85.863748] nix-grpc-daemon[1077]: time=2026-09-20T09:34:38.487Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4754lb # [ 85.961449] niks3-server[1037]: 2026/09/20 09:34:37 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4755lb # [ 85.974660] niks3-server[1037]: 2026/09/20 09:34:37 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4756lb # [ 85.985924] niks3-server[1037]: 2026/09/20 09:34:37 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4757lb # [ 85.993280] niks3-server[1037]: 2026/09/20 09:34:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4758lb # [ 85.999433] niks3-server[1037]: 2026/09/20 09:34:37 INFO Signed narinfos id=25 count=14759worker2 # [ 85.944119] nix-grpc-daemon[1077]: time=2026-09-20T09:34:38.570Z level=INFO msg="Uploading 3 narinfos"4760lb # [ 86.002461] niks3-server[1037]: 2026/09/20 09:34:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4761lb # [ 86.008169] niks3-server[1037]: 2026/09/20 09:34:37 INFO Signed narinfos id=26 count=24762lb # [ 86.010296] niks3-server[1037]: 2026/09/20 09:34:37 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4763lb # [ 86.030902] niks3-server[1037]: 2026/09/20 09:34:37 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4764lb # [ 86.039427] niks3-server[1037]: 2026/09/20 09:34:37 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4765lb # [ 86.046304] niks3-server[1037]: 2026/09/20 09:34:37 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4766lb # [ 86.050219] niks3-server[1037]: 2026/09/20 09:34:37 INFO Completed upload id=254767lb # [ 86.053777] niks3-server[1037]: 2026/09/20 09:34:37 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4768lb # [ 86.056316] niks3-server[1037]: 2026/09/20 09:34:37 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4769lb # [ 86.059606] niks3-server[1037]: 2026/09/20 09:34:37 INFO Completed upload id=264770worker2 # [ 86.003132] nix-grpc-daemon[1077]: time=2026-09-20T09:34:38.631Z level=INFO msg="Upload complete. (372ms)"4771worker2 # [ 86.017429] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52022 duration_s=0 paths=2 nar_bytes_in=3124772worker2 # [ 86.032890] nix-daemon[830]: reaped child process 1075, status = succeeded4773client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.61 seconds)4774worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4775worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)4776worker1 # [ 86.198895] systemd[1]: Listening on Nix worker-protocol over gRPC.4777worker1 # [ 86.209399] systemd[1]: Starting Nix worker-protocol over gRPC...4778worker1 # [ 86.417044] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:39Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4779worker1 # [ 86.420527] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:39Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14780worker1 # [ 86.429457] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:39Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4781worker1 # [ 86.431345] systemd[1]: Started Nix worker-protocol over gRPC.4782lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4783lb: must succeed: curl -sf localhost:9901/clusters4784worker1 # [ 86.488503] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:39Z level=info event=scheduler_connected addr=lb:500514785worker2 # [ 86.480402] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:39Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04786lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4787lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds)4788(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.32 seconds)4789subtest: scheduler down: the other node takes the lock and keeps it4790lb: must succeed: curl -sf localhost:9901/clusters4791lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4792lb: must succeed: curl -sf localhost:9901/clusters4793lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4794lb: must succeed: curl -sf localhost:9901/clusters4795lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4796lb: must succeed: curl -sf localhost:9901/clusters4797lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4798worker2 # [ 86.841094] systemd[1]: Stopping Nix worker-protocol over gRPC...4799worker2 # [ 86.881781] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:39Z level=info event=signal_exit4800worker2 # [ 86.892764] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:39Z level=info event=scheduler_yield4801lb # [ 86.953327] niks3-server[1037]: 2026/09/20 09:34:38 INFO lead: released remote=192.168.1.4:502144802worker1 # [ 86.916450] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:39Z level=info event=scheduler_restarting addr=lb:500514803worker2 # [ 86.907578] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:520204804worker2 # [ 86.917629] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:39Z level=info event=worker_gone addr=192.168.1.3:500514805worker2 # [ 86.921738] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:39Z level=info event=scheduler_restarting addr=lb:500514806worker2 # [ 86.925769] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:520204807worker2 # [ 86.930190] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:39Z level=info event=worker_gone addr=192.168.1.4:500514808worker1 # [ 87.117592] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:39Z level=info event=scheduler_connected addr=lb:500514809worker1 # [ 87.122936] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4810worker2 # [ 87.118257] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:39Z level=info event=scheduler_connected addr=lb:500514811worker2 # [ 87.122501] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4812worker1 # [ 87.323745] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:39Z level=info event=scheduler_connected addr=lb:500514813worker1 # [ 87.329110] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4814worker2 # [ 87.318722] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:39Z level=info event=scheduler_connected addr=lb:500514815worker2 # [ 87.323939] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4816worker1 # [ 87.531586] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:40Z level=info event=scheduler_connected addr=lb:500514817worker1 # [ 87.535814] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4818worker2 # [ 87.524869] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:40Z level=info event=scheduler_connected addr=lb:500514819worker2 # [ 87.530125] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4820worker1 # [ 87.732356] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:40Z level=info event=scheduler_connected addr=lb:500514821worker1 # [ 87.737556] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4822worker2 # [ 87.730999] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:40Z level=info event=scheduler_connected addr=lb:500514823worker2 # [ 87.736302] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4824worker2 # [ 87.898160] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:40Z level=info event=scheduler_restarting4825worker2 # [ 87.917415] nix-grpc-daemon[1021]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4826worker2 # [ 87.924555] nix-grpc-daemon[1021]: E0000 00:00:1789896880.545153 1064 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4827worker1 # [ 87.938422] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:40Z level=info event=scheduler_connected addr=lb:500514828worker1 # [ 87.943858] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4829worker2 # [ 87.959581] nix-grpc-daemon[1021]: E0000 00:00:1789896880.545609 1064 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4830worker2 # [ 87.966228] nix-grpc-daemon[1021]: ts=2026-09-20T09:34:40Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4831worker2 # [ 87.970659] nix-daemon[830]: reaped child process 1070, status = succeeded4832worker1 # [ 88.144938] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:40Z level=info event=scheduler_connected addr=lb:500514833worker1 # [ 88.150319] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4834worker1 # [ 88.351274] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:40Z level=info event=scheduler_connected addr=lb:500514835worker1 # [ 88.356868] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4836worker1 # [ 88.559569] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:41Z level=info event=scheduler_connected addr=lb:500514837worker1 # [ 88.563884] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4838worker1 # [ 88.760216] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:41Z level=info event=scheduler_connected addr=lb:500514839worker1 # [ 88.765450] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4840worker1 # [ 88.966498] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:41Z level=info event=scheduler_connected addr=lb:500514841worker1 # [ 88.971941] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4842worker1 # [ 89.172803] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:41Z level=info event=scheduler_connected addr=lb:500514843worker1 # [ 89.178123] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4844worker1 # [ 89.378877] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:42Z level=info event=scheduler_connected addr=lb:500514845worker1 # [ 89.384243] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4846worker1 # [ 89.586726] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:42Z level=info event=scheduler_connected addr=lb:500514847worker1 # [ 89.590888] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4848worker1 # [ 89.787368] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:42Z level=info event=scheduler_connected addr=lb:500514849worker1 # [ 89.792719] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4850worker2 # [ 89.917088] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4851worker2 # [ 89.920789] systemd[1]: Stopped Nix worker-protocol over gRPC.4852worker2 # [ 89.923313] systemd[1]: nix-grpc-daemon.service: Consumed 496ms CPU time over 8.268s wall clock time, 33.5M memory peak, 18.2K incoming IP traffic, 23.5K outgoing IP traffic.4853worker2 # [ 89.939821] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4854worker2 # [ 89.947235] systemd[1]: Closed Nix worker-protocol over gRPC.4855worker2 # [ 89.951005] systemd[1]: nix-grpc-daemon.socket: Consumed 772us CPU time over 9.031s wall clock time, 256K memory peak, 18.1K incoming IP traffic, 13.6K outgoing IP traffic.4856worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4857worker1 # [ 89.993657] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:42Z level=info event=scheduler_connected addr=lb:500514858worker1 # [ 90.004466] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4859worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.10 seconds)4860worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4861worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)4862worker1 # [ 90.202064] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:42Z level=info event=scheduler_connected addr=lb:500514863worker1 # [ 90.207044] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4864worker1 # [ 90.407964] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:43Z level=info event=scheduler_connected addr=lb:500514865worker1 # [ 90.413330] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4866worker1 # [ 90.615905] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:43Z level=info event=scheduler_connected addr=lb:500514867worker1 # [ 90.620282] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4868worker1 # [ 90.816717] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:43Z level=info event=scheduler_connected addr=lb:500514869worker1 # [ 90.822084] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4870worker1 # [ 91.023013] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:43Z level=info event=scheduler_connected addr=lb:500514871worker1 # [ 91.028475] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4872worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4873worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)4874worker1 # [ 91.229167] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:43Z level=info event=scheduler_connected addr=lb:500514875worker1 # [ 91.233616] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4876worker1 # [ 91.434534] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:44Z level=info event=scheduler_connected addr=lb:500514877worker1 # [ 91.440610] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4878worker1 # [ 91.446335] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:44Z level=info event=scheduler_take_over4879lb # [ 91.492698] niks3-server[1037]: 2026/09/20 09:34:43 INFO lead: acquired remote=192.168.1.3:585984880worker1 # [ 91.642615] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:44Z level=info event=scheduler_connected addr=lb:500514881worker1 # [ 91.651810] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:44Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04882lb # [ 92.164889] envoy[926]: conn peer=[2001:db8:1::3]:55688 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=8532 tx=2485 ms=602634883lb # [ 92.165151] envoy[926]: conn peer=[2001:db8:1::1]:37302 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1006 tx=305 ms=13234884lb # [ 92.165252] envoy[926]: conn peer=[2001:db8:1::4]:33190 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1653 tx=489 ms=60334885worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4886worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)4887client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24888worker1 # [ 92.560136] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:496284889worker1 # [ 92.575883] nix-daemon[836]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)4890client # don't know how to build these paths:4891client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4892worker1 # [ 92.597184] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:496284893worker1 # [ 92.612846] nix-grpc-daemon[1246]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 1/5)4894worker1 # [ 92.656479] nix-grpc-daemon[1246]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 25 ms (attempt 2/5)4895worker1 # [ 92.688972] nix-grpc-daemon[1246]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 386 ms (attempt 3/5)4896worker1 # [ 93.082596] nix-grpc-daemon[1246]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 756 ms (attempt 4/5)4897worker1 # [ 93.849649] nix-grpc-daemon[1246]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4898worker1 # [ 93.883245] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:46Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04899worker1 # [ 93.890663] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:46Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14900worker1 # [ 93.932545] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:496284901worker1 # [ 93.950897] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:496284902client # copying 1 paths to 'lb:50051'...4903client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4904worker1 # [ 93.965893] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:496284905worker1 # [ 93.984245] nix-daemon[836]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)4906worker1 # [ 94.013175] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:46Z level=info event=niks3_push_started pid=13254907worker1 # [ 94.400872] nix-daemon[836]: accepted connection from pid 1338, user nix-grpc-daemon (trusted)4908worker1 # [ 94.418928] nix-daemon[836]: reaped child process 1341, status = succeeded4909worker1 # [ 94.594200] nix-daemon[836]: accepted connection from pid 1343, user nix-grpc-daemon (trusted)4910worker1 # [ 94.611550] nix-daemon[836]: reaped child process 1346, status = succeeded4911lb # [ 94.669059] niks3-server[1037]: 2026/09/20 09:34:46 INFO Received uploads request method=POST path=/api/pending_closures4912worker1 # [ 94.636233] nix-grpc-daemon[1325]: time=2026-09-20T09:34:47.264Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4913worker1 # [ 94.637697] nix-grpc-daemon[1325]: time=2026-09-20T09:34:47.264Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4914lb # [ 94.710140] niks3-server[1037]: 2026/09/20 09:34:46 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4915worker1 # [ 94.676342] nix-grpc-daemon[1325]: time=2026-09-20T09:34:47.305Z level=INFO msg="Uploading 1 narinfos"4916lb # [ 94.724642] niks3-server[1037]: 2026/09/20 09:34:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4917lb # [ 94.734751] niks3-server[1037]: 2026/09/20 09:34:46 INFO Signed narinfos id=27 count=14918lb # [ 94.739892] niks3-server[1037]: 2026/09/20 09:34:46 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4919lb # [ 94.745530] niks3-server[1037]: 2026/09/20 09:34:46 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4920lb # [ 94.753321] niks3-server[1037]: 2026/09/20 09:34:46 INFO Completed upload id=274921worker1 # [ 94.707310] nix-grpc-daemon[1325]: time=2026-09-20T09:34:47.337Z level=INFO msg="Upload complete. (476ms)"4922worker1 # [ 94.716129] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49628 duration_s=0 paths=1 nar_bytes_in=5204923worker1 # [ 94.724257] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:496284924worker1 # [ 94.727456] nix-grpc-daemon[1325]: time=2026-09-20T09:34:47.352Z level=WARN msg="Failed to register uploaded object" key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo error="server returned 404: object is not pending upload\n"4925worker1 # [ 94.740172] nix-daemon[836]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)4926worker1 # [ 94.742505] nix-daemon[836]: reaped child process 1323, status = succeeded4927client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4928worker1 # [ 94.753001] nix-daemon[836]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)4929client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4930client # farm-a> LOG-farm-a-on-standby4931worker1 # [ 95.778038] nix-daemon[836]: reaped child process 1350, status = succeeded4932worker1 # [ 95.952336] nix-daemon[836]: accepted connection from pid 1365, user nix-grpc-daemon (trusted)4933worker1 # [ 95.969869] nix-daemon[836]: reaped child process 1368, status = succeeded4934lb # [ 96.029194] niks3-server[1037]: 2026/09/20 09:34:47 INFO Received uploads request method=POST path=/api/pending_closures4935worker1 # [ 96.000528] nix-grpc-daemon[1325]: time=2026-09-20T09:34:48.628Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4936worker1 # [ 96.002268] nix-grpc-daemon[1325]: time=2026-09-20T09:34:48.628Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4937lb # [ 96.089610] niks3-server[1037]: 2026/09/20 09:34:47 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4938worker1 # [ 96.058290] nix-grpc-daemon[1325]: time=2026-09-20T09:34:48.686Z level=INFO msg="Uploading 1 narinfos"4939lb # [ 96.102222] niks3-server[1037]: 2026/09/20 09:34:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4940lb # [ 96.109856] niks3-server[1037]: 2026/09/20 09:34:47 INFO Signed narinfos id=28 count=14941lb # [ 96.115383] niks3-server[1037]: 2026/09/20 09:34:47 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4942lb # [ 96.126782] niks3-server[1037]: 2026/09/20 09:34:47 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4943worker1 # [ 96.089078] nix-grpc-daemon[1325]: time=2026-09-20T09:34:48.719Z level=INFO msg="Upload complete. (327ms)"4944lb # [ 96.135776] niks3-server[1037]: 2026/09/20 09:34:47 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4945lb # [ 96.141254] niks3-server[1037]: 2026/09/20 09:34:47 INFO Completed upload id=284946lb # [ 96.144253] niks3-server[1037]: 2026/09/20 09:34:47 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4947worker1 # [ 96.113005] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49628 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14948worker1 # [ 96.124357] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:48Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04949worker1 # [ 96.127621] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:48Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=14950worker1 # [ 96.132480] nix-daemon[836]: reaped child process 1348, status = succeeded4951worker1 # [ 96.151676] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:496284952worker1 # [ 96.167142] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:496284953worker1 # [ 96.181717] nix-grpc-daemon[1325]: time=2026-09-20T09:34:48.811Z level=INFO msg="All 1 paths already cached"4954client # copying 1 paths to 'lb:50051'...4955client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4956worker1 # [ 96.192738] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:496284957worker1 # [ 96.209380] nix-daemon[836]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)4958worker1 # [ 96.410777] nix-daemon[836]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)4959worker1 # [ 96.430772] nix-daemon[836]: reaped child process 1377, status = succeeded4960worker1 # [ 96.607984] nix-daemon[836]: accepted connection from pid 1379, user nix-grpc-daemon (trusted)4961worker1 # [ 96.624753] nix-daemon[836]: reaped child process 1382, status = succeeded4962lb # [ 96.684573] niks3-server[1037]: 2026/09/20 09:34:48 INFO Received uploads request method=POST path=/api/pending_closures4963worker1 # [ 96.648119] nix-grpc-daemon[1325]: time=2026-09-20T09:34:49.278Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4964worker1 # [ 96.650254] nix-grpc-daemon[1325]: time=2026-09-20T09:34:49.278Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4965lb # [ 96.712909] niks3-server[1037]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4966worker1 # [ 96.682007] nix-grpc-daemon[1325]: time=2026-09-20T09:34:49.311Z level=INFO msg="Uploading 1 narinfos"4967lb # [ 96.729283] niks3-server[1037]: 2026/09/20 09:34:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4968lb # [ 96.739066] niks3-server[1037]: 2026/09/20 09:34:48 INFO Signed narinfos id=29 count=14969lb # [ 96.755704] niks3-server[1037]: 2026/09/20 09:34:48 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4970lb # [ 96.765141] niks3-server[1037]: 2026/09/20 09:34:48 INFO Completed upload id=294971worker1 # [ 96.719667] nix-grpc-daemon[1325]: time=2026-09-20T09:34:49.349Z level=INFO msg="Upload complete. (492ms)"4972lb # [ 96.770600] niks3-server[1037]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo4973worker1 # [ 96.728287] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49628 duration_s=0 paths=1 nar_bytes_in=6404974lb # [ 96.781068] niks3-server[1037]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls4975worker1 # [ 96.743089] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:496284976worker1 # [ 96.750098] nix-daemon[836]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)4977worker1 # [ 96.754788] nix-daemon[836]: reaped child process 1372, status = succeeded4978client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...4979worker1 # [ 96.768218] nix-daemon[836]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)4980client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4981client # farm-b> LOG-farm-b-on-standby4982worker1 # [ 98.198999] nix-daemon[836]: reaped child process 1386, status = succeeded4983worker1 # [ 98.372904] nix-daemon[836]: accepted connection from pid 1401, user nix-grpc-daemon (trusted)4984worker1 # [ 98.390251] nix-daemon[836]: reaped child process 1404, status = succeeded4985lb # [ 98.449114] niks3-server[1037]: 2026/09/20 09:34:50 INFO Received uploads request method=POST path=/api/pending_closures4986worker1 # [ 98.419783] nix-grpc-daemon[1325]: time=2026-09-20T09:34:51.049Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4987worker1 # [ 98.421430] nix-grpc-daemon[1325]: time=2026-09-20T09:34:51.049Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"4988lb # [ 98.490736] niks3-server[1037]: 2026/09/20 09:34:50 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4989lb # [ 98.507601] niks3-server[1037]: 2026/09/20 09:34:50 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst4990worker1 # [ 98.470454] nix-grpc-daemon[1325]: time=2026-09-20T09:34:51.100Z level=INFO msg="Uploading 1 narinfos"4991lb # [ 98.520173] niks3-server[1037]: 2026/09/20 09:34:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4992lb # [ 98.529107] niks3-server[1037]: 2026/09/20 09:34:50 INFO Signed narinfos id=30 count=14993worker1 # [ 98.491401] nix-grpc-daemon[1325]: time=2026-09-20T09:34:51.121Z level=INFO msg="Upload complete. (311ms)"4994lb # [ 98.537910] niks3-server[1037]: 2026/09/20 09:34:50 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls4995lb # [ 98.542165] niks3-server[1037]: 2026/09/20 09:34:50 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete4996lb # [ 98.546977] niks3-server[1037]: 2026/09/20 09:34:50 INFO Completed upload id=304997lb # [ 98.549505] niks3-server[1037]: 2026/09/20 09:34:50 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo4998worker1 # [ 98.508467] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49628 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=14999worker1 # [ 98.520923] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:51Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05000worker1 # [ 98.526210] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:51Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15001worker1 # [ 98.530005] nix-daemon[836]: reaped child process 1384, status = succeeded5002worker1 # [ 98.563317] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:496285003worker1 # [ 98.578899] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:496285004worker1 # [ 98.593060] nix-grpc-daemon[1325]: time=2026-09-20T09:34:51.223Z level=INFO msg="All 2 paths already cached"5005client # copying 1 paths to 'lb:50051'...5006client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5007worker1 # [ 98.603644] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:496285008worker1 # [ 98.618872] nix-daemon[836]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)5009worker1 # [ 98.826259] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5010worker1 # [ 98.844514] nix-daemon[836]: reaped child process 1413, status = succeeded5011worker1 # [ 99.016474] nix-daemon[836]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5012worker1 # [ 99.034908] nix-daemon[836]: reaped child process 1418, status = succeeded5013lb # [ 99.091966] niks3-server[1037]: 2026/09/20 09:34:50 INFO Received uploads request method=POST path=/api/pending_closures5014worker1 # [ 99.056973] nix-grpc-daemon[1325]: time=2026-09-20T09:34:51.686Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5015worker1 # [ 99.058510] nix-grpc-daemon[1325]: time=2026-09-20T09:34:51.686Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5016lb # [ 99.119202] niks3-server[1037]: 2026/09/20 09:34:50 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5017lb # [ 99.133141] niks3-server[1037]: 2026/09/20 09:34:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5018worker1 # [ 99.095377] nix-grpc-daemon[1325]: time=2026-09-20T09:34:51.724Z level=INFO msg="Uploading 1 narinfos"5019lb # [ 99.145872] niks3-server[1037]: 2026/09/20 09:34:50 INFO Signed narinfos id=31 count=15020lb # [ 99.151505] niks3-server[1037]: 2026/09/20 09:34:50 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5021lb # [ 99.161176] niks3-server[1037]: 2026/09/20 09:34:50 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5022lb # [ 99.165505] niks3-server[1037]: 2026/09/20 09:34:50 INFO Completed upload id=315023worker1 # [ 99.120447] nix-grpc-daemon[1325]: time=2026-09-20T09:34:51.750Z level=INFO msg="Upload complete. (483ms)"5024lb # [ 99.167916] niks3-server[1037]: 2026/09/20 09:34:50 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5025worker1 # [ 99.128244] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49628 duration_s=0 paths=1 nar_bytes_in=7685026worker1 # [ 99.140384] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:496285027worker1 # [ 99.146542] nix-daemon[836]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)5028worker1 # [ 99.151452] nix-daemon[836]: reaped child process 1408, status = succeeded5029client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5030worker1 # [ 99.163021] nix-daemon[836]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)5031client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5032client # farm-top> LOG-farm-top-on-standby5033worker1 # [ 100.000933] nix-daemon[836]: reaped child process 1422, status = succeeded5034worker1 # [ 100.184724] nix-daemon[836]: accepted connection from pid 1437, user nix-grpc-daemon (trusted)5035worker1 # [ 100.203009] nix-daemon[836]: reaped child process 1440, status = succeeded5036lb # [ 100.261584] niks3-server[1037]: 2026/09/20 09:34:51 INFO Received uploads request method=POST path=/api/pending_closures5037worker1 # [ 100.227419] nix-grpc-daemon[1325]: time=2026-09-20T09:34:52.857Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5038worker1 # [ 100.230872] nix-grpc-daemon[1325]: time=2026-09-20T09:34:52.859Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5039lb # [ 100.302206] niks3-server[1037]: 2026/09/20 09:34:51 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5040lb # [ 100.313902] niks3-server[1037]: 2026/09/20 09:34:51 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5041lb # [ 100.323417] niks3-server[1037]: 2026/09/20 09:34:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5042worker1 # [ 100.285816] nix-grpc-daemon[1325]: time=2026-09-20T09:34:52.915Z level=INFO msg="Uploading 1 narinfos"5043lb # [ 100.336343] niks3-server[1037]: 2026/09/20 09:34:51 INFO Signed narinfos id=32 count=15044lb # [ 100.339604] niks3-server[1037]: 2026/09/20 09:34:51 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5045lb # [ 100.354730] niks3-server[1037]: 2026/09/20 09:34:51 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5046lb # [ 100.360727] niks3-server[1037]: 2026/09/20 09:34:51 INFO Completed upload id=325047worker1 # [ 100.315639] nix-grpc-daemon[1325]: time=2026-09-20T09:34:52.945Z level=INFO msg="Upload complete. (340ms)"5048lb # [ 100.368282] niks3-server[1037]: 2026/09/20 09:34:51 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5049worker1 # [ 100.332451] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49628 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15050worker1 # [ 100.347110] nix-daemon[836]: reaped child process 1420, status = succeeded5051client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 8.08 seconds)5052client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5053client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds)5054worker2 # [ 100.692904] systemd[1]: Listening on Nix worker-protocol over gRPC.5055worker2 # [ 100.700637] systemd[1]: Starting Nix worker-protocol over gRPC...5056worker2 # [ 100.891751] nix-grpc-daemon[1114]: ts=2026-09-20T09:34:53Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5057worker2 # [ 100.894411] nix-grpc-daemon[1114]: ts=2026-09-20T09:34:53Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15058worker2 # [ 100.902038] nix-grpc-daemon[1114]: ts=2026-09-20T09:34:53Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5059worker2 # [ 100.910640] systemd[1]: Started Nix worker-protocol over gRPC.5060lb: must succeed: curl -sf localhost:9901/clusters5061worker2 # [ 100.957477] nix-grpc-daemon[1114]: ts=2026-09-20T09:34:53Z level=info event=scheduler_connected addr=lb:500515062worker1 # [ 100.973211] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:53Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05063lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5064worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5065worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5066lb: must succeed: curl -sf localhost:9901/clusters5067lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5068lb: must succeed: curl -sf localhost:9901/clusters5069lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5070worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5071worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5072(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.78 seconds)5073subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5074client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5075client # [ 101.413036] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5076client # Running as unit: rs.service; invocation ID: 65f1e4146687434cad839da947e562935077client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5078client # [ 101.653763] nix[1176]: don't know how to build these paths:5079client # [ 101.654809] nix[1176]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5080worker1 # [ 101.665560] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:496285081worker1 # [ 101.679410] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:54Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05082worker1 # [ 101.686514] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:54Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15083worker1 # [ 101.727106] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:496285084worker1 # [ 101.743896] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:496285085client # [ 101.744234] nix[1176]: copying 1 paths to 'lb:50051'...5086client # [ 101.748892] nix[1176]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5087worker1 # [ 101.762095] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:496285088worker1 # [ 101.777565] nix-daemon[836]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)5089worker1 # [ 101.986703] nix-daemon[836]: accepted connection from pid 1455, user nix-grpc-daemon (trusted)5090worker1 # [ 102.005930] nix-daemon[836]: reaped child process 1458, status = succeeded5091lb # [ 102.159684] envoy[926]: conn peer=[2001:db8:1::1]:52720 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9593 tx=3841 ms=77865092worker1 # [ 102.183284] nix-daemon[836]: accepted connection from pid 1460, user nix-grpc-daemon (trusted)5093worker1 # [ 102.203818] nix-daemon[836]: reaped child process 1463, status = succeeded5094lb # [ 102.261595] niks3-server[1037]: 2026/09/20 09:34:53 INFO Received uploads request method=POST path=/api/pending_closures5095worker1 # [ 102.226956] nix-grpc-daemon[1325]: time=2026-09-20T09:34:54.856Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5096worker1 # [ 102.229028] nix-grpc-daemon[1325]: time=2026-09-20T09:34:54.858Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5097lb # [ 102.292433] niks3-server[1037]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5098worker1 # [ 102.260924] nix-grpc-daemon[1325]: time=2026-09-20T09:34:54.890Z level=INFO msg="Uploading 1 narinfos"5099lb # [ 102.307918] niks3-server[1037]: 2026/09/20 09:34:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5100lb # [ 102.318611] niks3-server[1037]: 2026/09/20 09:34:53 INFO Signed narinfos id=33 count=15101lb # [ 102.326002] niks3-server[1037]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5102lb # [ 102.332207] niks3-server[1037]: 2026/09/20 09:34:53 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5103lb # [ 102.341921] niks3-server[1037]: 2026/09/20 09:34:53 INFO Completed upload id=335104worker1 # [ 102.296795] nix-grpc-daemon[1325]: time=2026-09-20T09:34:54.926Z level=INFO msg="Upload complete. (502ms)"5105lb # [ 102.345065] niks3-server[1037]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5106worker1 # [ 102.304161] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49628 duration_s=0 paths=1 nar_bytes_in=4165107worker1 # [ 102.319852] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:496285108worker1 # [ 102.326855] nix-daemon[836]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)5109worker1 # [ 102.331837] nix-daemon[836]: reaped child process 1453, status = succeeded5110client # [ 102.330040] nix[1176]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5111worker1 # [ 102.346487] nix-daemon[836]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)5112lb: must succeed: curl -sf localhost:9901/clusters5113lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5114lb: must succeed: curl -sf localhost:9901/clusters5115lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5116lb: must succeed: curl -sf localhost:9901/clusters5117lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5118lb: must succeed: curl -sf localhost:9901/clusters5119lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5120worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5121worker2 # [ 104.375967] systemd-journald[273]: Received client request to rotate journal, rotating.5122worker2 # [ 104.402107] systemd-journald[273]: Vacuuming done, freed 0B of archived journals from /var/log/journal/a8f1addbc49b430da47ebc4199f146c3.5123worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)5124worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5125worker1 # [ 104.473998] systemd[1]: Stopping Nix worker-protocol over gRPC...5126worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5127client: must succeed: sleep 5.05128worker1 # [ 105.447885] nix-grpc-daemon[1246]: ts=2026-09-20T09:34:58Z level=info event=draining5129client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5130worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5131worker1 # [ 110.003426] nix-daemon[836]: reaped child process 1467, status = succeeded5132worker1 # [ 110.189640] nix-daemon[836]: accepted connection from pid 1507, user nix-grpc-daemon (trusted)5133worker1 # [ 110.207387] nix-daemon[836]: reaped child process 1510, status = succeeded5134lb # [ 110.265364] niks3-server[1037]: 2026/09/20 09:35:01 INFO Received uploads request method=POST path=/api/pending_closures5135worker1 # [ 110.230019] nix-grpc-daemon[1325]: time=2026-09-20T09:35:02.859Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5136worker1 # [ 110.231525] nix-grpc-daemon[1325]: time=2026-09-20T09:35:02.859Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5137lb # [ 110.309357] niks3-server[1037]: 2026/09/20 09:35:01 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5138worker1 # [ 110.276319] nix-grpc-daemon[1325]: time=2026-09-20T09:35:02.906Z level=INFO msg="Uploading 1 narinfos"5139lb # [ 110.325513] niks3-server[1037]: 2026/09/20 09:35:01 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5140lb # [ 110.333733] niks3-server[1037]: 2026/09/20 09:35:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5141lb # [ 110.339313] niks3-server[1037]: 2026/09/20 09:35:01 INFO Signed narinfos id=34 count=15142lb # [ 110.345717] niks3-server[1037]: 2026/09/20 09:35:01 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5143lb # [ 110.349709] niks3-server[1037]: 2026/09/20 09:35:01 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5144worker1 # [ 110.304372] nix-grpc-daemon[1325]: time=2026-09-20T09:35:02.934Z level=INFO msg="Upload complete. (340ms)"5145lb # [ 110.353560] niks3-server[1037]: 2026/09/20 09:35:01 INFO Completed upload id=345146lb # [ 110.356951] niks3-server[1037]: 2026/09/20 09:35:01 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5147worker1 # [ 110.318127] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49628 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15148worker1 # [ 110.336447] nix-daemon[836]: reaped child process 1465, status = succeeded5149client # [ 110.349925] systemd[1]: rs.service: Deactivated successfully.5150client # [ 110.354355] systemd[1]: rs.service: Consumed 159ms CPU time over 8.940s wall clock time, 39.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5151worker1 # [ 110.449153] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:03Z level=info event=signal_exit5152worker1 # [ 110.668242] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:03Z level=info event=scheduler_yield5153worker1 # [ 110.676827] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:03Z level=info event=scheduler_restarting addr=lb:500515154lb # [ 110.716243] niks3-server[1037]: 2026/09/20 09:35:02 INFO lead: released remote=192.168.1.3:585985155worker2 # [ 110.666590] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:03Z level=info event=scheduler_restarting addr=lb:500515156worker1 # [ 110.683301] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:03Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:496205157worker1 # [ 110.688319] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:03Z level=info event=worker_gone addr=192.168.1.3:500515158worker1 # [ 110.692307] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:03Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:496205159worker1 # [ 110.697105] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:03Z level=info event=worker_gone addr=192.168.1.4:500515160worker1 # [ 110.877937] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:03Z level=info event=scheduler_connected addr=lb:500515161worker2 # [ 110.866638] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:03Z level=info event=scheduler_connected addr=lb:500515162worker1 # [ 110.883257] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5163worker2 # [ 110.872267] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5164lb # [ 110.969135] niks3-server[1037]: 2026/09/20 09:35:02 INFO lead: acquired remote=192.168.1.4:330385165worker2 # [ 110.917153] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:03Z level=info event=scheduler_take_over5166worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.13 seconds)5167client: waiting for success: ! systemctl is-active rs5168client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5169client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5170worker1 # [ 111.084410] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:03Z level=info event=scheduler_connected addr=lb:500515171worker2 # [ 111.073450] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:03Z level=info event=scheduler_connected addr=lb:500515172worker1 # [ 111.089858] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5173worker2 # [ 111.079474] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5174client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5175client: must fail: journalctl -u rs | grep -q 'reconnecting'5176client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5177lb: must succeed: curl -sf localhost:9901/clusters5178lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5179worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5180worker1 # [ 111.290834] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:03Z level=info event=scheduler_connected addr=lb:500515181worker2 # [ 111.281850] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:03Z level=info event=scheduler_connected addr=lb:500515182worker1 # [ 111.296442] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5183worker2 # [ 111.288292] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5184worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5185worker2 # [ 111.482973] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:04Z level=info event=scheduler_connected addr=lb:500515186worker1 # [ 111.499274] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:04Z level=info event=scheduler_connected addr=lb:500515187worker2 # [ 111.488483] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5188worker1 # [ 111.503698] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5189worker1 # [ 111.673897] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:04Z level=info event=scheduler_restarting5190worker2 # [ 111.691236] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:04Z level=info event=scheduler_connected addr=lb:500515191worker2 # [ 111.695469] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5192worker1 # [ 111.727727] nix-grpc-daemon[1246]: ts=2026-09-20T09:35:04Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5193worker1 # [ 111.733474] nix-daemon[836]: reaped child process 1316, status = succeeded5194worker2 # [ 111.892063] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:04Z level=info event=scheduler_connected addr=lb:500515195worker2 # [ 111.897179] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5196worker2 # [ 112.098259] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:04Z level=info event=scheduler_connected addr=lb:500515197lb # [ 112.161573] envoy[926]: conn peer=[2001:db8:1::1]:53514 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1348 ms=86695198lb # [ 112.166921] envoy[926]: conn peer=[2001:db8:1::3]:34142 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4970 tx=1483 ms=252285199worker2 # [ 112.117297] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:04Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05200lb: must succeed: curl -sf localhost:9901/clusters5201lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5202worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5203worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5204worker1 # [ 112.519922] nix-grpc-daemon[1246]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5205worker1 # [ 112.524477] nix-grpc-daemon[1246]: E0000 00:00:1789896905.148634 1289 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5206worker1 # [ 112.531719] nix-grpc-daemon[1246]: E0000 00:00:1789896905.161578 1289 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5207worker1 # [ 113.192439] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5208worker1 # [ 113.195501] systemd[1]: Stopped Nix worker-protocol over gRPC.5209worker1 # [ 113.200785] systemd[1]: nix-grpc-daemon.service: Consumed 1.849s CPU time over 26.979s wall clock time, 35.8M memory peak, 48.9K incoming IP traffic, 92.1K outgoing IP traffic.5210worker1 # [ 113.216900] systemd[1]: Starting Nix worker-protocol over gRPC...5211worker1 # [ 113.415153] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5212worker1 # [ 113.419092] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:06Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15213worker1 # [ 113.426912] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:06Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5214worker1 # [ 113.430716] systemd[1]: Started Nix worker-protocol over gRPC.5215worker1 # [ 113.462447] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:06Z level=info event=scheduler_connected addr=lb:500515216worker2 # [ 113.454344] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05217lb: must succeed: curl -sf localhost:9901/clusters5218lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5219worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5220worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5221(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.30 seconds)5222subtest: scheduler restart mid-build: build finishes, no double build5223client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5224client # [ 113.711260] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5225client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds)5226worker2 # [ 113.964224] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:437405227worker2 # [ 113.980119] nix-daemon[830]: accepted connection from pid 1114, user nix-grpc-daemon (trusted)5228client # Running as unit: mid.service; invocation ID: de1b63539fd647949ebee8682010b5a55229client # [ 113.997391] nix[1212]: don't know how to build these paths:5230client # [ 114.001531] nix[1212]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5231worker2 # [ 114.014545] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:06Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05232worker2 # [ 114.021415] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:06Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15233worker2 # [ 114.059795] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437405234worker2 # [ 114.077071] nix-grpc-daemon[1114]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 1/5)5235worker2 # [ 114.084865] nix-grpc-daemon[1114]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 2/5)5236worker2 # [ 114.106917] nix-grpc-daemon[1114]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 143 ms (attempt 3/5)5237worker2 # [ 114.257678] nix-grpc-daemon[1114]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 515 ms (attempt 4/5)5238worker2 # [ 114.781810] nix-grpc-daemon[1114]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5239worker2 # [ 114.804975] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437405240client # [ 114.820202] nix[1212]: copying 1 paths to 'lb:50051'...5241worker2 # [ 114.821053] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437405242client # [ 114.820511] nix[1212]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5243worker2 # [ 114.834088] nix-daemon[830]: accepted connection from pid 1114, user nix-grpc-daemon (trusted)5244worker2 # [ 114.865998] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:07Z level=info event=niks3_push_started pid=12375245worker2 # [ 115.275944] nix-daemon[830]: accepted connection from pid 1254, user nix-grpc-daemon (trusted)5246worker2 # [ 115.293853] nix-daemon[830]: reaped child process 1257, status = succeeded5247worker2 # [ 115.470709] nix-daemon[830]: accepted connection from pid 1259, user nix-grpc-daemon (trusted)5248worker2 # [ 115.488391] nix-daemon[830]: reaped child process 1262, status = succeeded5249lb # [ 115.557971] niks3-server[1037]: 2026/09/20 09:35:07 INFO Received uploads request method=POST path=/api/pending_closures5250worker2 # [ 115.512427] nix-grpc-daemon[1237]: time=2026-09-20T09:35:08.139Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5251worker2 # [ 115.513894] nix-grpc-daemon[1237]: time=2026-09-20T09:35:08.139Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5252lb # [ 115.603828] niks3-server[1037]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5253worker2 # [ 115.560472] nix-grpc-daemon[1237]: time=2026-09-20T09:35:08.188Z level=INFO msg="Uploading 1 narinfos"5254lb # [ 115.617339] niks3-server[1037]: 2026/09/20 09:35:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5255lb # [ 115.623698] niks3-server[1037]: 2026/09/20 09:35:07 INFO Signed narinfos id=35 count=15256lb # [ 115.631975] niks3-server[1037]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5257lb # [ 115.645520] niks3-server[1037]: 2026/09/20 09:35:07 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5258worker2 # [ 115.593211] nix-grpc-daemon[1237]: time=2026-09-20T09:35:08.221Z level=INFO msg="Upload complete. (492ms)"5259lb # [ 115.652648] niks3-server[1037]: 2026/09/20 09:35:07 INFO Completed upload id=355260lb # [ 115.656432] niks3-server[1037]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5261worker2 # [ 115.605300] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43740 duration_s=0 paths=1 nar_bytes_in=4245262worker2 # [ 115.615668] nix-grpc-daemon[1114]: ts=2026-09-20T09:35:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437405263worker2 # [ 115.622627] nix-daemon[830]: accepted connection from pid 1114, user nix-grpc-daemon (trusted)5264worker2 # [ 115.627692] nix-daemon[830]: reaped child process 1235, status = succeeded5265client # [ 115.638019] nix[1212]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5266worker2 # [ 115.640988] nix-daemon[830]: accepted connection from pid 1114, user nix-grpc-daemon (trusted)5267lb: must succeed: curl -sf localhost:9901/clusters5268lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5269lb: must succeed: curl -sf localhost:9901/clusters5270lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5271worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5272worker2 # [ 117.698195] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1114 (nix-grpc-daemon) on client request.5273worker2 # [ 117.701482] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5274lb # [ 117.764977] niks3-server[1037]: 2026/09/20 09:35:09 INFO lead: released remote=192.168.1.4:330385275client # [ 117.716343] nix[1212]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5276worker1 # [ 117.728365] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:10Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5277worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.07 seconds)5278client: must succeed: sleep 5.05279client # [ 117.722815] nix[1212]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5280worker2 # [ 117.742785] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5281worker2 # [ 117.745190] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5282worker2 # [ 117.746460] systemd[1]: nix-grpc-daemon.service: Consumed 556ms CPU time over 17.035s wall clock time, 33.6M memory peak, 14.8K incoming IP traffic, 22.8K outgoing IP traffic.5283worker2 # [ 117.756573] nix-daemon[830]: reaped child process 1228, status = succeeded5284worker2 # [ 117.757705] nix-daemon[830]: reaped child process 1264, status = succeeded5285worker2 # [ 117.764409] nix-daemon[1266]: unexpected Nix daemon error: error: interrupted by the user5286worker2 # [ 117.772880] nix-daemon[830]: reaped child process 1266, status = failed with exit code 15287worker2 # [ 117.848101] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5288worker2 # [ 117.857441] systemd[1]: Starting Nix worker-protocol over gRPC...5289worker1 # [ 117.928387] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:10Z level=info event=scheduler_connected addr=lb:500515290worker2 # [ 118.049706] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:10Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5291worker2 # [ 118.052135] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:10Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15292worker2 # [ 118.059934] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:10Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5293lb # [ 118.133516] niks3-server[1037]: 2026/09/20 09:35:09 INFO lead: acquired remote=192.168.1.4:463345294worker2 # [ 118.081891] systemd[1]: Started Nix worker-protocol over gRPC.5295worker2 # [ 118.082782] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:10Z level=info event=scheduler_take_over5296worker2 # [ 118.094599] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:10Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05297worker2 # [ 118.108216] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:10Z level=info event=scheduler_connected addr=lb:500515298worker2 # [ 118.110122] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:10Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05299worker2 # [ 118.234504] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:10Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05300worker2 # [ 118.240673] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:10Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15301worker1 # [ 118.307591] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576685302worker1 # [ 118.322128] nix-daemon[836]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)5303worker1 # [ 118.347449] nix-grpc-daemon[1517]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 96 ms (attempt 1/5)5304worker1 # [ 118.450892] nix-grpc-daemon[1517]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 130 ms (attempt 2/5)5305worker1 # [ 118.588701] nix-grpc-daemon[1517]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 256 ms (attempt 3/5)5306worker1 # [ 118.853545] nix-grpc-daemon[1517]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 729 ms (attempt 4/5)5307worker1 # [ 119.582133] nix-grpc-daemon[1517]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5308worker1 # [ 119.602172] nix-grpc-daemon[1517]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5309worker1 # [ 119.630818] nix-daemon[836]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)5310client # [ 119.636773] nix[1212]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5311worker1 # [ 119.652571] nix-daemon[836]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)5312lb # [ 122.162688] envoy[926]: conn peer=[2001:db8:1::4]:45816 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1436 tx=526 ms=167705313client: (finished: must succeed: sleep 5.0, in 5.07 seconds)5314client: waiting for success: ! systemctl is-active mid5315worker1 # [ 123.290574] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:15Z level=info event=niks3_push_started pid=16185316worker1 # [ 123.352767] nix-daemon[836]: reaped child process 1594, status = succeeded5317worker1 # [ 123.791839] nix-daemon[836]: accepted connection from pid 1631, user nix-grpc-daemon (trusted)5318worker1 # [ 123.811258] nix-daemon[836]: reaped child process 1634, status = succeeded5319lb # [ 123.877145] niks3-server[1037]: 2026/09/20 09:35:15 INFO Received uploads request method=POST path=/api/pending_closures5320worker1 # [ 123.852672] nix-grpc-daemon[1618]: time=2026-09-20T09:35:16.480Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5321worker1 # [ 123.854461] nix-grpc-daemon[1618]: time=2026-09-20T09:35:16.480Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5322lb # [ 123.966352] niks3-server[1037]: 2026/09/20 09:35:15 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5323worker1 # [ 123.936261] nix-grpc-daemon[1618]: time=2026-09-20T09:35:16.565Z level=INFO msg="Uploading 1 narinfos"5324lb # [ 123.981153] niks3-server[1037]: 2026/09/20 09:35:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5325lb # [ 123.992653] niks3-server[1037]: 2026/09/20 09:35:15 INFO Signed narinfos id=36 count=15326lb # [ 124.011183] niks3-server[1037]: 2026/09/20 09:35:15 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5327lb # [ 124.028151] niks3-server[1037]: 2026/09/20 09:35:15 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5328lb # [ 124.042568] niks3-server[1037]: 2026/09/20 09:35:15 INFO Completed upload id=365329worker1 # [ 123.998111] nix-grpc-daemon[1618]: time=2026-09-20T09:35:16.627Z level=INFO msg="Upload complete. (402ms)"5330lb # [ 124.063016] niks3-server[1037]: 2026/09/20 09:35:15 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5331worker1 # [ 124.012660] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57668 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15332worker1 # [ 124.036592] nix-grpc-daemon[1618]: time=2026-09-20T09:35:16.654Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5333worker1 # [ 124.047352] nix-daemon[836]: reaped child process 1592, status = succeeded5334client # [ 124.072584] systemd[1]: mid.service: Deactivated successfully.5335client # [ 124.079793] systemd[1]: mid.service: Consumed 199ms CPU time over 10.366s wall clock time, 39M memory peak, 9.9K incoming IP traffic, 10.7K outgoing IP traffic.5336client: (finished: waiting for success: ! systemctl is-active mid, in 1.19 seconds)5337client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5338client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5339(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.80 seconds)5340subtest: interrupting the client stops the build on the worker5341client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5342client # [ 124.484941] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5343client # Running as unit: intr.service; invocation ID: d69137d17dbd43598a84e7bfb291e3a95344client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.07 seconds)5345worker1 # [ 124.781265] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:576685346client # [ 124.779843] nix[1248]: don't know how to build these paths:5347client # [ 124.781226] nix[1248]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5348worker2 # [ 124.803077] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:17Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05349worker2 # [ 124.811586] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:17Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15350worker2 # [ 124.867978] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603525351worker2 # [ 124.887250] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5352worker2 # [ 124.920541] nix-grpc-daemon[1302]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 1/5)5353worker2 # [ 124.980285] nix-grpc-daemon[1302]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 173 ms (attempt 2/5)5354worker2 # [ 125.161294] nix-grpc-daemon[1302]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 3/5)5355worker2 # [ 125.222628] nix-grpc-daemon[1302]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 73 ms (attempt 4/5)5356worker2 # [ 125.303801] nix-grpc-daemon[1302]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5357worker2 # [ 125.325613] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603525358client # [ 125.338184] nix[1248]: copying 1 paths to 'lb:50051'...5359worker2 # [ 125.344104] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603525360client # [ 125.347853] nix[1248]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5361worker2 # [ 125.360182] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5362worker2 # [ 125.397095] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:18Z level=info event=niks3_push_started pid=13745363worker2 # [ 125.795693] nix-daemon[830]: accepted connection from pid 1387, user nix-grpc-daemon (trusted)5364worker2 # [ 125.817177] nix-daemon[830]: reaped child process 1390, status = succeeded5365worker2 # [ 125.999878] nix-daemon[830]: accepted connection from pid 1396, user nix-grpc-daemon (trusted)5366worker2 # [ 126.017810] nix-daemon[830]: reaped child process 1399, status = succeeded5367lb # [ 126.087095] niks3-server[1037]: 2026/09/20 09:35:17 INFO Received uploads request method=POST path=/api/pending_closures5368worker2 # [ 126.046345] nix-grpc-daemon[1374]: time=2026-09-20T09:35:18.672Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5369worker2 # [ 126.047809] nix-grpc-daemon[1374]: time=2026-09-20T09:35:18.672Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5370lb # [ 126.130531] niks3-server[1037]: 2026/09/20 09:35:17 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5371lb # [ 126.139732] niks3-server[1037]: 2026/09/20 09:35:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5372worker2 # [ 126.090415] nix-grpc-daemon[1374]: time=2026-09-20T09:35:18.718Z level=INFO msg="Uploading 1 narinfos"5373lb # [ 126.155963] niks3-server[1037]: 2026/09/20 09:35:17 INFO Signed narinfos id=37 count=15374lb # [ 126.174237] niks3-server[1037]: 2026/09/20 09:35:17 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5375lb # [ 126.183163] niks3-server[1037]: 2026/09/20 09:35:17 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5376lb # [ 126.188511] niks3-server[1037]: 2026/09/20 09:35:17 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5377lb # [ 126.192106] niks3-server[1037]: 2026/09/20 09:35:17 INFO Completed upload id=375378worker2 # [ 126.135290] nix-grpc-daemon[1374]: time=2026-09-20T09:35:18.763Z level=INFO msg="Upload complete. (507ms)"5379worker2 # [ 126.145093] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60352 duration_s=0 paths=1 nar_bytes_in=4245380worker2 # [ 126.160497] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603525381worker2 # [ 126.170687] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5382worker2 # [ 126.173898] nix-daemon[830]: reaped child process 1372, status = succeeded5383client # [ 126.184664] nix[1248]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5384worker2 # [ 126.188511] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5385client: must succeed: systemctl kill -s INT intr5386worker2 # [ 127.080487] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:19Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5387client # [ 127.078499] nix[1248]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5388client # [ 127.080803] systemd[1]: intr.service: Sent signal SIGINT to main process 1248 (nix) on client request.5389client: (finished: must succeed: systemctl kill -s INT intr, in 0.07 seconds)5390client # [ 127.094845] nix[1248]: error: interrupted by the user5391client # [ 127.123459] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5392client # [ 127.126654] systemd[1]: intr.service: Failed with result 'exit-code'.5393client # [ 127.129494] systemd[1]: intr.service: Consumed 187ms CPU time over 2.641s wall clock time, 39.2M memory peak, 7.5K incoming IP traffic, 8.9K outgoing IP traffic.5394worker2 # [ 127.218981] nix-daemon[1403]: unexpected Nix daemon error: error: interrupted by the user5395worker2 # [ 127.244201] nix-daemon[830]: reaped child process 1401, status = succeeded5396worker2 # [ 127.245319] nix-daemon[830]: reaped child process 1403, status = failed with exit code 15397(finished: subtest: interrupting the client stops the build on the worker, in 2.81 seconds)5398subtest: a deploy mid-build drains: the build finishes, the new generation takes over5399client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5400client # [ 127.315144] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5401client # Running as unit: sw.service; invocation ID: 73f9d5e1946e45548e357e858df3bd715402client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5403client # [ 127.541468] nix[1268]: don't know how to build these paths:5404client # [ 127.542391] nix[1268]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5405worker2 # [ 127.541194] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:603525406worker2 # [ 127.555341] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:20Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05407worker2 # [ 127.561425] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:20Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15408worker1 # [ 127.616736] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576685409worker1 # [ 127.634353] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576685410client # [ 127.638599] nix[1268]: copying 1 paths to 'lb:50051'...5411worker1 # [ 127.649801] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:576685412client # [ 127.641507] nix[1268]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5413worker1 # [ 127.669916] nix-daemon[836]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)5414worker1 # [ 127.880537] nix-daemon[836]: accepted connection from pid 1658, user nix-grpc-daemon (trusted)5415worker1 # [ 127.898017] nix-daemon[836]: reaped child process 1661, status = succeeded5416worker1 # [ 128.076971] nix-daemon[836]: accepted connection from pid 1663, user nix-grpc-daemon (trusted)5417worker1 # [ 128.094310] nix-daemon[836]: reaped child process 1666, status = succeeded5418lb # [ 128.152910] niks3-server[1037]: 2026/09/20 09:35:19 INFO Received uploads request method=POST path=/api/pending_closures5419worker1 # [ 128.118124] nix-grpc-daemon[1618]: time=2026-09-20T09:35:20.747Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5420worker1 # [ 128.119607] nix-grpc-daemon[1618]: time=2026-09-20T09:35:20.747Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5421lb # [ 128.182341] niks3-server[1037]: 2026/09/20 09:35:19 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5422lb # [ 128.198796] niks3-server[1037]: 2026/09/20 09:35:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5423worker1 # [ 128.160162] nix-grpc-daemon[1618]: time=2026-09-20T09:35:20.789Z level=INFO msg="Uploading 1 narinfos"5424lb # [ 128.210646] niks3-server[1037]: 2026/09/20 09:35:19 INFO Signed narinfos id=38 count=15425lb # [ 128.216261] niks3-server[1037]: 2026/09/20 09:35:19 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5426lb # [ 128.222304] niks3-server[1037]: 2026/09/20 09:35:19 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5427lb # [ 128.228858] niks3-server[1037]: 2026/09/20 09:35:19 INFO Completed upload id=385428worker1 # [ 128.183242] nix-grpc-daemon[1618]: time=2026-09-20T09:35:20.813Z level=INFO msg="Upload complete. (495ms)"5429lb # [ 128.231243] niks3-server[1037]: 2026/09/20 09:35:19 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5430worker1 # [ 128.193091] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57668 duration_s=0 paths=1 nar_bytes_in=4165431worker1 # [ 128.202439] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576685432worker1 # [ 128.208986] nix-daemon[836]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)5433worker1 # [ 128.213691] nix-daemon[836]: reaped child process 1656, status = succeeded5434worker1 # [ 128.224180] nix-daemon[836]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)5435client # [ 128.210888] nix[1268]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5436worker1: must succeed: systemctl reload nix-grpc-daemon.service5437worker1 # [ 130.000784] systemd[1]: Reloading Nix worker-protocol over gRPC...5438worker1 # [ 130.053775] systemd[1]: Reloaded Nix worker-protocol over gRPC.5439worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds)5440worker1: must succeed: pgrep -f 'read -t [9]0 x'5441worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5442client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25443worker2 # [ 130.355867] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:603525444client # don't know how to build these paths:5445client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5446worker2 # [ 130.367323] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603525447worker2 # [ 130.395308] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:23Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05448worker2 # [ 130.402054] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:23Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15449worker1 # [ 130.439745] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:23Z level=info event=draining5450worker2 # [ 130.437325] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603525451worker2 # [ 130.453708] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603525452client # copying 1 paths to 'lb:50051'...5453worker2 # [ 130.471428] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603525454client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5455worker2 # [ 130.495892] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5456worker2 # [ 130.702192] nix-daemon[830]: accepted connection from pid 1449, user nix-grpc-daemon (trusted)5457worker2 # [ 130.722637] nix-daemon[830]: reaped child process 1452, status = succeeded5458worker2 # [ 130.898848] nix-daemon[830]: accepted connection from pid 1454, user nix-grpc-daemon (trusted)5459worker2 # [ 130.917188] nix-daemon[830]: reaped child process 1457, status = succeeded5460lb # [ 130.985667] niks3-server[1037]: 2026/09/20 09:35:22 INFO Received uploads request method=POST path=/api/pending_closures5461worker2 # [ 130.939044] nix-grpc-daemon[1374]: time=2026-09-20T09:35:23.566Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5462worker2 # [ 130.940686] nix-grpc-daemon[1374]: time=2026-09-20T09:35:23.566Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5463lb # [ 131.018431] niks3-server[1037]: 2026/09/20 09:35:22 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5464worker2 # [ 130.973804] nix-grpc-daemon[1374]: time=2026-09-20T09:35:23.601Z level=INFO msg="Uploading 1 narinfos"5465lb # [ 131.034835] niks3-server[1037]: 2026/09/20 09:35:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5466lb # [ 131.043993] niks3-server[1037]: 2026/09/20 09:35:22 INFO Signed narinfos id=39 count=15467lb # [ 131.052248] niks3-server[1037]: 2026/09/20 09:35:22 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5468lb # [ 131.055327] niks3-server[1037]: 2026/09/20 09:35:22 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5469lb # [ 131.059837] niks3-server[1037]: 2026/09/20 09:35:22 INFO Completed upload id=395470worker2 # [ 131.003104] nix-grpc-daemon[1374]: time=2026-09-20T09:35:23.631Z level=INFO msg="Upload complete. (488ms)"5471lb # [ 131.062758] niks3-server[1037]: 2026/09/20 09:35:22 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5472worker2 # [ 131.013272] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60352 duration_s=0 paths=1 nar_bytes_in=5285473worker2 # [ 131.026142] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603525474worker2 # [ 131.032374] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5475worker2 # [ 131.036985] nix-daemon[830]: reaped child process 1447, status = succeeded5476client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5477worker2 # [ 131.047880] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5478client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5479client # farm-a> LOG-farm-a-during-drain5480worker2 # [ 132.075667] nix-daemon[830]: reaped child process 1461, status = succeeded5481lb # [ 132.164457] envoy[926]: conn peer=[2001:db8:1::1]:38764 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3858 tx=1702 ms=100705482lb # [ 132.164771] envoy[926]: conn peer=[2001:db8:1::1]:35668 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=733 ms=23495483worker2 # [ 132.242913] nix-daemon[830]: accepted connection from pid 1476, user nix-grpc-daemon (trusted)5484worker2 # [ 132.262224] nix-daemon[830]: reaped child process 1479, status = succeeded5485lb # [ 132.332740] niks3-server[1037]: 2026/09/20 09:35:23 INFO Received uploads request method=POST path=/api/pending_closures5486worker2 # [ 132.286355] nix-grpc-daemon[1374]: time=2026-09-20T09:35:24.913Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5487worker2 # [ 132.287852] nix-grpc-daemon[1374]: time=2026-09-20T09:35:24.913Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5488lb # [ 132.376616] niks3-server[1037]: 2026/09/20 09:35:24 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5489lb # [ 132.387506] niks3-server[1037]: 2026/09/20 09:35:24 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5490lb # [ 132.399590] niks3-server[1037]: 2026/09/20 09:35:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5491worker2 # [ 132.343835] nix-grpc-daemon[1374]: time=2026-09-20T09:35:24.971Z level=INFO msg="Uploading 1 narinfos"5492lb # [ 132.409421] niks3-server[1037]: 2026/09/20 09:35:24 INFO Signed narinfos id=40 count=15493lb # [ 132.411956] niks3-server[1037]: 2026/09/20 09:35:24 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5494lb # [ 132.420217] niks3-server[1037]: 2026/09/20 09:35:24 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5495lb # [ 132.429163] niks3-server[1037]: 2026/09/20 09:35:24 INFO Completed upload id=405496worker2 # [ 132.372468] nix-grpc-daemon[1374]: time=2026-09-20T09:35:25.000Z level=INFO msg="Upload complete. (311ms)"5497lb # [ 132.432099] niks3-server[1037]: 2026/09/20 09:35:24 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5498worker2 # [ 132.388768] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60352 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15499worker2 # [ 132.403574] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:25Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05500worker2 # [ 132.407341] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:25Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15501worker2 # [ 132.410877] nix-daemon[830]: reaped child process 1459, status = succeeded5502worker2 # [ 132.437457] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603525503worker2 # [ 132.452611] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603525504worker2 # [ 132.471762] nix-grpc-daemon[1374]: time=2026-09-20T09:35:25.099Z level=INFO msg="All 1 paths already cached"5505client # copying 1 paths to 'lb:50051'...5506worker2 # [ 132.482215] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603525507client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5508worker2 # [ 132.505894] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5509worker2 # [ 132.708286] nix-daemon[830]: accepted connection from pid 1485, user nix-grpc-daemon (trusted)5510worker2 # [ 132.727983] nix-daemon[830]: reaped child process 1488, status = succeeded5511worker2 # [ 132.901731] nix-daemon[830]: accepted connection from pid 1490, user nix-grpc-daemon (trusted)5512worker2 # [ 132.918246] nix-daemon[830]: reaped child process 1493, status = succeeded5513lb # [ 132.987403] niks3-server[1037]: 2026/09/20 09:35:24 INFO Received uploads request method=POST path=/api/pending_closures5514worker2 # [ 132.941434] nix-grpc-daemon[1374]: time=2026-09-20T09:35:25.569Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5515worker2 # [ 132.942917] nix-grpc-daemon[1374]: time=2026-09-20T09:35:25.569Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5516lb # [ 133.018259] niks3-server[1037]: 2026/09/20 09:35:24 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5517worker2 # [ 132.972635] nix-grpc-daemon[1374]: time=2026-09-20T09:35:25.600Z level=INFO msg="Uploading 1 narinfos"5518lb # [ 133.034378] niks3-server[1037]: 2026/09/20 09:35:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5519lb # [ 133.045100] niks3-server[1037]: 2026/09/20 09:35:24 INFO Signed narinfos id=41 count=15520lb # [ 133.049616] niks3-server[1037]: 2026/09/20 09:35:24 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5521lb # [ 133.058142] niks3-server[1037]: 2026/09/20 09:35:24 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5522worker2 # [ 133.006053] nix-grpc-daemon[1374]: time=2026-09-20T09:35:25.634Z level=INFO msg="Upload complete. (481ms)"5523lb # [ 133.063096] niks3-server[1037]: 2026/09/20 09:35:24 INFO Completed upload id=415524lb # [ 133.065982] niks3-server[1037]: 2026/09/20 09:35:24 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5525worker2 # [ 133.012260] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60352 duration_s=0 paths=1 nar_bytes_in=6405526worker2 # [ 133.024471] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603525527worker2 # [ 133.031356] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5528worker2 # [ 133.036363] nix-daemon[830]: reaped child process 1483, status = succeeded5529client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5530worker2 # [ 133.047373] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5531client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5532client # farm-b> LOG-farm-b-during-drain5533worker2 # [ 134.690291] nix-daemon[830]: reaped child process 1497, status = succeeded5534worker2 # [ 134.876297] nix-daemon[830]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)5535worker2 # [ 134.892831] nix-daemon[830]: reaped child process 1515, status = succeeded5536lb # [ 134.965661] niks3-server[1037]: 2026/09/20 09:35:26 INFO Received uploads request method=POST path=/api/pending_closures5537worker2 # [ 134.918209] nix-grpc-daemon[1374]: time=2026-09-20T09:35:27.545Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5538worker2 # [ 134.919698] nix-grpc-daemon[1374]: time=2026-09-20T09:35:27.545Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5539lb # [ 134.995116] niks3-server[1037]: 2026/09/20 09:35:26 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5540lb # [ 135.012532] niks3-server[1037]: 2026/09/20 09:35:26 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5541lb # [ 135.023072] niks3-server[1037]: 2026/09/20 09:35:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5542worker2 # [ 134.972197] nix-grpc-daemon[1374]: time=2026-09-20T09:35:27.599Z level=INFO msg="Uploading 1 narinfos"5543lb # [ 135.032491] niks3-server[1037]: 2026/09/20 09:35:26 INFO Signed narinfos id=42 count=15544lb # [ 135.037313] niks3-server[1037]: 2026/09/20 09:35:26 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5545lb # [ 135.044631] niks3-server[1037]: 2026/09/20 09:35:26 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5546lb # [ 135.051414] niks3-server[1037]: 2026/09/20 09:35:26 INFO Completed upload id=425547worker2 # [ 134.994709] nix-grpc-daemon[1374]: time=2026-09-20T09:35:27.622Z level=INFO msg="Upload complete. (335ms)"5548lb # [ 135.053876] niks3-server[1037]: 2026/09/20 09:35:26 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5549worker2 # [ 135.013101] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60352 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15550worker2 # [ 135.028379] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:27Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05551worker2 # [ 135.031995] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:27Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15552worker2 # [ 135.036709] nix-daemon[830]: reaped child process 1495, status = succeeded5553worker2 # [ 135.055846] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603525554worker2 # [ 135.072347] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603525555worker2 # [ 135.086216] nix-grpc-daemon[1374]: time=2026-09-20T09:35:27.714Z level=INFO msg="All 2 paths already cached"5556client # copying 1 paths to 'lb:50051'...5557worker2 # [ 135.096838] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603525558client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5559worker2 # [ 135.114938] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5560worker2 # [ 135.320563] nix-daemon[830]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5561worker2 # [ 135.340437] nix-daemon[830]: reaped child process 1524, status = succeeded5562worker2 # [ 135.511728] nix-daemon[830]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)5563worker2 # [ 135.530838] nix-daemon[830]: reaped child process 1529, status = succeeded5564lb # [ 135.599330] niks3-server[1037]: 2026/09/20 09:35:27 INFO Received uploads request method=POST path=/api/pending_closures5565worker2 # [ 135.552099] nix-grpc-daemon[1374]: time=2026-09-20T09:35:28.180Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5566worker2 # [ 135.554047] nix-grpc-daemon[1374]: time=2026-09-20T09:35:28.181Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5567lb # [ 135.628195] niks3-server[1037]: 2026/09/20 09:35:27 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5568lb # [ 135.642749] niks3-server[1037]: 2026/09/20 09:35:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5569worker2 # [ 135.592238] nix-grpc-daemon[1374]: time=2026-09-20T09:35:28.220Z level=INFO msg="Uploading 1 narinfos"5570lb # [ 135.656432] niks3-server[1037]: 2026/09/20 09:35:27 INFO Signed narinfos id=43 count=15571lb # [ 135.662979] niks3-server[1037]: 2026/09/20 09:35:27 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5572lb # [ 135.672344] niks3-server[1037]: 2026/09/20 09:35:27 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5573worker2 # [ 135.620731] nix-grpc-daemon[1374]: time=2026-09-20T09:35:28.248Z level=INFO msg="Upload complete. (488ms)"5574lb # [ 135.677732] niks3-server[1037]: 2026/09/20 09:35:27 INFO Completed upload id=435575lb # [ 135.680837] niks3-server[1037]: 2026/09/20 09:35:27 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5576worker2 # [ 135.628125] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60352 duration_s=0 paths=1 nar_bytes_in=7685577worker2 # [ 135.636307] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603525578worker2 # [ 135.648224] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5579worker2 # [ 135.652747] nix-daemon[830]: reaped child process 1519, status = succeeded5580client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5581client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5582worker2 # [ 135.666790] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5583client # farm-top> LOG-farm-top-during-drain5584worker2 # [ 137.303705] nix-daemon[830]: reaped child process 1533, status = succeeded5585worker2 # [ 137.472615] nix-daemon[830]: accepted connection from pid 1548, user nix-grpc-daemon (trusted)5586worker2 # [ 137.489261] nix-daemon[830]: reaped child process 1551, status = succeeded5587lb # [ 137.560681] niks3-server[1037]: 2026/09/20 09:35:29 INFO Received uploads request method=POST path=/api/pending_closures5588worker2 # [ 137.515440] nix-grpc-daemon[1374]: time=2026-09-20T09:35:30.141Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5589worker2 # [ 137.517092] nix-grpc-daemon[1374]: time=2026-09-20T09:35:30.142Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5590lb # [ 137.603237] niks3-server[1037]: 2026/09/20 09:35:29 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5591worker2 # [ 137.557493] nix-grpc-daemon[1374]: time=2026-09-20T09:35:30.185Z level=INFO msg="Uploading 1 narinfos"5592lb # [ 137.617204] niks3-server[1037]: 2026/09/20 09:35:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5593lb # [ 137.625524] niks3-server[1037]: 2026/09/20 09:35:29 INFO Signed narinfos id=44 count=15594lb # [ 137.627600] niks3-server[1037]: 2026/09/20 09:35:29 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5595lb # [ 137.633759] niks3-server[1037]: 2026/09/20 09:35:29 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5596worker2 # [ 137.584407] nix-grpc-daemon[1374]: time=2026-09-20T09:35:30.212Z level=INFO msg="Upload complete. (306ms)"5597lb # [ 137.641700] niks3-server[1037]: 2026/09/20 09:35:29 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5598lb # [ 137.645571] niks3-server[1037]: 2026/09/20 09:35:29 INFO Completed upload id=445599lb # [ 137.648500] niks3-server[1037]: 2026/09/20 09:35:29 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5600worker2 # [ 137.596573] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60352 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15601worker2 # [ 137.610139] nix-daemon[830]: reaped child process 1531, status = succeeded5602client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 7.55 seconds)5603client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5604client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds)5605worker1: must succeed: pkill -f 'read -t [9]0 x'5606worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5607client: waiting for success: ! systemctl is-active sw5608worker1 # [ 138.058775] nix-daemon[836]: reaped child process 1670, status = succeeded5609worker1 # [ 138.218339] nix-daemon[836]: accepted connection from pid 1710, user nix-grpc-daemon (trusted)5610worker1 # [ 138.237211] nix-daemon[836]: reaped child process 1713, status = succeeded5611lb # [ 138.296954] niks3-server[1037]: 2026/09/20 09:35:29 INFO Received uploads request method=POST path=/api/pending_closures5612worker1 # [ 138.262089] nix-grpc-daemon[1618]: time=2026-09-20T09:35:30.891Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5613worker1 # [ 138.263620] nix-grpc-daemon[1618]: time=2026-09-20T09:35:30.891Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5614lb # [ 138.337033] niks3-server[1037]: 2026/09/20 09:35:29 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5615worker1 # [ 138.311653] nix-grpc-daemon[1618]: time=2026-09-20T09:35:30.940Z level=INFO msg="Uploading 1 narinfos"5616lb # [ 138.348658] niks3-server[1037]: 2026/09/20 09:35:29 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5617lb # [ 138.361307] niks3-server[1037]: 2026/09/20 09:35:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5618lb # [ 138.370145] niks3-server[1037]: 2026/09/20 09:35:29 INFO Signed narinfos id=45 count=15619lb # [ 138.373385] niks3-server[1037]: 2026/09/20 09:35:29 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5620lb # [ 138.382190] niks3-server[1037]: 2026/09/20 09:35:30 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5621lb # [ 138.387348] niks3-server[1037]: 2026/09/20 09:35:30 INFO Completed upload id=455622worker1 # [ 138.341437] nix-grpc-daemon[1618]: time=2026-09-20T09:35:30.971Z level=INFO msg="Upload complete. (297ms)"5623lb # [ 138.390521] niks3-server[1037]: 2026/09/20 09:35:30 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5624worker1 # [ 138.357120] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57668 duration_s=10 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15625worker1 # [ 138.370362] nix-daemon[836]: reaped child process 1668, status = succeeded5626client # [ 138.386004] systemd[1]: sw.service: Deactivated successfully.5627client # [ 138.390444] systemd[1]: sw.service: Consumed 152ms CPU time over 11.074s wall clock time, 38.9M memory peak, 8.4K incoming IP traffic, 9K outgoing IP traffic.5628worker1 # [ 138.442658] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:31Z level=info event=signal_exit5629client: (finished: waiting for success: ! systemctl is-active sw, in 1.11 seconds)5630client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5631client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5632worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5633worker2 # [ 139.654621] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:32Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:437505634worker1 # [ 139.668837] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:32Z level=info event=scheduler_restarting5635worker2 # [ 139.655058] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:32Z level=info event=worker_gone addr=192.168.1.3:500515636worker1 # [ 139.695379] nix-grpc-daemon[1517]: ts=2026-09-20T09:35:32Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5637worker1 # [ 139.719491] nix-daemon[836]: reaped child process 1586, status = succeeded5638worker1 # [ 140.248091] nix-grpc-daemon[1517]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5639worker1 # [ 140.252736] nix-grpc-daemon[1517]: E0000 00:00:1789896932.877622 1560 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5640worker1 # [ 140.259439] nix-grpc-daemon[1517]: E0000 00:00:1789896932.877988 1560 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5641worker1 # [ 141.494746] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5642worker1 # [ 141.499895] systemd[1]: nix-grpc-daemon.service: Consumed 959ms CPU time over 28.277s wall clock time, 33.3M memory peak, 21.1K incoming IP traffic, 27.2K outgoing IP traffic.5643worker1 # [ 141.522225] systemd[1]: Starting Nix worker-protocol over gRPC...5644worker1 # [ 141.717613] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:34Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5645worker1 # [ 141.720308] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:34Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15646worker1 # [ 141.729102] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:34Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5647worker1 # [ 141.737629] systemd[1]: Started Nix worker-protocol over gRPC.5648worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.64 seconds)5649lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5650lb: must succeed: curl -sf localhost:9901/clusters5651worker1 # [ 141.770969] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:34Z level=info event=scheduler_connected addr=lb:500515652worker2 # [ 141.763803] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:34Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05653lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5654lb # [ 142.158001] envoy[926]: conn peer=[2001:db8:1::1]:35680 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9625 tx=3872 ms=72595655lb # [ 142.163068] envoy[926]: conn peer=[2001:db8:1::1]:35678 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=1326 ms=108165656lb # [ 142.168276] envoy[926]: conn peer=[2001:db8:1::3]:35270 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=986 tx=425 ms=262115657lb: must succeed: curl -sf localhost:9901/clusters5658lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5659lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds)5660lb: must succeed: curl -sf localhost:9901/clusters5661lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5662worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5663worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5664(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.81 seconds)5665subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5666client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15667worker1 # [ 143.320929] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:607405668worker1 # [ 143.335614] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5669worker1 # [ 143.355603] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607405670worker1 # [ 143.376835] nix-grpc-daemon[1727]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 1/5)5671worker1 # [ 143.456338] nix-grpc-daemon[1727]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 2/5)5672worker1 # [ 143.532757] nix-grpc-daemon[1727]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 232 ms (attempt 3/5)5673worker1 # [ 143.772598] nix-grpc-daemon[1727]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 398 ms (attempt 4/5)5674worker1 # [ 144.179530] nix-grpc-daemon[1727]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5675worker2 # [ 144.219986] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:36Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05676worker2 # [ 144.220703] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:36Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15677worker2 # [ 144.220891] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:36Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05678worker2 # [ 144.221007] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:36Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05679worker1 # [ 144.275580] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607405680worker1 # [ 144.291524] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607405681worker1 # [ 144.306000] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:607405682worker1 # [ 144.320519] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5683worker1 # [ 144.350683] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:36Z level=info event=niks3_push_started pid=17835684worker1 # [ 144.737755] nix-daemon[836]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)5685worker1 # [ 144.754882] nix-daemon[836]: reaped child process 1799, status = succeeded5686worker1 # [ 144.927576] nix-daemon[836]: accepted connection from pid 1801, user nix-grpc-daemon (trusted)5687worker1 # [ 144.943680] nix-daemon[836]: reaped child process 1804, status = succeeded5688lb # [ 145.005377] niks3-server[1037]: 2026/09/20 09:35:36 INFO Received uploads request method=POST path=/api/pending_closures5689worker1 # [ 144.970166] nix-grpc-daemon[1783]: time=2026-09-20T09:35:37.598Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5690worker1 # [ 144.971649] nix-grpc-daemon[1783]: time=2026-09-20T09:35:37.598Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5691lb # [ 145.039121] niks3-server[1037]: 2026/09/20 09:35:36 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5692lb # [ 145.050512] niks3-server[1037]: 2026/09/20 09:35:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5693worker1 # [ 145.012246] nix-grpc-daemon[1783]: time=2026-09-20T09:35:37.641Z level=INFO msg="Uploading 1 narinfos"5694lb # [ 145.063502] niks3-server[1037]: 2026/09/20 09:35:36 INFO Signed narinfos id=46 count=15695lb # [ 145.070682] niks3-server[1037]: 2026/09/20 09:35:36 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5696lb # [ 145.080958] niks3-server[1037]: 2026/09/20 09:35:36 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5697lb # [ 145.088689] niks3-server[1037]: 2026/09/20 09:35:36 INFO Completed upload id=465698worker1 # [ 145.043592] nix-grpc-daemon[1783]: time=2026-09-20T09:35:37.673Z level=INFO msg="Upload complete. (474ms)"5699lb # [ 145.091460] niks3-server[1037]: 2026/09/20 09:35:36 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5700worker1 # [ 145.052233] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=0 paths=1 nar_bytes_in=5125701worker1 # [ 145.064070] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607405702worker1 # [ 145.070532] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5703worker1 # [ 145.075112] nix-daemon[836]: reaped child process 1781, status = succeeded5704worker1 # [ 145.088409] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5705worker1 # [ 146.309949] nix-daemon[836]: reaped child process 1808, status = succeeded5706worker1 # [ 146.467270] nix-daemon[836]: accepted connection from pid 1823, user nix-grpc-daemon (trusted)5707worker1 # [ 146.485922] nix-daemon[836]: reaped child process 1826, status = succeeded5708lb # [ 146.544943] niks3-server[1037]: 2026/09/20 09:35:38 INFO Received uploads request method=POST path=/api/pending_closures5709worker1 # [ 146.511509] nix-grpc-daemon[1783]: time=2026-09-20T09:35:39.138Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5710worker1 # [ 146.513662] nix-grpc-daemon[1783]: time=2026-09-20T09:35:39.138Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5711lb # [ 146.573004] niks3-server[1037]: 2026/09/20 09:35:38 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5712lb # [ 146.589547] niks3-server[1037]: 2026/09/20 09:35:38 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5713lb # [ 146.606009] niks3-server[1037]: 2026/09/20 09:35:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5714worker1 # [ 146.567028] nix-grpc-daemon[1783]: time=2026-09-20T09:35:39.196Z level=INFO msg="Uploading 1 narinfos"5715lb # [ 146.617454] niks3-server[1037]: 2026/09/20 09:35:38 INFO Signed narinfos id=47 count=15716lb # [ 146.622459] niks3-server[1037]: 2026/09/20 09:35:38 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5717lb # [ 146.629938] niks3-server[1037]: 2026/09/20 09:35:38 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5718worker1 # [ 146.588874] nix-grpc-daemon[1783]: time=2026-09-20T09:35:39.218Z level=INFO msg="Upload complete. (291ms)"5719lb # [ 146.634598] niks3-server[1037]: 2026/09/20 09:35:38 INFO Completed upload id=475720lb # [ 146.637490] niks3-server[1037]: 2026/09/20 09:35:38 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5721worker2 # [ 146.587118] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:39Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15722worker1 # [ 146.600788] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=15723worker1 # [ 146.613114] nix-daemon[836]: reaped child process 1806, status = succeeded5724worker2 # [ 146.600771] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:39Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05725worker1 # [ 146.651440] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607405726worker1 # [ 146.666735] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607405727worker1 # [ 146.680694] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:607405728worker1 # [ 146.693984] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5729worker1 # [ 146.893071] nix-daemon[836]: accepted connection from pid 1830, user nix-grpc-daemon (trusted)5730worker1 # [ 146.913437] nix-daemon[836]: reaped child process 1833, status = succeeded5731worker1 # [ 147.085107] nix-daemon[836]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)5732worker1 # [ 147.102010] nix-daemon[836]: reaped child process 1838, status = succeeded5733lb # [ 147.158429] niks3-server[1037]: 2026/09/20 09:35:38 INFO Received uploads request method=POST path=/api/pending_closures5734worker1 # [ 147.122010] nix-grpc-daemon[1783]: time=2026-09-20T09:35:39.751Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5735worker1 # [ 147.123458] nix-grpc-daemon[1783]: time=2026-09-20T09:35:39.751Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5736lb # [ 147.187976] niks3-server[1037]: 2026/09/20 09:35:38 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5737lb # [ 147.197629] niks3-server[1037]: 2026/09/20 09:35:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5738worker1 # [ 147.159069] nix-grpc-daemon[1783]: time=2026-09-20T09:35:39.788Z level=INFO msg="Uploading 1 narinfos"5739lb # [ 147.212183] niks3-server[1037]: 2026/09/20 09:35:38 INFO Signed narinfos id=48 count=15740lb # [ 147.215312] niks3-server[1037]: 2026/09/20 09:35:38 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5741lb # [ 147.225996] niks3-server[1037]: 2026/09/20 09:35:38 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5742worker1 # [ 147.185647] nix-grpc-daemon[1783]: time=2026-09-20T09:35:39.815Z level=INFO msg="Upload complete. (476ms)"5743lb # [ 147.230804] niks3-server[1037]: 2026/09/20 09:35:38 INFO Completed upload id=485744lb # [ 147.233500] niks3-server[1037]: 2026/09/20 09:35:38 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5745worker1 # [ 147.192138] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=0 paths=1 nar_bytes_in=5125746worker1 # [ 147.203307] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607405747worker1 # [ 147.208636] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5748worker1 # [ 147.213031] nix-daemon[836]: reaped child process 1828, status = succeeded5749worker1 # [ 147.224965] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5750worker1 # [ 148.667980] nix-daemon[836]: reaped child process 1842, status = succeeded5751worker1 # [ 148.850250] nix-daemon[836]: accepted connection from pid 1857, user nix-grpc-daemon (trusted)5752worker1 # [ 148.867175] nix-daemon[836]: reaped child process 1860, status = succeeded5753lb # [ 148.926639] niks3-server[1037]: 2026/09/20 09:35:40 INFO Received uploads request method=POST path=/api/pending_closures5754worker1 # [ 148.891959] nix-grpc-daemon[1783]: time=2026-09-20T09:35:41.521Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5755worker1 # [ 148.893743] nix-grpc-daemon[1783]: time=2026-09-20T09:35:41.521Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5756lb # [ 148.963703] niks3-server[1037]: 2026/09/20 09:35:40 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5757worker1 # [ 148.932490] nix-grpc-daemon[1783]: time=2026-09-20T09:35:41.562Z level=INFO msg="Uploading 1 narinfos"5758lb # [ 148.977226] niks3-server[1037]: 2026/09/20 09:35:40 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5759lb # [ 148.987569] niks3-server[1037]: 2026/09/20 09:35:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5760lb # [ 148.997714] niks3-server[1037]: 2026/09/20 09:35:40 INFO Signed narinfos id=49 count=15761worker1 # [ 148.958979] nix-grpc-daemon[1783]: time=2026-09-20T09:35:41.589Z level=INFO msg="Upload complete. (324ms)"5762lb # [ 149.004705] niks3-server[1037]: 2026/09/20 09:35:40 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5763lb # [ 149.007937] niks3-server[1037]: 2026/09/20 09:35:40 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5764lb # [ 149.016959] niks3-server[1037]: 2026/09/20 09:35:40 INFO Completed upload id=495765worker1 # [ 148.968922] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=15766lb # [ 149.020285] niks3-server[1037]: 2026/09/20 09:35:40 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5767worker2 # [ 148.962588] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:41Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15768worker2 # [ 148.971680] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:41Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05769worker1 # [ 148.985982] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607405770worker1 # [ 148.990149] nix-daemon[836]: reaped child process 1840, status = succeeded5771worker1 # [ 148.997096] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607405772worker1 # [ 149.008761] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:607405773worker1 # [ 149.019360] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5774worker1 # [ 149.209659] nix-daemon[836]: accepted connection from pid 1864, user nix-grpc-daemon (trusted)5775worker1 # [ 149.227489] nix-daemon[836]: reaped child process 1867, status = succeeded5776worker1 # [ 149.403910] nix-daemon[836]: accepted connection from pid 1869, user nix-grpc-daemon (trusted)5777worker1 # [ 149.420504] nix-daemon[836]: reaped child process 1872, status = succeeded5778lb # [ 149.477541] niks3-server[1037]: 2026/09/20 09:35:41 INFO Received uploads request method=POST path=/api/pending_closures5779worker1 # [ 149.440587] nix-grpc-daemon[1783]: time=2026-09-20T09:35:42.070Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5780worker1 # [ 149.442064] nix-grpc-daemon[1783]: time=2026-09-20T09:35:42.070Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5781lb # [ 149.502468] niks3-server[1037]: 2026/09/20 09:35:41 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5782lb # [ 149.515127] niks3-server[1037]: 2026/09/20 09:35:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5783worker1 # [ 149.476319] nix-grpc-daemon[1783]: time=2026-09-20T09:35:42.106Z level=INFO msg="Uploading 1 narinfos"5784lb # [ 149.526016] niks3-server[1037]: 2026/09/20 09:35:41 INFO Signed narinfos id=50 count=15785lb # [ 149.532732] niks3-server[1037]: 2026/09/20 09:35:41 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5786worker1 # [ 149.499767] nix-grpc-daemon[1783]: time=2026-09-20T09:35:42.129Z level=INFO msg="Upload complete. (468ms)"5787lb # [ 149.545518] niks3-server[1037]: 2026/09/20 09:35:41 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5788lb # [ 149.552679] niks3-server[1037]: 2026/09/20 09:35:41 INFO Completed upload id=505789worker1 # [ 149.507023] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=0 paths=1 nar_bytes_in=5125790lb # [ 149.556956] niks3-server[1037]: 2026/09/20 09:35:41 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5791worker1 # [ 149.519839] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607405792worker1 # [ 149.525733] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5793worker1 # [ 149.530188] nix-daemon[836]: reaped child process 1862, status = succeeded5794worker1 # [ 149.541619] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5795worker1 # [ 150.963098] nix-daemon[836]: reaped child process 1876, status = succeeded5796worker1 # [ 151.120990] nix-daemon[836]: accepted connection from pid 1891, user nix-grpc-daemon (trusted)5797worker1 # [ 151.139162] nix-daemon[836]: reaped child process 1894, status = succeeded5798lb # [ 151.197340] niks3-server[1037]: 2026/09/20 09:35:42 INFO Received uploads request method=POST path=/api/pending_closures5799worker1 # [ 151.164419] nix-grpc-daemon[1783]: time=2026-09-20T09:35:43.793Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5800worker1 # [ 151.165924] nix-grpc-daemon[1783]: time=2026-09-20T09:35:43.793Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5801worker1 # [ 151.204286] nix-grpc-daemon[1783]: time=2026-09-20T09:35:43.833Z level=INFO msg="Uploading 1 narinfos"5802lb # [ 151.240473] niks3-server[1037]: 2026/09/20 09:35:42 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5803lb # [ 151.254668] niks3-server[1037]: 2026/09/20 09:35:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5804lb # [ 151.264142] niks3-server[1037]: 2026/09/20 09:35:42 INFO Signed narinfos id=51 count=15805lb # [ 151.268386] niks3-server[1037]: 2026/09/20 09:35:42 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5806worker1 # [ 151.231298] nix-grpc-daemon[1783]: time=2026-09-20T09:35:43.861Z level=INFO msg="Upload complete. (280ms)"5807lb # [ 151.275462] niks3-server[1037]: 2026/09/20 09:35:42 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5808lb # [ 151.279922] niks3-server[1037]: 2026/09/20 09:35:42 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5809lb # [ 151.284196] niks3-server[1037]: 2026/09/20 09:35:42 INFO Completed upload id=515810lb # [ 151.286583] niks3-server[1037]: 2026/09/20 09:35:42 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5811worker1 # [ 151.240908] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=15812worker2 # [ 151.229216] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:43Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15813worker2 # [ 151.242147] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:43Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05814worker1 # [ 151.255589] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607405815worker1 # [ 151.260684] nix-daemon[836]: reaped child process 1874, status = succeeded5816worker1 # [ 151.267035] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607405817worker1 # [ 151.277886] nix-grpc-daemon[1783]: time=2026-09-20T09:35:43.907Z level=INFO msg="All 1 paths already cached"5818worker1 # [ 151.284995] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:607405819worker1 # [ 151.294659] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5820worker1 # [ 151.479676] nix-daemon[836]: accepted connection from pid 1898, user nix-grpc-daemon (trusted)5821worker1 # [ 151.495338] nix-daemon[836]: reaped child process 1901, status = succeeded5822worker1 # [ 151.672084] nix-daemon[836]: accepted connection from pid 1903, user nix-grpc-daemon (trusted)5823worker1 # [ 151.689591] nix-daemon[836]: reaped child process 1906, status = succeeded5824lb # [ 151.746148] niks3-server[1037]: 2026/09/20 09:35:43 INFO Received uploads request method=POST path=/api/pending_closures5825worker1 # [ 151.709523] nix-grpc-daemon[1783]: time=2026-09-20T09:35:44.339Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5826worker1 # [ 151.711026] nix-grpc-daemon[1783]: time=2026-09-20T09:35:44.339Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5827lb # [ 151.769862] niks3-server[1037]: 2026/09/20 09:35:43 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5828lb # [ 151.784825] niks3-server[1037]: 2026/09/20 09:35:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5829worker1 # [ 151.745858] nix-grpc-daemon[1783]: time=2026-09-20T09:35:44.375Z level=INFO msg="Uploading 1 narinfos"5830lb # [ 151.796427] niks3-server[1037]: 2026/09/20 09:35:43 INFO Signed narinfos id=52 count=15831lb # [ 151.799594] niks3-server[1037]: 2026/09/20 09:35:43 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5832lb # [ 151.815895] niks3-server[1037]: 2026/09/20 09:35:43 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5833lb # [ 151.823355] niks3-server[1037]: 2026/09/20 09:35:43 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5834lb # [ 151.827321] niks3-server[1037]: 2026/09/20 09:35:43 INFO Completed upload id=525835worker1 # [ 151.782017] nix-grpc-daemon[1783]: time=2026-09-20T09:35:44.412Z level=INFO msg="Upload complete. (476ms)"5836worker1 # [ 151.790968] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=0 paths=1 nar_bytes_in=6245837worker1 # [ 151.804619] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607405838worker1 # [ 151.811055] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5839worker1 # [ 151.815749] nix-daemon[836]: reaped child process 1896, status = succeeded5840worker1 # [ 151.829748] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5841worker1 # [ 152.864940] nix-daemon[836]: reaped child process 1910, status = succeeded5842worker1 # [ 153.051493] nix-daemon[836]: accepted connection from pid 1925, user nix-grpc-daemon (trusted)5843worker1 # [ 153.070275] nix-daemon[836]: reaped child process 1928, status = succeeded5844lb # [ 153.134916] niks3-server[1037]: 2026/09/20 09:35:44 INFO Received uploads request method=POST path=/api/pending_closures5845worker1 # [ 153.100111] nix-grpc-daemon[1783]: time=2026-09-20T09:35:45.729Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5846worker1 # [ 153.104828] nix-grpc-daemon[1783]: time=2026-09-20T09:35:45.731Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5847lb # [ 153.176173] niks3-server[1037]: 2026/09/20 09:35:44 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5848worker1 # [ 153.147705] nix-grpc-daemon[1783]: time=2026-09-20T09:35:45.777Z level=INFO msg="Uploading 1 narinfos"5849lb # [ 153.192667] niks3-server[1037]: 2026/09/20 09:35:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5850lb # [ 153.202793] niks3-server[1037]: 2026/09/20 09:35:44 INFO Signed narinfos id=53 count=15851lb # [ 153.209082] niks3-server[1037]: 2026/09/20 09:35:44 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5852lb # [ 153.214705] niks3-server[1037]: 2026/09/20 09:35:44 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5853lb # [ 153.223286] niks3-server[1037]: 2026/09/20 09:35:44 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5854lb # [ 153.230229] niks3-server[1037]: 2026/09/20 09:35:44 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5855lb # [ 153.234903] niks3-server[1037]: 2026/09/20 09:35:44 INFO Completed upload id=535856worker1 # [ 153.189906] nix-grpc-daemon[1783]: time=2026-09-20T09:35:45.819Z level=INFO msg="Upload complete. (345ms)"5857worker2 # [ 153.185734] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:45Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15858worker1 # [ 153.202476] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=15859worker2 # [ 153.198261] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:45Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05860worker1 # [ 153.224471] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607405861worker1 # [ 153.232578] nix-daemon[836]: reaped child process 1908, status = succeeded5862worker1 # [ 153.237696] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607405863worker1 # [ 153.247584] nix-grpc-daemon[1783]: time=2026-09-20T09:35:45.877Z level=INFO msg="All 1 paths already cached"5864worker1 # [ 153.256129] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:607405865worker1 # [ 153.268904] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5866worker1 # [ 153.466136] nix-daemon[836]: accepted connection from pid 1932, user nix-grpc-daemon (trusted)5867worker1 # [ 153.483501] nix-daemon[836]: reaped child process 1935, status = succeeded5868worker1 # [ 153.659643] nix-daemon[836]: accepted connection from pid 1937, user nix-grpc-daemon (trusted)5869worker1 # [ 153.677121] nix-daemon[836]: reaped child process 1940, status = succeeded5870lb # [ 153.734044] niks3-server[1037]: 2026/09/20 09:35:45 INFO Received uploads request method=POST path=/api/pending_closures5871worker1 # [ 153.697510] nix-grpc-daemon[1783]: time=2026-09-20T09:35:46.327Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5872worker1 # [ 153.698998] nix-grpc-daemon[1783]: time=2026-09-20T09:35:46.327Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5873lb # [ 153.762259] niks3-server[1037]: 2026/09/20 09:35:45 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5874worker1 # [ 153.730290] nix-grpc-daemon[1783]: time=2026-09-20T09:35:46.360Z level=INFO msg="Uploading 1 narinfos"5875lb # [ 153.775495] niks3-server[1037]: 2026/09/20 09:35:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5876lb # [ 153.783199] niks3-server[1037]: 2026/09/20 09:35:45 INFO Signed narinfos id=54 count=15877lb # [ 153.789950] niks3-server[1037]: 2026/09/20 09:35:45 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5878lb # [ 153.800707] niks3-server[1037]: 2026/09/20 09:35:45 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5879lb # [ 153.807634] niks3-server[1037]: 2026/09/20 09:35:45 INFO Completed upload id=545880worker1 # [ 153.762581] nix-grpc-daemon[1783]: time=2026-09-20T09:35:46.392Z level=INFO msg="Upload complete. (479ms)"5881lb # [ 153.811546] niks3-server[1037]: 2026/09/20 09:35:45 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5882worker1 # [ 153.772290] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=0 paths=1 nar_bytes_in=6245883worker1 # [ 153.783459] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607405884worker1 # [ 153.790334] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5885worker1 # [ 153.794891] nix-daemon[836]: reaped child process 1930, status = succeeded5886worker1 # [ 153.808226] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5887worker1 # [ 155.252959] nix-daemon[836]: reaped child process 1944, status = succeeded5888worker1 # [ 155.429345] nix-daemon[836]: accepted connection from pid 1959, user nix-grpc-daemon (trusted)5889worker1 # [ 155.450068] nix-daemon[836]: reaped child process 1962, status = succeeded5890lb # [ 155.510034] niks3-server[1037]: 2026/09/20 09:35:47 INFO Received uploads request method=POST path=/api/pending_closures5891worker1 # [ 155.476457] nix-grpc-daemon[1783]: time=2026-09-20T09:35:48.106Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5892worker1 # [ 155.480232] nix-grpc-daemon[1783]: time=2026-09-20T09:35:48.108Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5893lb # [ 155.553180] niks3-server[1037]: 2026/09/20 09:35:47 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5894lb # [ 155.567140] niks3-server[1037]: 2026/09/20 09:35:47 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5895worker1 # [ 155.531122] nix-grpc-daemon[1783]: time=2026-09-20T09:35:48.160Z level=INFO msg="Uploading 1 narinfos"5896lb # [ 155.577554] niks3-server[1037]: 2026/09/20 09:35:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5897lb # [ 155.585047] niks3-server[1037]: 2026/09/20 09:35:47 INFO Signed narinfos id=55 count=15898lb # [ 155.591702] niks3-server[1037]: 2026/09/20 09:35:47 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5899lb # [ 155.596159] niks3-server[1037]: 2026/09/20 09:35:47 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5900lb # [ 155.602452] niks3-server[1037]: 2026/09/20 09:35:47 INFO Completed upload id=555901worker1 # [ 155.556137] nix-grpc-daemon[1783]: time=2026-09-20T09:35:48.186Z level=INFO msg="Upload complete. (337ms)"5902lb # [ 155.604776] niks3-server[1037]: 2026/09/20 09:35:47 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5903worker2 # [ 155.553846] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:48Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15904worker1 # [ 155.569599] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=15905worker2 # [ 155.567065] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:48Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05906worker1 # [ 155.593004] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607405907worker1 # [ 155.598239] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607405908worker1 # [ 155.605165] nix-daemon[836]: reaped child process 1942, status = succeeded5909worker1 # [ 155.613245] nix-grpc-daemon[1783]: time=2026-09-20T09:35:48.243Z level=INFO msg="All 1 paths already cached"5910worker1 # [ 155.621412] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:607405911worker1 # [ 155.634474] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5912worker1 # [ 155.829312] nix-daemon[836]: accepted connection from pid 1966, user nix-grpc-daemon (trusted)5913worker1 # [ 155.849403] nix-daemon[836]: reaped child process 1969, status = succeeded5914worker1 # [ 156.025131] nix-daemon[836]: accepted connection from pid 1971, user nix-grpc-daemon (trusted)5915worker1 # [ 156.042273] nix-daemon[836]: reaped child process 1974, status = succeeded5916lb # [ 156.098952] niks3-server[1037]: 2026/09/20 09:35:47 INFO Received uploads request method=POST path=/api/pending_closures5917worker1 # [ 156.062677] nix-grpc-daemon[1783]: time=2026-09-20T09:35:48.692Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5918worker1 # [ 156.064218] nix-grpc-daemon[1783]: time=2026-09-20T09:35:48.692Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5919lb # [ 156.128080] niks3-server[1037]: 2026/09/20 09:35:47 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5920worker1 # [ 156.093589] nix-grpc-daemon[1783]: time=2026-09-20T09:35:48.723Z level=INFO msg="Uploading 1 narinfos"5921lb # [ 156.143093] niks3-server[1037]: 2026/09/20 09:35:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5922lb # [ 156.154041] niks3-server[1037]: 2026/09/20 09:35:47 INFO Signed narinfos id=56 count=15923lb # [ 156.157950] niks3-server[1037]: 2026/09/20 09:35:47 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5924worker1 # [ 156.121464] nix-grpc-daemon[1783]: time=2026-09-20T09:35:48.751Z level=INFO msg="Upload complete. (473ms)"5925lb # [ 156.167225] niks3-server[1037]: 2026/09/20 09:35:47 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5926lb # [ 156.172054] niks3-server[1037]: 2026/09/20 09:35:47 INFO Completed upload id=565927worker1 # [ 156.128145] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=0 paths=1 nar_bytes_in=6245928lb # [ 156.174988] niks3-server[1037]: 2026/09/20 09:35:47 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo5929worker1 # [ 156.138993] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607405930worker1 # [ 156.145398] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5931worker1 # [ 156.150201] nix-daemon[836]: reaped child process 1964, status = succeeded5932worker1 # [ 156.162527] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5933worker1 # [ 157.188202] nix-daemon[836]: reaped child process 1978, status = succeeded5934worker1 # [ 157.348421] nix-daemon[836]: accepted connection from pid 1993, user nix-grpc-daemon (trusted)5935worker1 # [ 157.367320] nix-daemon[836]: reaped child process 1996, status = succeeded5936lb # [ 157.425216] niks3-server[1037]: 2026/09/20 09:35:49 INFO Received uploads request method=POST path=/api/pending_closures5937worker1 # [ 157.390089] nix-grpc-daemon[1783]: time=2026-09-20T09:35:50.018Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5938worker1 # [ 157.391565] nix-grpc-daemon[1783]: time=2026-09-20T09:35:50.019Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"5939lb # [ 157.463177] niks3-server[1037]: 2026/09/20 09:35:49 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst5940worker1 # [ 157.432615] nix-grpc-daemon[1783]: time=2026-09-20T09:35:50.062Z level=INFO msg="Uploading 1 narinfos"5941lb # [ 157.479152] niks3-server[1037]: 2026/09/20 09:35:49 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv5942lb # [ 157.489263] niks3-server[1037]: 2026/09/20 09:35:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign5943lb # [ 157.495590] niks3-server[1037]: 2026/09/20 09:35:49 INFO Signed narinfos id=57 count=15944lb # [ 157.501685] niks3-server[1037]: 2026/09/20 09:35:49 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls5945worker1 # [ 157.460496] nix-grpc-daemon[1783]: time=2026-09-20T09:35:50.090Z level=INFO msg="Upload complete. (288ms)"5946lb # [ 157.506053] niks3-server[1037]: 2026/09/20 09:35:49 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete5947lb # [ 157.510282] niks3-server[1037]: 2026/09/20 09:35:49 INFO Completed upload id=575948lb # [ 157.513562] niks3-server[1037]: 2026/09/20 09:35:49 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo5949worker2 # [ 157.458689] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:50Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=15950worker1 # [ 157.472895] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=15951worker2 # [ 157.472488] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:50Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=05952worker1 # [ 157.488332] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607405953worker1 # [ 157.497756] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607405954worker1 # [ 157.503393] nix-daemon[836]: reaped child process 1976, status = succeeded5955worker1 # [ 157.511032] nix-grpc-daemon[1783]: time=2026-09-20T09:35:50.141Z level=INFO msg="All 2 paths already cached"5956worker1 # [ 157.519145] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:607405957worker1 # [ 157.533095] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5958worker1 # [ 157.728482] nix-daemon[836]: accepted connection from pid 2000, user nix-grpc-daemon (trusted)5959worker1 # [ 157.746556] nix-daemon[836]: reaped child process 2003, status = succeeded5960worker1 # [ 157.923692] nix-daemon[836]: accepted connection from pid 2005, user nix-grpc-daemon (trusted)5961worker1 # [ 157.940687] nix-daemon[836]: reaped child process 2008, status = succeeded5962lb # [ 158.000420] niks3-server[1037]: 2026/09/20 09:35:49 INFO Received uploads request method=POST path=/api/pending_closures5963worker1 # [ 157.973375] nix-grpc-daemon[1783]: time=2026-09-20T09:35:50.603Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5964worker1 # [ 157.974853] nix-grpc-daemon[1783]: time=2026-09-20T09:35:50.603Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"5965lb # [ 158.045639] niks3-server[1037]: 2026/09/20 09:35:49 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst5966lb # [ 158.056894] niks3-server[1037]: 2026/09/20 09:35:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign5967worker1 # [ 158.016277] nix-grpc-daemon[1783]: time=2026-09-20T09:35:50.646Z level=INFO msg="Uploading 1 narinfos"5968lb # [ 158.065410] niks3-server[1037]: 2026/09/20 09:35:49 INFO Signed narinfos id=58 count=15969lb # [ 158.070961] niks3-server[1037]: 2026/09/20 09:35:49 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls5970lb # [ 158.080118] niks3-server[1037]: 2026/09/20 09:35:49 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete5971lb # [ 158.086616] niks3-server[1037]: 2026/09/20 09:35:49 INFO Completed upload id=585972lb # [ 158.089330] niks3-server[1037]: 2026/09/20 09:35:49 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo5973worker1 # [ 158.041570] nix-grpc-daemon[1783]: time=2026-09-20T09:35:50.671Z level=INFO msg="Upload complete. (494ms)"5974worker1 # [ 158.051500] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=0 paths=1 nar_bytes_in=7525975worker1 # [ 158.066706] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607405976worker1 # [ 158.072929] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5977worker1 # [ 158.078134] nix-daemon[836]: reaped child process 1998, status = succeeded5978worker1 # [ 158.092523] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5979worker1 # [ 158.917041] nix-daemon[836]: reaped child process 2012, status = succeeded5980worker1 # [ 159.082850] nix-daemon[836]: accepted connection from pid 2027, user nix-grpc-daemon (trusted)5981worker1 # [ 159.101129] nix-daemon[836]: reaped child process 2030, status = succeeded5982lb # [ 159.159102] niks3-server[1037]: 2026/09/20 09:35:50 INFO Received uploads request method=POST path=/api/pending_closures5983worker1 # [ 159.127056] nix-grpc-daemon[1783]: time=2026-09-20T09:35:51.755Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5984worker1 # [ 159.130721] nix-grpc-daemon[1783]: time=2026-09-20T09:35:51.755Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"5985lb # [ 159.206102] niks3-server[1037]: 2026/09/20 09:35:50 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst5986worker1 # [ 159.176049] nix-grpc-daemon[1783]: time=2026-09-20T09:35:51.805Z level=INFO msg="Uploading 1 narinfos"5987lb # [ 159.222372] niks3-server[1037]: 2026/09/20 09:35:50 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv5988lb # [ 159.230722] niks3-server[1037]: 2026/09/20 09:35:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign5989lb # [ 159.235740] niks3-server[1037]: 2026/09/20 09:35:50 INFO Signed narinfos id=59 count=15990lb # [ 159.242819] niks3-server[1037]: 2026/09/20 09:35:50 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls5991lb # [ 159.246707] niks3-server[1037]: 2026/09/20 09:35:50 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete5992lb # [ 159.250417] niks3-server[1037]: 2026/09/20 09:35:50 INFO Completed upload id=595993worker1 # [ 159.204885] nix-grpc-daemon[1783]: time=2026-09-20T09:35:51.834Z level=INFO msg="Upload complete. (302ms)"5994lb # [ 159.252867] niks3-server[1037]: 2026/09/20 09:35:50 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo5995worker2 # [ 159.201767] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:51Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=15996worker1 # [ 159.216607] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=15997worker1 # [ 159.228528] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607405998worker1 # [ 159.237880] nix-daemon[836]: reaped child process 2010, status = succeeded5999worker1 # [ 159.263436] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607406000worker1 # [ 159.278980] nix-grpc-daemon[1783]: time=2026-09-20T09:35:51.908Z level=INFO msg="All 2 paths already cached"6001worker1 # [ 159.289189] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:607406002worker1 # [ 159.303213] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)6003worker1 # [ 159.507160] nix-daemon[836]: accepted connection from pid 2034, user nix-grpc-daemon (trusted)6004worker1 # [ 159.525895] nix-daemon[836]: reaped child process 2037, status = succeeded6005worker1 # [ 159.703132] nix-daemon[836]: accepted connection from pid 2039, user nix-grpc-daemon (trusted)6006worker1 # [ 159.721306] nix-daemon[836]: reaped child process 2042, status = succeeded6007lb # [ 159.777786] niks3-server[1037]: 2026/09/20 09:35:51 INFO Received uploads request method=POST path=/api/pending_closures6008worker1 # [ 159.742213] nix-grpc-daemon[1783]: time=2026-09-20T09:35:52.372Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6009worker1 # [ 159.743758] nix-grpc-daemon[1783]: time=2026-09-20T09:35:52.372Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6010lb # [ 159.812628] niks3-server[1037]: 2026/09/20 09:35:51 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6011worker1 # [ 159.776900] nix-grpc-daemon[1783]: time=2026-09-20T09:35:52.406Z level=INFO msg="Uploading 1 narinfos"6012lb # [ 159.826910] niks3-server[1037]: 2026/09/20 09:35:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6013lb # [ 159.836291] niks3-server[1037]: 2026/09/20 09:35:51 INFO Signed narinfos id=60 count=16014lb # [ 159.838984] niks3-server[1037]: 2026/09/20 09:35:51 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6015lb # [ 159.846950] niks3-server[1037]: 2026/09/20 09:35:51 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6016lb # [ 159.853077] niks3-server[1037]: 2026/09/20 09:35:51 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6017lb # [ 159.858048] niks3-server[1037]: 2026/09/20 09:35:51 INFO Completed upload id=606018worker1 # [ 159.812989] nix-grpc-daemon[1783]: time=2026-09-20T09:35:52.443Z level=INFO msg="Upload complete. (493ms)"6019worker1 # [ 159.820153] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=0 paths=1 nar_bytes_in=7526020worker1 # [ 159.835030] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607406021worker1 # [ 159.842352] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)6022worker1 # [ 159.847593] nix-daemon[836]: reaped child process 2032, status = succeeded6023worker1 # [ 159.863494] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)6024worker1 # [ 161.088421] nix-daemon[836]: reaped child process 2046, status = succeeded6025worker1 # [ 161.284673] nix-daemon[836]: accepted connection from pid 2061, user nix-grpc-daemon (trusted)6026worker1 # [ 161.307736] nix-daemon[836]: reaped child process 2064, status = succeeded6027lb # [ 161.370830] niks3-server[1037]: 2026/09/20 09:35:52 INFO Received uploads request method=POST path=/api/pending_closures6028worker1 # [ 161.338927] nix-grpc-daemon[1783]: time=2026-09-20T09:35:53.967Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6029worker1 # [ 161.340626] nix-grpc-daemon[1783]: time=2026-09-20T09:35:53.967Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6030lb # [ 161.426261] niks3-server[1037]: 2026/09/20 09:35:53 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6031lb # [ 161.439047] niks3-server[1037]: 2026/09/20 09:35:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6032worker1 # [ 161.398908] nix-grpc-daemon[1783]: time=2026-09-20T09:35:54.028Z level=INFO msg="Uploading 1 narinfos"6033lb # [ 161.449082] niks3-server[1037]: 2026/09/20 09:35:53 INFO Signed narinfos id=61 count=16034lb # [ 161.451133] niks3-server[1037]: 2026/09/20 09:35:53 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6035lb # [ 161.459944] niks3-server[1037]: 2026/09/20 09:35:53 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6036lb # [ 161.466682] niks3-server[1037]: 2026/09/20 09:35:53 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6037lb # [ 161.470669] niks3-server[1037]: 2026/09/20 09:35:53 INFO Completed upload id=616038worker1 # [ 161.425719] nix-grpc-daemon[1783]: time=2026-09-20T09:35:54.055Z level=INFO msg="Upload complete. (351ms)"6039lb # [ 161.472957] niks3-server[1037]: 2026/09/20 09:35:53 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6040worker2 # [ 161.425395] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:54Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16041worker1 # [ 161.441677] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=16042worker1 # [ 161.462678] nix-daemon[836]: reaped child process 2044, status = succeeded6043worker1 # [ 161.480443] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607406044worker1 # [ 161.499112] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607406045worker1 # [ 161.515506] nix-grpc-daemon[1783]: time=2026-09-20T09:35:54.145Z level=INFO msg="All 2 paths already cached"6046worker1 # [ 161.527360] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:607406047worker1 # [ 161.543919] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)6048worker1 # [ 161.811102] nix-daemon[836]: accepted connection from pid 2068, user nix-grpc-daemon (trusted)6049worker1 # [ 161.831522] nix-daemon[836]: reaped child process 2071, status = succeeded6050worker1 # [ 162.026984] nix-daemon[836]: accepted connection from pid 2073, user nix-grpc-daemon (trusted)6051worker1 # [ 162.046080] nix-daemon[836]: reaped child process 2076, status = succeeded6052lb # [ 162.104231] niks3-server[1037]: 2026/09/20 09:35:53 INFO Received uploads request method=POST path=/api/pending_closures6053worker1 # [ 162.074831] nix-grpc-daemon[1783]: time=2026-09-20T09:35:54.704Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6054worker1 # [ 162.076577] nix-grpc-daemon[1783]: time=2026-09-20T09:35:54.704Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6055lb # [ 162.149924] niks3-server[1037]: 2026/09/20 09:35:53 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6056worker1 # [ 162.128603] nix-grpc-daemon[1783]: time=2026-09-20T09:35:54.758Z level=INFO msg="Uploading 1 narinfos"6057lb # [ 162.167357] niks3-server[1037]: 2026/09/20 09:35:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6058lb # [ 162.186028] niks3-server[1037]: 2026/09/20 09:35:53 INFO Signed narinfos id=62 count=16059lb # [ 162.192882] niks3-server[1037]: 2026/09/20 09:35:53 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6060lb # [ 162.207216] niks3-server[1037]: 2026/09/20 09:35:53 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6061lb # [ 162.218593] niks3-server[1037]: 2026/09/20 09:35:53 INFO Completed upload id=626062worker1 # [ 162.173198] nix-grpc-daemon[1783]: time=2026-09-20T09:35:54.803Z level=INFO msg="Upload complete. (610ms)"6063lb # [ 162.221849] niks3-server[1037]: 2026/09/20 09:35:53 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6064worker1 # [ 162.186973] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=0 paths=1 nar_bytes_in=7526065worker1 # [ 162.204495] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:607406066worker1 # [ 162.221823] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)6067worker1 # [ 162.240544] nix-daemon[836]: reaped child process 2066, status = succeeded6068worker1 # [ 162.249019] nix-daemon[836]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)6069worker1 # [ 163.711291] nix-daemon[836]: reaped child process 2080, status = succeeded6070worker1 # [ 163.899139] nix-daemon[836]: accepted connection from pid 2095, user nix-grpc-daemon (trusted)6071worker1 # [ 163.922640] nix-daemon[836]: reaped child process 2098, status = succeeded6072lb # [ 163.983826] niks3-server[1037]: 2026/09/20 09:35:55 INFO Received uploads request method=POST path=/api/pending_closures6073worker1 # [ 163.953874] nix-grpc-daemon[1783]: time=2026-09-20T09:35:56.583Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6074worker1 # [ 163.959080] nix-grpc-daemon[1783]: time=2026-09-20T09:35:56.585Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6075lb # [ 164.044681] niks3-server[1037]: 2026/09/20 09:35:55 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6076lb # [ 164.057157] niks3-server[1037]: 2026/09/20 09:35:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6077worker1 # [ 164.017409] nix-grpc-daemon[1783]: time=2026-09-20T09:35:56.647Z level=INFO msg="Uploading 1 narinfos"6078lb # [ 164.070832] niks3-server[1037]: 2026/09/20 09:35:55 INFO Signed narinfos id=63 count=16079lb # [ 164.075952] niks3-server[1037]: 2026/09/20 09:35:55 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6080lb # [ 164.082375] niks3-server[1037]: 2026/09/20 09:35:55 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6081lb # [ 164.091402] niks3-server[1037]: 2026/09/20 09:35:55 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6082lb # [ 164.096202] niks3-server[1037]: 2026/09/20 09:35:55 INFO Completed upload id=636083worker1 # [ 164.051334] nix-grpc-daemon[1783]: time=2026-09-20T09:35:56.681Z level=INFO msg="Upload complete. (385ms)"6084lb # [ 164.098875] niks3-server[1037]: 2026/09/20 09:35:55 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6085worker1 # [ 164.066164] nix-grpc-daemon[1727]: ts=2026-09-20T09:35:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60740 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16086worker1 # [ 164.088675] nix-daemon[836]: reaped child process 2078, status = succeeded6087client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 21.09 seconds)6088worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6089worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.10 seconds)6090client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16091worker2 # [ 164.533731] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:603526092worker2 # [ 164.545136] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603526093worker2 # [ 164.581578] nix-grpc-daemon[1302]: ts=2026-09-20T09:35:57Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06094lb # [ 172.167996] envoy[926]: conn peer=[2001:db8:1::1]:36900 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27200 tx=10789 ms=207696095client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.38 seconds)6096(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 51.57 seconds)6097subtest: low disk drains a worker and builds go to the other6098worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6099worker1 # [ 195.761276] nix-grpc-daemon[1727]: ts=2026-09-20T09:36:28Z level=info event=unhealthy reason=min_free6100worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.12 seconds)6101worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6102worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.05 seconds)6103client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26104worker2 # [ 196.038019] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:603526105client # don't know how to build these paths:6106client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6107worker1 # [ 196.063420] nix-grpc-daemon[1727]: ts=2026-09-20T09:36:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:607406108worker2 # [ 196.079628] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:28Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06109worker2 # [ 196.086888] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:28Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16110worker2 # [ 196.096765] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603526111worker2 # [ 196.107974] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603526112client # copying 1 paths to 'lb:50051'...6113client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6114worker2 # [ 196.121008] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603526115worker2 # [ 196.140326] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)6116worker2 # [ 196.344768] nix-daemon[830]: accepted connection from pid 1578, user nix-grpc-daemon (trusted)6117worker2 # [ 196.362440] nix-daemon[830]: reaped child process 1581, status = succeeded6118worker2 # [ 196.533023] nix-daemon[830]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)6119worker2 # [ 196.548850] nix-daemon[830]: reaped child process 1586, status = succeeded6120lb # [ 196.617743] niks3-server[1037]: 2026/09/20 09:36:28 INFO Received uploads request method=POST path=/api/pending_closures6121worker2 # [ 196.572250] nix-grpc-daemon[1374]: time=2026-09-20T09:36:29.199Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6122worker2 # [ 196.573734] nix-grpc-daemon[1374]: time=2026-09-20T09:36:29.199Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6123lb # [ 196.651604] niks3-server[1037]: 2026/09/20 09:36:28 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6124worker2 # [ 196.608572] nix-grpc-daemon[1374]: time=2026-09-20T09:36:29.236Z level=INFO msg="Uploading 1 narinfos"6125lb # [ 196.666170] niks3-server[1037]: 2026/09/20 09:36:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6126lb # [ 196.677536] niks3-server[1037]: 2026/09/20 09:36:28 INFO Signed narinfos id=64 count=16127lb # [ 196.683381] niks3-server[1037]: 2026/09/20 09:36:28 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6128worker2 # [ 196.635978] nix-grpc-daemon[1374]: time=2026-09-20T09:36:29.264Z level=INFO msg="Upload complete. (478ms)"6129lb # [ 196.693153] niks3-server[1037]: 2026/09/20 09:36:28 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6130lb # [ 196.697595] niks3-server[1037]: 2026/09/20 09:36:28 INFO Completed upload id=646131lb # [ 196.700836] niks3-server[1037]: 2026/09/20 09:36:28 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6132worker2 # [ 196.644139] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60352 duration_s=0 paths=1 nar_bytes_in=5126133worker2 # [ 196.660229] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603526134worker2 # [ 196.663401] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)6135worker2 # [ 196.668855] nix-daemon[830]: reaped child process 1576, status = succeeded6136client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6137client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6138worker2 # [ 196.679524] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)6139client # farm-a> LOG-farm-a-drain6140worker2 # [ 197.507275] nix-daemon[830]: reaped child process 1590, status = succeeded6141worker2 # [ 197.662810] nix-daemon[830]: accepted connection from pid 1605, user nix-grpc-daemon (trusted)6142worker2 # [ 197.679502] nix-daemon[830]: reaped child process 1608, status = succeeded6143lb # [ 197.753745] niks3-server[1037]: 2026/09/20 09:36:29 INFO Received uploads request method=POST path=/api/pending_closures6144worker2 # [ 197.707194] nix-grpc-daemon[1374]: time=2026-09-20T09:36:30.332Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6145worker2 # [ 197.708772] nix-grpc-daemon[1374]: time=2026-09-20T09:36:30.332Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6146lb # [ 197.788931] niks3-server[1037]: 2026/09/20 09:36:29 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6147lb # [ 197.802979] niks3-server[1037]: 2026/09/20 09:36:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6148worker2 # [ 197.751155] nix-grpc-daemon[1374]: time=2026-09-20T09:36:30.379Z level=INFO msg="Uploading 1 narinfos"6149lb # [ 197.813354] niks3-server[1037]: 2026/09/20 09:36:29 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6150lb # [ 197.827800] niks3-server[1037]: 2026/09/20 09:36:29 INFO Signed narinfos id=65 count=16151worker2 # [ 197.770547] nix-grpc-daemon[1374]: time=2026-09-20T09:36:30.398Z level=INFO msg="Upload complete. (282ms)"6152lb # [ 197.831153] niks3-server[1037]: 2026/09/20 09:36:29 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6153lb # [ 197.836645] niks3-server[1037]: 2026/09/20 09:36:29 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6154lb # [ 197.841948] niks3-server[1037]: 2026/09/20 09:36:29 INFO Completed upload id=656155lb # [ 197.844382] niks3-server[1037]: 2026/09/20 09:36:29 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6156worker2 # [ 197.788701] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60352 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16157worker2 # [ 197.795278] nix-daemon[830]: reaped child process 1588, status = succeeded6158worker2 # [ 197.802229] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:30Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06159worker2 # [ 197.806310] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:30Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16160worker2 # [ 197.847762] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603526161worker2 # [ 197.862988] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603526162worker2 # [ 197.877993] nix-grpc-daemon[1374]: time=2026-09-20T09:36:30.506Z level=INFO msg="All 1 paths already cached"6163client # copying 1 paths to 'lb:50051'...6164client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6165worker2 # [ 197.888107] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603526166worker2 # [ 197.901525] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)6167worker2 # [ 198.100728] nix-daemon[830]: accepted connection from pid 1614, user nix-grpc-daemon (trusted)6168worker2 # [ 198.119678] nix-daemon[830]: reaped child process 1617, status = succeeded6169worker2 # [ 198.295451] nix-daemon[830]: accepted connection from pid 1619, user nix-grpc-daemon (trusted)6170worker2 # [ 198.313907] nix-daemon[830]: reaped child process 1622, status = succeeded6171lb # [ 198.381183] niks3-server[1037]: 2026/09/20 09:36:30 INFO Received uploads request method=POST path=/api/pending_closures6172worker2 # [ 198.334689] nix-grpc-daemon[1374]: time=2026-09-20T09:36:30.962Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6173worker2 # [ 198.336262] nix-grpc-daemon[1374]: time=2026-09-20T09:36:30.962Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6174lb # [ 198.410991] niks3-server[1037]: 2026/09/20 09:36:30 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6175worker2 # [ 198.366016] nix-grpc-daemon[1374]: time=2026-09-20T09:36:30.993Z level=INFO msg="Uploading 1 narinfos"6176lb # [ 198.427742] niks3-server[1037]: 2026/09/20 09:36:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6177lb # [ 198.438613] niks3-server[1037]: 2026/09/20 09:36:30 INFO Signed narinfos id=66 count=16178lb # [ 198.442892] niks3-server[1037]: 2026/09/20 09:36:30 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6179lb # [ 198.451240] niks3-server[1037]: 2026/09/20 09:36:30 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6180worker2 # [ 198.398716] nix-grpc-daemon[1374]: time=2026-09-20T09:36:31.026Z level=INFO msg="Upload complete. (480ms)"6181lb # [ 198.456183] niks3-server[1037]: 2026/09/20 09:36:30 INFO Completed upload id=666182lb # [ 198.459191] niks3-server[1037]: 2026/09/20 09:36:30 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6183worker2 # [ 198.408716] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60352 duration_s=0 paths=1 nar_bytes_in=6326184worker2 # [ 198.419300] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603526185worker2 # [ 198.424871] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)6186worker2 # [ 198.429470] nix-daemon[830]: reaped child process 1612, status = succeeded6187client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6188client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6189worker2 # [ 198.441794] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)6190client # farm-b> LOG-farm-b-drain6191worker2 # [ 199.485179] nix-daemon[830]: reaped child process 1626, status = succeeded6192worker2 # [ 199.654996] nix-daemon[830]: accepted connection from pid 1641, user nix-grpc-daemon (trusted)6193worker2 # [ 199.672445] nix-daemon[830]: reaped child process 1644, status = succeeded6194lb # [ 199.743649] niks3-server[1037]: 2026/09/20 09:36:31 INFO Received uploads request method=POST path=/api/pending_closures6195worker2 # [ 199.697851] nix-grpc-daemon[1374]: time=2026-09-20T09:36:32.325Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6196worker2 # [ 199.703286] nix-grpc-daemon[1374]: time=2026-09-20T09:36:32.327Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6197lb # [ 199.777631] niks3-server[1037]: 2026/09/20 09:36:31 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6198lb # [ 199.794961] niks3-server[1037]: 2026/09/20 09:36:31 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6199lb # [ 199.802658] niks3-server[1037]: 2026/09/20 09:36:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6200worker2 # [ 199.750694] nix-grpc-daemon[1374]: time=2026-09-20T09:36:32.378Z level=INFO msg="Uploading 1 narinfos"6201lb # [ 199.811661] niks3-server[1037]: 2026/09/20 09:36:31 INFO Signed narinfos id=67 count=16202lb # [ 199.816787] niks3-server[1037]: 2026/09/20 09:36:31 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6203lb # [ 199.823627] niks3-server[1037]: 2026/09/20 09:36:31 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6204lb # [ 199.829390] niks3-server[1037]: 2026/09/20 09:36:31 INFO Completed upload id=676205worker2 # [ 199.772698] nix-grpc-daemon[1374]: time=2026-09-20T09:36:32.400Z level=INFO msg="Upload complete. (320ms)"6206lb # [ 199.831721] niks3-server[1037]: 2026/09/20 09:36:31 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6207worker2 # [ 199.785113] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60352 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16208worker2 # [ 199.801753] nix-daemon[830]: reaped child process 1624, status = succeeded6209worker2 # [ 199.829316] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:32Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06210worker2 # [ 199.836317] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:32Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16211worker2 # [ 199.875441] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603526212worker2 # [ 199.891062] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603526213client # copying 1 paths to 'lb:50051'...6214worker2 # [ 199.905766] nix-grpc-daemon[1374]: time=2026-09-20T09:36:32.533Z level=INFO msg="All 2 paths already cached"6215client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6216worker2 # [ 199.912513] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603526217worker2 # [ 199.926684] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)6218worker2 # [ 200.145607] nix-daemon[830]: accepted connection from pid 1650, user nix-grpc-daemon (trusted)6219worker2 # [ 200.165109] nix-daemon[830]: reaped child process 1653, status = succeeded6220worker2 # [ 200.340296] nix-daemon[830]: accepted connection from pid 1655, user nix-grpc-daemon (trusted)6221worker2 # [ 200.357392] nix-daemon[830]: reaped child process 1658, status = succeeded6222lb # [ 200.427524] niks3-server[1037]: 2026/09/20 09:36:32 INFO Received uploads request method=POST path=/api/pending_closures6223worker2 # [ 200.380064] nix-grpc-daemon[1374]: time=2026-09-20T09:36:33.008Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6224worker2 # [ 200.381585] nix-grpc-daemon[1374]: time=2026-09-20T09:36:33.008Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6225lb # [ 200.457651] niks3-server[1037]: 2026/09/20 09:36:32 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6226lb # [ 200.471802] niks3-server[1037]: 2026/09/20 09:36:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6227worker2 # [ 200.421075] nix-grpc-daemon[1374]: time=2026-09-20T09:36:33.049Z level=INFO msg="Uploading 1 narinfos"6228lb # [ 200.484609] niks3-server[1037]: 2026/09/20 09:36:32 INFO Signed narinfos id=68 count=16229lb # [ 200.491241] niks3-server[1037]: 2026/09/20 09:36:32 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6230worker2 # [ 200.442354] nix-grpc-daemon[1374]: time=2026-09-20T09:36:33.070Z level=INFO msg="Upload complete. (498ms)"6231lb # [ 200.500332] niks3-server[1037]: 2026/09/20 09:36:32 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6232lb # [ 200.505339] niks3-server[1037]: 2026/09/20 09:36:32 INFO Completed upload id=686233worker2 # [ 200.448249] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60352 duration_s=0 paths=1 nar_bytes_in=7606234lb # [ 200.508528] niks3-server[1037]: 2026/09/20 09:36:32 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6235worker2 # [ 200.457068] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603526236worker2 # [ 200.468607] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)6237worker2 # [ 200.473377] nix-daemon[830]: reaped child process 1648, status = succeeded6238client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6239client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6240worker2 # [ 200.487543] nix-daemon[830]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)6241client # farm-top> LOG-farm-top-drain6242worker2 # [ 201.715167] nix-daemon[830]: reaped child process 1662, status = succeeded6243worker2 # [ 201.927091] nix-daemon[830]: accepted connection from pid 1677, user nix-grpc-daemon (trusted)6244worker2 # [ 201.950891] nix-daemon[830]: reaped child process 1680, status = succeeded6245lb # [ 202.023794] niks3-server[1037]: 2026/09/20 09:36:33 INFO Received uploads request method=POST path=/api/pending_closures6246worker2 # [ 201.979971] nix-grpc-daemon[1374]: time=2026-09-20T09:36:34.607Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6247worker2 # [ 201.983242] nix-grpc-daemon[1374]: time=2026-09-20T09:36:34.610Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6248lb # [ 202.082642] niks3-server[1037]: 2026/09/20 09:36:33 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6249worker2 # [ 202.036386] nix-grpc-daemon[1374]: time=2026-09-20T09:36:34.664Z level=INFO msg="Uploading 1 narinfos"6250lb # [ 202.095444] niks3-server[1037]: 2026/09/20 09:36:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6251lb # [ 202.103838] niks3-server[1037]: 2026/09/20 09:36:33 INFO Signed narinfos id=69 count=16252lb # [ 202.108692] niks3-server[1037]: 2026/09/20 09:36:33 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6253lb # [ 202.114563] niks3-server[1037]: 2026/09/20 09:36:33 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6254lb # [ 202.121344] niks3-server[1037]: 2026/09/20 09:36:33 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6255worker2 # [ 202.063796] nix-grpc-daemon[1374]: time=2026-09-20T09:36:34.691Z level=INFO msg="Upload complete. (366ms)"6256lb # [ 202.124833] niks3-server[1037]: 2026/09/20 09:36:33 INFO Completed upload id=696257lb # [ 202.128103] niks3-server[1037]: 2026/09/20 09:36:33 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6258worker2 # [ 202.077172] nix-grpc-daemon[1302]: ts=2026-09-20T09:36:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60352 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16259worker2 # [ 202.097272] nix-daemon[830]: reaped child process 1660, status = succeeded6260lb # [ 202.174059] envoy[926]: conn peer=[2001:db8:1::1]:40040 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=500 ms=300716261lb # [ 202.179738] envoy[926]: conn peer=[2001:db8:1::1]:60398 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9549 tx=3825 ms=60556262client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.35 seconds)6263client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6264client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.28 seconds)6265worker1: must succeed: rm /nix/.rw-store/fill6266worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.21 seconds)6267worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6268worker1 # [ 203.771425] nix-grpc-daemon[1727]: ts=2026-09-20T09:36:36Z level=info event=healthy reason=min_free6269worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.19 seconds)6270(finished: subtest: low disk drains a worker and builds go to the other, in 9.35 seconds)6271(finished: run the VM test script, in 204.86 seconds)6272test script finished in 205.18s6273cleanup6274kill QemuMachine (pid 50)6275client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6276kill QemuMachine (pid 49)6277lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6278kill QemuMachine (pid 51)6279worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6280kill QemuMachine (pid 52)6281worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6282(finished: cleanup, in 1.04 seconds)6283additionally exposed symbols:6284 client, lb, worker1, worker2,6285 vlan1,6286 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh