vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #279
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker1 # Disk image does not exist, creating the virtualisation disk image...13lb # Disk image does not exist, creating the virtualisation disk image...14worker1 # Formatting '/build/vm-state-worker1/tmp.diOldA1duZ', fmt=raw size=107374182415lb: QEMU running (pid 49)16worker1: QEMU running (pid 51)17worker1 # mke2fs 1.47.4 (6-Mar-2025)18lb # Formatting '/build/vm-state-lb/tmp.OLRsNsqZUl', fmt=raw size=107374182419client # Disk image does not exist, creating the virtualisation disk image...20client: QEMU running (pid 50)21worker2 # Disk image does not exist, creating the virtualisation disk image...22worker2: QEMU running (pid 52)23worker1 # Discarding device blocks: 0/262144 done24worker2 # Formatting '/build/vm-state-worker2/tmp.8BWSeZmmqj', fmt=raw size=107374182425lb # mke2fs 1.47.4 (6-Mar-2025)26client # Formatting '/build/vm-state-client/tmp.9zUqgO0Ugd', fmt=raw size=107374182427worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes28lb # Discarding device blocks: 0/262144 done29client # mke2fs 1.47.4 (6-Mar-2025)30worker1 # Filesystem UUID: 89fb4fd6-9498-48e9-b243-95b6bca472df31lb # Creating filesystem with 262144 4k blocks and 65536 inodes32client # Discarding device blocks: 0/262144 done33worker1 # Superblock backups stored on blocks:34lb # Filesystem UUID: 60128c9d-a0b3-4659-9c05-9ec5bacc3a3135client # Creating filesystem with 262144 4k blocks and 65536 inodes36worker1 # 32768, 98304, 163840, 22937637lb # Superblock backups stored on blocks:38client # Filesystem UUID: 17b022c1-81f6-4db3-80bc-54ebff4fb61039worker1 # 40lb # 32768, 98304, 163840, 22937641client # Superblock backups stored on blocks:42worker1 # Allocating group tables: 0/8 done43lb # 44client # 32768, 98304, 163840, 22937645worker1 # Writing inode tables: 0/8 done46lb # Allocating group tables: 0/8 done47client # 48worker1 # Creating journal (8192 blocks): done49lb # Writing inode tables: 0/8 done50client # Allocating group tables: 0/8 done51worker1 # Writing superblocks and filesystem accounting information: 0/8 done52lb # Creating journal (8192 blocks): done53client # Writing inode tables: 0/8 done54worker1 # 55lb # Writing superblocks and filesystem accounting information: 0/8 done56client # Creating journal (8192 blocks): done57worker1 # Virtualisation disk image created.58lb # 59client # Writing superblocks and filesystem accounting information: 0/8 done60worker2 # mke2fs 1.47.4 (6-Mar-2025)61(finished: start all VMs, in 0.48 seconds)62lb # Virtualisation disk image created.63client # 64client: waiting for unit network-addresses-eth1.service65client # Virtualisation disk image created.66client: waiting for the VM to finish booting67worker2 # Discarding device blocks: 0/262144 done68worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes69worker2 # Filesystem UUID: 456ab137-f055-4443-ab99-81dd1b7e3c5c70worker2 # Superblock backups stored on blocks:71worker2 # 32768, 98304, 163840, 22937672worker2 # 73worker2 # Allocating group tables: 0/8 done74worker2 # Writing inode tables: 0/8 done75worker2 # Creating journal (8192 blocks): done76worker2 # Writing superblocks and filesystem accounting information: 0/8 done77worker2 # 78worker2 # Virtualisation disk image created.79lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681lb # [ 0.000000] KASLR enabled82lb # [ 0.000000] random: crng init done83lb # [ 0.000000] Machine model: linux,dummy-virt84lb # [ 0.000000] efi: UEFI not found.85lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88lb # [ 0.000000] Zone ranges:89lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90lb # [ 0.000000] DMA32 empty91lb # [ 0.000000] Normal empty92lb # [ 0.000000] Device empty93lb # [ 0.000000] Movable zone start for each node94lb # [ 0.000000] Early memory node ranges95lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098lb # [ 0.000000] psci: probing for conduit method from DT.99lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.100lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101lb # [ 0.000000] psci: Trusted OS migration not required102lb # [ 0.000000] psci: SMC Calling Convention v1.1103lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105lb # [ 0.000000] Detected PIPT I-cache on CPU0106lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107lb # [ 0.000000] CPU features: detected: GICv3 CPU interface108lb # [ 0.000000] CPU features: detected: Spectre-v4109lb # [ 0.000000] CPU features: detected: Spectre-BHB110lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112lb # [ 0.000000] alternatives: applying boot alternatives113lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1y76sp58sczakc84qnb2p7nq6lq4cpg2-nixos-system-lb-test/init regInfo=/nix/store/yf668d8xpf1l4919kivs4ak64gjacscd-closure-info/registration console=ttyAMA0,115200n8 console=tty0114lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/yf668d8xpf1l4919kivs4ak64gjacscd-closure-info/registration", will be passed to user space.115lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119lb # [ 0.000000] software IO TLB: area num 1.120lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122lb # [ 0.000000] Fallback order for Node 0: 0123lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216124lb # [ 0.000000] Policy zone: DMA125lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off126lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1127lb # [ 0.000000] allocated 3145728 bytes of page_ext128lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages129lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups130lb # [ 0.000000] rcu: Hierarchical RCU implementation.131lb # [ 0.000000] rcu: RCU event tracing is enabled.132lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.133lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.134lb # [ 0.000000] Rude variant of Tasks RCU enabled.135lb # [ 0.000000] Tracing variant of Tasks RCU enabled.136lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.137lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1138worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]139lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.140lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.141worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026142worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]143client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]144worker1 # [ 0.000000] KASLR enabled145worker1 # [ 0.000000] random: crng init done146lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.147worker1 # [ 0.000000] Machine model: linux,dummy-virt148worker1 # [ 0.000000] efi: UEFI not found.149client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026150lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0151worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026152worker2 # [ 0.000000] KASLR enabled153client # [ 0.000000] KASLR enabled154lb # [ 0.000000] GICv3: 256 SPIs implemented155client # [ 0.000000] random: crng init done156worker2 # [ 0.000000] random: crng init done157worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT158lb # [ 0.000000] GICv3: 0 Extended SPIs implemented159client # [ 0.000000] Machine model: linux,dummy-virt160worker2 # [ 0.000000] Machine model: linux,dummy-virt161lb # [ 0.000000] Root IRQ handler: gic_handle_irq162client # [ 0.000000] efi: UEFI not found.163worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]164worker2 # [ 0.000000] efi: UEFI not found.165lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI166worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]167client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT168worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT169lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0170worker1 # [ 0.000000] Zone ranges:171worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]172worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]173client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]174lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000175worker1 # [ 0.000000] DMA32 empty176lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]177worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]178client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]179worker1 # [ 0.000000] Normal empty180worker2 # [ 0.000000] Zone ranges:181client # [ 0.000000] Zone ranges:182worker1 # [ 0.000000] Device empty183worker1 # [ 0.000000] Movable zone start for each node184lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)185client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]186worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]187client # [ 0.000000] DMA32 empty188worker2 # [ 0.000000] DMA32 empty189worker1 # [ 0.000000] Early memory node ranges190worker2 # [ 0.000000] Normal empty191client # [ 0.000000] Normal empty192worker2 # [ 0.000000] Device empty193worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]194client # [ 0.000000] Device empty195lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)196worker2 # [ 0.000000] Movable zone start for each node197client # [ 0.000000] Movable zone start for each node198worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]199lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000200client # [ 0.000000] Early memory node ranges201worker2 # [ 0.000000] Early memory node ranges202worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000203lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000204client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]205worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]206worker1 # [ 0.000000] psci: probing for conduit method from DT.207worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]208lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.209client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]210worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.211client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000212worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs213worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000214lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns215worker2 # [ 0.000000] psci: probing for conduit method from DT.216worker1 # [ 0.000000] psci: Trusted OS migration not required217client # [ 0.000000] psci: probing for conduit method from DT.218worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.219worker1 # [ 0.000000] psci: SMC Calling Convention v1.1220lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).221client # [ 0.000000] psci: PSCIv1.3 detected in firmware.222worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs223client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs224worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)225client # [ 0.000000] psci: Trusted OS migration not required226worker2 # [ 0.000000] psci: Trusted OS migration not required227lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns228worker2 # [ 0.000000] psci: SMC Calling Convention v1.1229client # [ 0.000000] psci: SMC Calling Convention v1.1230worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296231lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns232worker1 # [ 0.000000] Detected PIPT I-cache on CPU0233lb # [ 0.000033] arm-pv: using stolen time PV234worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)235client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)236worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)237worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296238client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296239worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface240worker2 # [ 0.000000] Detected PIPT I-cache on CPU0241lb # [ 0.000654] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)242client # [ 0.000000] Detected PIPT I-cache on CPU0243worker1 # [ 0.000000] CPU features: detected: Spectre-v4244lb # [ 0.000807] Console: colour dummy device 80x25245client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)246worker1 # [ 0.000000] CPU features: detected: Spectre-BHB247lb # [ 0.000815] printk: legacy console [tty0] enabled248worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)249worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface250worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38251client # [ 0.000000] CPU features: detected: GICv3 CPU interface252client # [ 0.000000] CPU features: detected: Spectre-v4253worker2 # [ 0.000000] CPU features: detected: Spectre-v4254lb # [ 0.001032] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)255worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23256worker2 # [ 0.000000] CPU features: detected: Spectre-BHB257client # [ 0.000000] CPU features: detected: Spectre-BHB258lb # [ 0.001038] pid_max: default: 32768 minimum: 301259worker1 # [ 0.000000] alternatives: applying boot alternatives260worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38261client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38262lb # [ 0.001107] LSM: initializing lsm=capability,landlock,yama,bpf,ima263lb # [ 0.001290] landlock: Up and running.264worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23265client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23266lb # [ 0.001293] Yama: becoming mindful.267worker2 # [ 0.000000] alternatives: applying boot alternatives268client # [ 0.000000] alternatives: applying boot alternatives269lb # [ 0.001939] LSM support for eBPF active270lb # [ 0.002083] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)271lb # [ 0.002116] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)272worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/j8hg5v2mna41b2rmqffhgiw2p9n7fx0y-nixos-system-worker1-test/init regInfo=/nix/store/jsp8jrhhk8b4cd1nrwsv3w1mv7c8x67x-closure-info/registration console=ttyAMA0,115200n8 console=tty0273lb # [ 0.003266] cacheinfo: Unable to detect cache hierarchy for CPU 0274lb # [ 0.003956] rcu: Hierarchical SRCU implementation.275worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1d3l1q1rzfvh0f7kbcwmr9fszyp0b0dz-nixos-system-worker2-test/init regInfo=/nix/store/ff87zia02lc2pva4ypygaxx75p990h0m-closure-info/registration console=ttyAMA0,115200n8 console=tty0276lb # [ 0.003960] rcu: Max phase no-delay instances is 1000.277worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/jsp8jrhhk8b4cd1nrwsv3w1mv7c8x67x-closure-info/registration", will be passed to user space.278client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test/init regInfo=/nix/store/bs9wr4dhg08lmmqzzj6b672rzvy73rhp-closure-info/registration console=ttyAMA0,115200n8 console=tty0279lb # [ 0.005188] fsl-mc MSI: its@8080000 domain created280worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes281lb # [ 0.005278] EFI services will not be available.282lb # [ 0.005347] smp: Bringing up secondary CPUs ...283worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/ff87zia02lc2pva4ypygaxx75p990h0m-closure-info/registration", will be passed to user space.284worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)285client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/bs9wr4dhg08lmmqzzj6b672rzvy73rhp-closure-info/registration", will be passed to user space.286lb # [ 0.005355] smp: Brought up 1 node, 1 CPU287worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes288lb # [ 0.005358] SMP: Total of 1 processors activated.289client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes290worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)291lb # [ 0.005363] CPU: All CPU(s) started at EL1292worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)293client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)294lb # [ 0.005373] CPU features: detected: Branch Target Identification295worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB296worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)297worker1 # [ 0.000000] software IO TLB: area num 1.298client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)299lb # [ 0.005378] CPU features: detected: ARMv8.4 Translation Table Level300worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB301worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB302worker2 # [ 0.000000] software IO TLB: area num 1.303lb # [ 0.005381] CPU features: detected: Instruction cache invalidation not required for I/D coherence304client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB305worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)306worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB307client # [ 0.000000] software IO TLB: area num 1.308lb # [ 0.005385] CPU features: detected: Data cache clean to the PoU not required for I/D coherence309worker1 # [ 0.000000] Fallback order for Node 0: 0310client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB311worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)312lb # [ 0.005388] CPU features: detected: Common not Private translations313worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216314worker2 # [ 0.000000] Fallback order for Node 0: 0315worker1 # [ 0.000000] Policy zone: DMA316lb # [ 0.005391] CPU features: detected: CRC32 instructions317client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)318worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216319client # [ 0.000000] Fallback order for Node 0: 0320worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off321lb # [ 0.005394] CPU features: detected: Data cache clean to Point of Deep Persistence322worker2 # [ 0.000000] Policy zone: DMA323client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216324worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1325worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off326lb # [ 0.005398] CPU features: detected: Data cache clean to Point of Persistence327client # [ 0.000000] Policy zone: DMA328worker1 # [ 0.000000] allocated 3145728 bytes of page_ext329worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1330worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages331lb # [ 0.005401] CPU features: detected: Data independent timing control (DIT)332client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off333worker2 # [ 0.000000] allocated 3145728 bytes of page_ext334lb # [ 0.005404] CPU features: detected: E0PD335worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups336client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1337worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.338lb # [ 0.005406] CPU features: detected: Enhanced Counter Virtualization339client # [ 0.000000] allocated 3145728 bytes of page_ext340worker1 # [ 0.000000] rcu: RCU event tracing is enabled.341worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages342client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages343lb # [ 0.005409] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)344worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups345worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.346client # [ 0.000000] ftrace: allocated 294 pages with 4 groups347lb # [ 0.005411] CPU features: detected: Enhanced Virtualization Traps348worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.349worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.350client # [ 0.000000] rcu: Hierarchical RCU implementation.351lb # [ 0.005414] CPU features: detected: Fine Grained Traps352worker2 # [ 0.000000] rcu: RCU event tracing is enabled.353client # [ 0.000000] rcu: RCU event tracing is enabled.354worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.355worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.356lb # [ 0.005418] CPU features: detected: Generic authentication (architected QARMA5 algorithm)357worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.358client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.359worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.360client # [ 0.000000] Trampoline variant of Tasks RCU enabled.361lb # [ 0.005422] CPU features: detected: RCpc load-acquire (LDAPR)362worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.363worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.364client # [ 0.000000] Rude variant of Tasks RCU enabled.365lb # [ 0.005425] CPU features: detected: LSE atomic instructions366worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1367worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.368client # [ 0.000000] Tracing variant of Tasks RCU enabled.369lb # [ 0.005428] CPU features: detected: Privileged Access Never370lb # [ 0.005430] CPU features: detected: PMUv3371worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.372worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.373client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.374lb # [ 0.005433] CPU features: detected: RAS Extension Support375worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1376client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1377worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.378lb # [ 0.005435] CPU features: detected: RASv1p1 Extension Support379worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.380client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.381lb # [ 0.005438] CPU features: detected: Random Number Generator382worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.383lb # [ 0.005440] CPU features: detected: Speculation barrier (SB)384worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0385worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.386client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.387worker1 # [ 0.000000] GICv3: 256 SPIs implemented388lb # [ 0.005443] CPU features: detected: Stage-2 Force Write-Back389worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented390worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.391client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.392lb # [ 0.005446] CPU features: detected: TLB range maintenance instructions393worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq394worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0395client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0396worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI397lb # [ 0.005450] CPU features: detected: Speculative Store Bypassing Safe (SSBS)398worker2 # [ 0.000000] GICv3: 256 SPIs implemented399client # [ 0.000000] GICv3: 256 SPIs implemented400worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0401lb # [ 0.005490] alternatives: applying system-wide alternatives402worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented403client # [ 0.000000] GICv3: 0 Extended SPIs implemented404worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000405worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq406client # [ 0.000000] Root IRQ handler: gic_handle_irq407lb # [ 0.008402] CPU features: detected: BBM Level 2 without TLB conflict abort408worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI409worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]410client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI411worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0412client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0413worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)414lb # [ 0.008558] Memory: 1406548K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)415worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000416client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000417lb # [ 0.008916] devtmpfs: initialized418worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]419client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]420worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)421lb # [ 0.010673] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)422worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000423worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)424client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)425worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000426worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)427client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)428worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.429worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000430client # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000431worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns432worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000433client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000434worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).435worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.436client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.437worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns438worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns439client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns440worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).441client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).442worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns443worker1 # [ 0.000027] arm-pv: using stolen time PV444worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns445client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns446worker1 # [ 0.000390] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)447worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns448worker1 # [ 0.000596] Console: colour dummy device 80x25449client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns450worker2 # [ 0.000029] arm-pv: using stolen time PV451client # [ 0.000030] arm-pv: using stolen time PV452worker1 # [ 0.000603] printk: legacy console [tty0] enabled453lb # [ 0.010695] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).454worker2 # [ 0.000413] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)455lb # [ 0.010892] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL456client # [ 0.000393] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)457worker1 # [ 0.000787] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)458worker2 # [ 0.000542] Console: colour dummy device 80x25459lb # [ 0.010897] 0 pages in range for non-PLT usage460client # [ 0.000544] Console: colour dummy device 80x25461worker1 # [ 0.000794] pid_max: default: 32768 minimum: 301462worker2 # [ 0.000549] printk: legacy console [tty0] enabled463lb # [ 0.010898] 508288 pages in range for PLT usage464client # [ 0.000551] printk: legacy console [tty0] enabled465worker1 # [ 0.000862] LSM: initializing lsm=capability,landlock,yama,bpf,ima466lb # [ 0.010987] pinctrl core: initialized pinctrl subsystem467worker1 # [ 0.000992] landlock: Up and running.468lb # [ 0.011775] DMI not present or invalid.469worker1 # [ 0.000994] Yama: becoming mindful.470worker2 # [ 0.000735] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)471client # [ 0.000768] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)472worker1 # [ 0.001467] LSM support for eBPF active473worker2 # [ 0.000742] pid_max: default: 32768 minimum: 301474lb # [ 0.015431] NET: Registered PF_NETLINK/PF_ROUTE protocol family475client # [ 0.000775] pid_max: default: 32768 minimum: 301476worker2 # [ 0.000816] LSM: initializing lsm=capability,landlock,yama,bpf,ima477worker1 # [ 0.001603] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)478client # [ 0.000857] LSM: initializing lsm=capability,landlock,yama,bpf,ima479lb # [ 0.017585] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations480worker2 # [ 0.000948] landlock: Up and running.481client # [ 0.001013] landlock: Up and running.482worker2 # [ 0.000951] Yama: becoming mindful.483worker1 # [ 0.001635] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)484client # [ 0.001015] Yama: becoming mindful.485lb # [ 0.017758] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations486worker2 # [ 0.001367] LSM support for eBPF active487client # [ 0.001465] LSM support for eBPF active488worker1 # [ 0.002799] cacheinfo: Unable to detect cache hierarchy for CPU 0489lb # [ 0.017954] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations490worker2 # [ 0.001526] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)491client # [ 0.001598] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)492worker1 # [ 0.003514] rcu: Hierarchical SRCU implementation.493lb # [ 0.017975] audit: initializing netlink subsys (disabled)494worker1 # [ 0.003518] rcu: Max phase no-delay instances is 1000.495worker2 # [ 0.001571] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)496client # [ 0.001630] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)497lb # [ 0.018549] thermal_sys: Registered thermal governor 'fair_share'498worker1 # [ 0.004669] fsl-mc MSI: its@8080000 domain created499worker2 # [ 0.002613] cacheinfo: Unable to detect cache hierarchy for CPU 0500worker1 # [ 0.004758] EFI services will not be available.501client # [ 0.002717] cacheinfo: Unable to detect cache hierarchy for CPU 0502lb # [ 0.018551] thermal_sys: Registered thermal governor 'bang_bang'503worker2 # [ 0.003289] rcu: Hierarchical SRCU implementation.504worker1 # [ 0.004834] smp: Bringing up secondary CPUs ...505client # [ 0.003405] rcu: Hierarchical SRCU implementation.506lb # [ 0.018554] thermal_sys: Registered thermal governor 'step_wise'507worker1 # [ 0.004842] smp: Brought up 1 node, 1 CPU508worker2 # [ 0.003293] rcu: Max phase no-delay instances is 1000.509client # [ 0.003409] rcu: Max phase no-delay instances is 1000.510worker2 # [ 0.004470] fsl-mc MSI: its@8080000 domain created511worker1 # [ 0.004845] SMP: Total of 1 processors activated.512lb # [ 0.018559] thermal_sys: Registered thermal governor 'user_space'513client # [ 0.004566] fsl-mc MSI: its@8080000 domain created514worker1 # [ 0.004850] CPU: All CPU(s) started at EL1515worker2 # [ 0.004559] EFI services will not be available.516client # [ 0.004656] EFI services will not be available.517lb # [ 0.018562] thermal_sys: Registered thermal governor 'power_allocator'518worker2 # [ 0.004669] smp: Bringing up secondary CPUs ...519worker1 # [ 0.004860] CPU features: detected: Branch Target Identification520client # [ 0.004732] smp: Bringing up secondary CPUs ...521worker2 # [ 0.004677] smp: Brought up 1 node, 1 CPU522lb # [ 0.018587] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1523client # [ 0.004740] smp: Brought up 1 node, 1 CPU524worker1 # [ 0.004864] CPU features: detected: ARMv8.4 Translation Table Level525lb # [ 0.018596] cpuidle: using governor ladder526worker2 # [ 0.004680] SMP: Total of 1 processors activated.527client # [ 0.004743] SMP: Total of 1 processors activated.528worker2 # [ 0.004685] CPU: All CPU(s) started at EL1529lb # [ 0.018601] cpuidle: using governor menu530client # [ 0.004748] CPU: All CPU(s) started at EL1531worker1 # [ 0.004867] CPU features: detected: Instruction cache invalidation not required for I/D coherence532worker2 # [ 0.004697] CPU features: detected: Branch Target Identification533lb # [ 0.018790] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.534client # [ 0.004760] CPU features: detected: Branch Target Identification535worker1 # [ 0.004871] CPU features: detected: Data cache clean to the PoU not required for I/D coherence536worker2 # [ 0.004702] CPU features: detected: ARMv8.4 Translation Table Level537lb # [ 0.018806] ASID allocator initialised with 65536 entries538client # [ 0.004765] CPU features: detected: ARMv8.4 Translation Table Level539lb # [ 0.020035] Serial: AMBA PL011 UART driver540worker1 # [ 0.004875] CPU features: detected: Common not Private translations541worker2 # [ 0.004705] CPU features: detected: Instruction cache invalidation not required for I/D coherence542worker1 # [ 0.004878] CPU features: detected: CRC32 instructions543client # [ 0.004768] CPU features: detected: Instruction cache invalidation not required for I/D coherence544lb # [ 0.025462] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1545lb # [ 0.025609] printk: console [ttyAMA0] enabled546worker2 # [ 0.004709] CPU features: detected: Data cache clean to the PoU not required for I/D coherence547worker1 # [ 0.004881] CPU features: detected: Data cache clean to Point of Deep Persistence548client # [ 0.004772] CPU features: detected: Data cache clean to the PoU not required for I/D coherence549worker2 # [ 0.004713] CPU features: detected: Common not Private translations550worker1 # [ 0.004884] CPU features: detected: Data cache clean to Point of Persistence551client # [ 0.004775] CPU features: detected: Common not Private translations552lb # [ 0.145766] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages553worker2 # [ 0.004716] CPU features: detected: CRC32 instructions554client # [ 0.004778] CPU features: detected: CRC32 instructions555worker1 # [ 0.004888] CPU features: detected: Data independent timing control (DIT)556lb # [ 0.145784] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page557worker1 # [ 0.004891] CPU features: detected: E0PD558worker2 # [ 0.004719] CPU features: detected: Data cache clean to Point of Deep Persistence559client # [ 0.004781] CPU features: detected: Data cache clean to Point of Deep Persistence560worker1 # [ 0.004893] CPU features: detected: Enhanced Counter Virtualization561lb # [ 0.145790] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages562worker2 # [ 0.004723] CPU features: detected: Data cache clean to Point of Persistence563client # [ 0.004785] CPU features: detected: Data cache clean to Point of Persistence564lb # [ 0.145794] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page565worker1 # [ 0.004896] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)566worker2 # [ 0.004726] CPU features: detected: Data independent timing control (DIT)567client # [ 0.004788] CPU features: detected: Data independent timing control (DIT)568worker2 # [ 0.004729] CPU features: detected: E0PD569lb # [ 0.145798] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages570worker1 # [ 0.004899] CPU features: detected: Enhanced Virtualization Traps571client # [ 0.004791] CPU features: detected: E0PD572worker1 # [ 0.004902] CPU features: detected: Fine Grained Traps573worker2 # [ 0.004731] CPU features: detected: Enhanced Counter Virtualization574lb # [ 0.145802] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page575client # [ 0.004793] CPU features: detected: Enhanced Counter Virtualization576worker2 # [ 0.004734] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)577lb # [ 0.145807] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages578worker1 # [ 0.004906] CPU features: detected: Generic authentication (architected QARMA5 algorithm)579client # [ 0.004796] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)580worker2 # [ 0.004737] CPU features: detected: Enhanced Virtualization Traps581lb # [ 0.145811] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page582client # [ 0.004800] CPU features: detected: Enhanced Virtualization Traps583worker2 # [ 0.004741] CPU features: detected: Fine Grained Traps584client # [ 0.004803] CPU features: detected: Fine Grained Traps585worker2 # [ 0.004745] CPU features: detected: Generic authentication (architected QARMA5 algorithm)586client # [ 0.004806] CPU features: detected: Generic authentication (architected QARMA5 algorithm)587worker2 # [ 0.004750] CPU features: detected: RCpc load-acquire (LDAPR)588lb # [ 0.152950] fbcon: Taking over console589client # [ 0.004812] CPU features: detected: RCpc load-acquire (LDAPR)590lb # [ 0.152964] ACPI: Interpreter disabled.591worker2 # [ 0.004753] CPU features: detected: LSE atomic instructions592client # [ 0.004815] CPU features: detected: LSE atomic instructions593lb # [ 0.154764] iommu: Default domain type: Translated594worker2 # [ 0.004756] CPU features: detected: Privileged Access Never595client # [ 0.004818] CPU features: detected: Privileged Access Never596worker2 # [ 0.004758] CPU features: detected: PMUv3597lb # [ 0.154774] iommu: DMA domain TLB invalidation policy: strict mode598client # [ 0.004821] CPU features: detected: PMUv3599worker2 # [ 0.004761] CPU features: detected: RAS Extension Support600lb # [ 0.156441] SCSI subsystem initialized601client # [ 0.004823] CPU features: detected: RAS Extension Support602worker2 # [ 0.004764] CPU features: detected: RASv1p1 Extension Support603client # [ 0.004826] CPU features: detected: RASv1p1 Extension Support604worker2 # [ 0.004767] CPU features: detected: Random Number Generator605client # [ 0.004829] CPU features: detected: Random Number Generator606worker2 # [ 0.004769] CPU features: detected: Speculation barrier (SB)607client # [ 0.004831] CPU features: detected: Speculation barrier (SB)608worker2 # [ 0.004772] CPU features: detected: Stage-2 Force Write-Back609client # [ 0.004834] CPU features: detected: Stage-2 Force Write-Back610worker1 # [ 0.004911] CPU features: detected: RCpc load-acquire (LDAPR)611worker2 # [ 0.004775] CPU features: detected: TLB range maintenance instructions612client # [ 0.004837] CPU features: detected: TLB range maintenance instructions613worker1 # [ 0.004914] CPU features: detected: LSE atomic instructions614worker2 # [ 0.004780] CPU features: detected: Speculative Store Bypassing Safe (SSBS)615worker1 # [ 0.004917] CPU features: detected: Privileged Access Never616worker2 # [ 0.004818] alternatives: applying system-wide alternatives617worker1 # [ 0.004919] CPU features: detected: PMUv3618worker2 # [ 0.007714] CPU features: detected: BBM Level 2 without TLB conflict abort619worker1 # [ 0.004922] CPU features: detected: RAS Extension Support620worker1 # [ 0.004925] CPU features: detected: RASv1p1 Extension Support621worker1 # [ 0.004927] CPU features: detected: Random Number Generator622worker2 # [ 0.007848] Memory: 1406584K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)623worker1 # [ 0.004930] CPU features: detected: Speculation barrier (SB)624worker2 # [ 0.008252] devtmpfs: initialized625worker1 # [ 0.004933] CPU features: detected: Stage-2 Force Write-Back626lb # [ 0.164047] usbcore: registered new interface driver usbfs627worker2 # [ 0.010093] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)628lb # [ 0.164080] usbcore: registered new interface driver hub629worker1 # [ 0.004936] CPU features: detected: TLB range maintenance instructions630worker2 # [ 0.010114] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).631lb # [ 0.164098] usbcore: registered new device driver usb632worker1 # [ 0.004940] CPU features: detected: Speculative Store Bypassing Safe (SSBS)633lb # [ 0.164394] pps_core: LinuxPPS API ver. 1 registered634worker2 # [ 0.010314] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL635worker1 # [ 0.004976] alternatives: applying system-wide alternatives636worker2 # [ 0.010318] 0 pages in range for non-PLT usage637lb # [ 0.164400] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>638worker2 # [ 0.010319] 508288 pages in range for PLT usage639worker1 # [ 0.007864] CPU features: detected: BBM Level 2 without TLB conflict abort640lb # [ 0.164410] PTP clock support registered641worker2 # [ 0.010417] pinctrl core: initialized pinctrl subsystem642lb # [ 0.164455] EDAC MC: Ver: 3.0.0643worker2 # [ 0.011155] DMI not present or invalid.644client # [ 0.004842] CPU features: detected: Speculative Store Bypassing Safe (SSBS)645worker1 # [ 0.008084] Memory: 1406500K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)646lb # [ 0.168931] scmi_core: SCMI protocol bus registered647client # [ 0.004878] alternatives: applying system-wide alternatives648worker2 # [ 0.014266] NET: Registered PF_NETLINK/PF_ROUTE protocol family649worker1 # [ 0.008428] devtmpfs: initialized650worker2 # [ 0.016500] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations651lb # [ 0.169855] FPGA manager framework652client # [ 0.007854] CPU features: detected: BBM Level 2 without TLB conflict abort653worker1 # [ 0.010128] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)654lb # [ 0.170804] vgaarb: loaded655worker2 # [ 0.016677] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations656worker1 # [ 0.010154] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).657client # [ 0.008083] Memory: 1406556K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)658worker2 # [ 0.016870] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations659worker1 # [ 0.010339] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL660client # [ 0.008449] devtmpfs: initialized661lb # [ 0.171432] clocksource: Switched to clocksource arch_sys_counter662worker1 # [ 0.010343] 0 pages in range for non-PLT usage663worker2 # [ 0.016889] audit: initializing netlink subsys (disabled)664lb # [ 0.172004] VFS: Disk quotas dquot_6.6.0665client # [ 0.010229] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)666worker1 # [ 0.010344] 508288 pages in range for PLT usage667worker2 # [ 0.017420] thermal_sys: Registered thermal governor 'fair_share'668lb # [ 0.172028] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)669worker1 # [ 0.010437] pinctrl core: initialized pinctrl subsystem670client # [ 0.010250] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).671worker2 # [ 0.017422] thermal_sys: Registered thermal governor 'bang_bang'672worker1 # [ 0.011208] DMI not present or invalid.673lb # [ 0.174257] netfs: FS-Cache loaded674lb # [ 0.174348] pnp: PnP ACPI: disabled675worker2 # [ 0.017426] thermal_sys: Registered thermal governor 'step_wise'676worker1 # [ 0.014254] NET: Registered PF_NETLINK/PF_ROUTE protocol family677client # [ 0.010429] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL678client # [ 0.010433] 0 pages in range for non-PLT usage679worker2 # [ 0.017431] thermal_sys: Registered thermal governor 'user_space'680worker1 # [ 0.016698] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations681client # [ 0.010434] 508288 pages in range for PLT usage682worker2 # [ 0.017433] thermal_sys: Registered thermal governor 'power_allocator'683client # [ 0.010540] pinctrl core: initialized pinctrl subsystem684worker1 # [ 0.016888] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations685client # [ 0.011303] DMI not present or invalid.686worker2 # [ 0.017456] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1687worker1 # [ 0.017084] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations688client # [ 0.014502] NET: Registered PF_NETLINK/PF_ROUTE protocol family689worker1 # [ 0.017106] audit: initializing netlink subsys (disabled)690client # [ 0.016690] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations691worker1 # [ 0.017675] thermal_sys: Registered thermal governor 'fair_share'692client # [ 0.016881] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations693worker1 # [ 0.017677] thermal_sys: Registered thermal governor 'bang_bang'694client # [ 0.017077] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations695worker1 # [ 0.017681] thermal_sys: Registered thermal governor 'step_wise'696client # [ 0.017109] audit: initializing netlink subsys (disabled)697worker1 # [ 0.017686] thermal_sys: Registered thermal governor 'user_space'698client # [ 0.017703] thermal_sys: Registered thermal governor 'fair_share'699worker1 # [ 0.017689] thermal_sys: Registered thermal governor 'power_allocator'700client # [ 0.017705] thermal_sys: Registered thermal governor 'bang_bang'701worker1 # [ 0.017711] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1702client # [ 0.017709] thermal_sys: Registered thermal governor 'step_wise'703worker1 # [ 0.017721] cpuidle: using governor ladder704lb # [ 0.180153] NET: Registered PF_INET protocol family705worker1 # [ 0.017727] cpuidle: using governor menu706client # [ 0.017713] thermal_sys: Registered thermal governor 'user_space'707lb # [ 0.180411] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)708worker1 # [ 0.017915] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.709client # [ 0.017716] thermal_sys: Registered thermal governor 'power_allocator'710worker1 # [ 0.017930] ASID allocator initialised with 65536 entries711client # [ 0.017739] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1712worker2 # [ 0.017466] cpuidle: using governor ladder713worker1 # [ 0.019123] Serial: AMBA PL011 UART driver714worker2 # [ 0.017471] cpuidle: using governor menu715client # [ 0.017749] cpuidle: using governor ladder716client # [ 0.017754] cpuidle: using governor menu717worker1 # [ 0.024214] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1718worker2 # [ 0.017682] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.719worker1 # [ 0.024366] printk: console [ttyAMA0] enabled720client # [ 0.017941] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.721worker2 # [ 0.017695] ASID allocator initialised with 65536 entries722worker2 # [ 0.018885] Serial: AMBA PL011 UART driver723client # [ 0.017954] ASID allocator initialised with 65536 entries724worker1 # [ 0.143443] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages725client # [ 0.019104] Serial: AMBA PL011 UART driver726worker2 # [ 0.024763] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1727worker1 # [ 0.143463] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page728client # [ 0.024240] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1729worker2 # [ 0.024887] printk: console [ttyAMA0] enabled730worker1 # [ 0.143468] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages731client # [ 0.024388] printk: console [ttyAMA0] enabled732worker1 # [ 0.143472] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page733worker2 # [ 0.144672] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages734client # [ 0.144793] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages735worker1 # [ 0.143477] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages736worker2 # [ 0.144688] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page737client # [ 0.144811] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page738worker1 # [ 0.143481] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page739worker2 # [ 0.144693] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages740client # [ 0.144815] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages741worker1 # [ 0.143486] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages742worker2 # [ 0.144697] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page743client # [ 0.144820] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page744worker1 # [ 0.143490] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page745worker2 # [ 0.144701] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages746client # [ 0.144824] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages747worker2 # [ 0.144705] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page748client # [ 0.144829] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page749worker2 # [ 0.144709] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages750client # [ 0.144833] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages751worker1 # [ 0.150714] fbcon: Taking over console752worker2 # [ 0.144713] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page753worker1 # [ 0.150728] ACPI: Interpreter disabled.754client # [ 0.144837] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page755worker2 # [ 0.152002] fbcon: Taking over console756worker2 # [ 0.152017] ACPI: Interpreter disabled.757client # [ 0.152192] fbcon: Taking over console758client # [ 0.152206] ACPI: Interpreter disabled.759worker2 # [ 0.153915] iommu: Default domain type: Translated760worker2 # [ 0.153924] iommu: DMA domain TLB invalidation policy: strict mode761worker2 # [ 0.155583] SCSI subsystem initialized762worker1 # [ 0.157722] iommu: Default domain type: Translated763worker1 # [ 0.157731] iommu: DMA domain TLB invalidation policy: strict mode764worker1 # [ 0.159398] SCSI subsystem initialized765worker1 # [ 0.160085] usbcore: registered new interface driver usbfs766worker1 # [ 0.160117] usbcore: registered new interface driver hub767worker1 # [ 0.160135] usbcore: registered new device driver usb768worker1 # [ 0.160398] pps_core: LinuxPPS API ver. 1 registered769client # [ 0.160857] iommu: Default domain type: Translated770worker2 # [ 0.160895] usbcore: registered new interface driver usbfs771worker2 # [ 0.160928] usbcore: registered new interface driver hub772client # [ 0.160868] iommu: DMA domain TLB invalidation policy: strict mode773worker1 # [ 0.160403] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>774worker2 # [ 0.160945] usbcore: registered new device driver usb775worker1 # [ 0.160414] PTP clock support registered776client # [ 0.162582] SCSI subsystem initialized777worker2 # [ 0.161219] pps_core: LinuxPPS API ver. 1 registered778worker1 # [ 0.160470] EDAC MC: Ver: 3.0.0779worker1 # [ 0.165004] scmi_core: SCMI protocol bus registered780client # [ 0.163247] usbcore: registered new interface driver usbfs781worker2 # [ 0.161224] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>782worker2 # [ 0.161235] PTP clock support registered783client # [ 0.163271] usbcore: registered new interface driver hub784worker1 # [ 0.165966] FPGA manager framework785worker2 # [ 0.161283] EDAC MC: Ver: 3.0.0786client # [ 0.163303] usbcore: registered new device driver usb787worker1 # [ 0.166904] vgaarb: loaded788worker2 # [ 0.165829] scmi_core: SCMI protocol bus registered789client # [ 0.163579] pps_core: LinuxPPS API ver. 1 registered790worker1 # [ 0.167530] clocksource: Switched to clocksource arch_sys_counter791worker2 # [ 0.166804] FPGA manager framework792client # [ 0.163585] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>793worker2 # [ 0.167792] vgaarb: loaded794client # [ 0.163596] PTP clock support registered795client # [ 0.163635] EDAC MC: Ver: 3.0.0796worker2 # [ 0.168498] clocksource: Switched to clocksource arch_sys_counter797client # [ 0.168246] scmi_core: SCMI protocol bus registered798client # [ 0.169198] FPGA manager framework799lb # [ 0.208902] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)800client # [ 0.170154] vgaarb: loaded801lb # [ 0.208944] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)802worker1 # [ 0.170630] VFS: Disk quotas dquot_6.6.0803lb # [ 0.208972] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)804client # [ 0.170805] clocksource: Switched to clocksource arch_sys_counter805worker1 # [ 0.170673] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)806worker2 # [ 0.172305] VFS: Disk quotas dquot_6.6.0807client # [ 0.171401] VFS: Disk quotas dquot_6.6.0808lb # [ 0.209041] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)809worker2 # [ 0.172342] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)810worker1 # [ 0.174312] netfs: FS-Cache loaded811client # [ 0.171435] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)812worker1 # [ 0.174417] pnp: PnP ACPI: disabled813lb # [ 0.209185] TCP: Hash tables configured (established 16384 bind 16384)814client # [ 0.173734] netfs: FS-Cache loaded815lb # [ 0.209259] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)816client # [ 0.173829] pnp: PnP ACPI: disabled817lb # [ 0.209294] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)818lb # [ 0.209329] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)819worker2 # [ 0.176240] netfs: FS-Cache loaded820worker2 # [ 0.176361] pnp: PnP ACPI: disabled821lb # [ 0.209412] NET: Registered PF_UNIX/PF_LOCAL protocol family822lb # [ 0.209435] NET: Registered PF_XDP protocol family823lb # [ 0.209452] PCI: CLS 0 bytes, default 64824worker1 # [ 0.178265] NET: Registered PF_INET protocol family825lb # [ 0.209683] Trying to unpack rootfs image as initramfs...826worker1 # [ 0.178523] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)827worker2 # [ 0.180234] NET: Registered PF_INET protocol family828worker2 # [ 0.180492] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)829client # [ 0.179729] NET: Registered PF_INET protocol family830client # [ 0.180004] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)831lb # [ 0.224977] kvm [1]: HYP mode not available832worker1 # [ 0.207943] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833worker1 # [ 0.207990] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834worker1 # [ 0.208018] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835worker2 # [ 0.210030] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)836worker1 # [ 0.208096] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)837worker2 # [ 0.210078] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)838worker1 # [ 0.208239] TCP: Hash tables configured (established 16384 bind 16384)839worker2 # [ 0.210108] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)840worker1 # [ 0.208319] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)841worker2 # [ 0.210186] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)842client # [ 0.209374] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)843worker1 # [ 0.208355] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)844worker2 # [ 0.210328] TCP: Hash tables configured (established 16384 bind 16384)845client # [ 0.209422] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)846worker1 # [ 0.208391] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)847worker2 # [ 0.210410] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)848worker1 # [ 0.208506] NET: Registered PF_UNIX/PF_LOCAL protocol family849client # [ 0.209451] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)850worker1 # [ 0.208534] NET: Registered PF_XDP protocol family851worker2 # [ 0.210443] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)852client # [ 0.209525] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)853worker1 # [ 0.208551] PCI: CLS 0 bytes, default 64854worker2 # [ 0.210479] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)855worker1 # [ 0.208805] Trying to unpack rootfs image as initramfs...856client # [ 0.209669] TCP: Hash tables configured (established 16384 bind 16384)857worker2 # [ 0.210571] NET: Registered PF_UNIX/PF_LOCAL protocol family858client # [ 0.209750] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)859worker2 # [ 0.210624] NET: Registered PF_XDP protocol family860worker2 # [ 0.210643] PCI: CLS 0 bytes, default 64861client # [ 0.209785] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)862worker2 # [ 0.210905] Trying to unpack rootfs image as initramfs...863client # [ 0.209822] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)864client # [ 0.209928] NET: Registered PF_UNIX/PF_LOCAL protocol family865client # [ 0.209969] NET: Registered PF_XDP protocol family866client # [ 0.209987] PCI: CLS 0 bytes, default 64867client # [ 0.210219] Trying to unpack rootfs image as initramfs...868worker1 # [ 0.225050] kvm [1]: HYP mode not available869worker2 # [ 0.226069] kvm [1]: HYP mode not available870client # [ 0.228431] kvm [1]: HYP mode not available871lb # [ 0.316030] Initialise system trusted keyrings872lb # [ 0.316774] workingset: timestamp_bits=42 max_order=19 bucket_order=0873lb # [ 0.318046] squashfs: version 4.0 (2009/01/31) Phillip Lougher874lb # [ 0.318803] 9p: Installing v9fs 9p2000 file system support875lb # [ 0.339373] Key type asymmetric registered876lb # [ 0.339398] Asymmetric key parser 'x509' registered877lb # [ 0.347498] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)878lb # [ 0.348529] io scheduler mq-deadline registered879lb # [ 0.348539] io scheduler kyber registered880lb # [ 0.359573] pl061_gpio 9030000.pl061: PL061 GPIO chip registered881worker1 # [ 0.316031] Initialise system trusted keyrings882worker1 # [ 0.316765] workingset: timestamp_bits=42 max_order=19 bucket_order=0883worker1 # [ 0.318058] squashfs: version 4.0 (2009/01/31) Phillip Lougher884worker2 # [ 0.317071] Initialise system trusted keyrings885lb # [ 0.360961] ledtrig-cpu: registered to indicate activity on CPUs886worker2 # [ 0.317829] workingset: timestamp_bits=42 max_order=19 bucket_order=0887worker1 # [ 0.318837] 9p: Installing v9fs 9p2000 file system support888lb # [ 0.361349] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:889worker2 # [ 0.319161] squashfs: version 4.0 (2009/01/31) Phillip Lougher890lb # [ 0.361367] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000891worker2 # [ 0.319931] 9p: Installing v9fs 9p2000 file system support892lb # [ 0.361379] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000893lb # [ 0.361387] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000894lb # [ 0.361408] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits895lb # [ 0.361444] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]896lb # [ 0.361530] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00897client # [ 0.324502] Initialise system trusted keyrings898lb # [ 0.361539] pci_bus 0000:00: root bus resource [bus 00-ff]899client # [ 0.325275] workingset: timestamp_bits=42 max_order=19 bucket_order=0900lb # [ 0.361545] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]901lb # [ 0.361550] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]902client # [ 0.326551] squashfs: version 4.0 (2009/01/31) Phillip Lougher903lb # [ 0.361555] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]904lb # [ 0.361610] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint905lb # [ 0.362046] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint906lb # [ 0.362230] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]907lb # [ 0.362246] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]908lb # [ 0.362275] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]909lb # [ 0.362291] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]910lb # [ 0.362733] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint911lb # [ 0.362915] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]912lb # [ 0.362931] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]913client # [ 0.327403] 9p: Installing v9fs 9p2000 file system support914lb # [ 0.362960] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]915lb # [ 0.363428] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint916lb # [ 0.383334] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]917worker1 # [ 0.339360] Key type asymmetric registered918lb # [ 0.383354] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]919worker1 # [ 0.339383] Asymmetric key parser 'x509' registered920lb # [ 0.383383] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]921worker1 # [ 0.339453] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)922lb # [ 0.385980] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint923lb # [ 0.386165] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]924lb # [ 0.386181] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]925lb # [ 0.386213] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]926lb # [ 0.386657] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint927lb # [ 0.386837] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]928lb # [ 0.386852] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]929worker1 # [ 0.347577] io scheduler mq-deadline registered930worker1 # [ 0.347595] io scheduler kyber registered931lb # [ 0.386882] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]932client # [ 0.347285] Key type asymmetric registered933lb # [ 0.387363] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint934client # [ 0.347311] Asymmetric key parser 'x509' registered935worker2 # [ 0.348555] Key type asymmetric registered936worker2 # [ 0.348582] Asymmetric key parser 'x509' registered937client # [ 0.347384] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)938worker2 # [ 0.348649] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)939worker2 # [ 0.350781] io scheduler mq-deadline registered940worker2 # [ 0.350792] io scheduler kyber registered941client # [ 0.354898] io scheduler mq-deadline registered942client # [ 0.354918] io scheduler kyber registered943worker2 # [ 0.360636] pl061_gpio 9030000.pl061: PL061 GPIO chip registered944lb # [ 0.399571] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]945lb # [ 0.399595] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]946lb # [ 0.399623] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]947client # [ 0.362965] pl061_gpio 9030000.pl061: PL061 GPIO chip registered948lb # [ 0.400078] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint949worker2 # [ 0.362022] ledtrig-cpu: registered to indicate activity on CPUs950lb # [ 0.400261] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]951worker2 # [ 0.362422] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:952lb # [ 0.400277] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]953lb # [ 0.400306] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]954worker1 # [ 0.359670] pl061_gpio 9030000.pl061: PL061 GPIO chip registered955worker2 # [ 0.362440] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000956lb # [ 0.400322] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]957worker1 # [ 0.360293] ledtrig-cpu: registered to indicate activity on CPUs958client # [ 0.364323] ledtrig-cpu: registered to indicate activity on CPUs959worker2 # [ 0.362452] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000960worker1 # [ 0.360650] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:961lb # [ 0.400762] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint962client # [ 0.364692] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:963worker2 # [ 0.362460] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000964lb # [ 0.400945] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]965worker1 # [ 0.360667] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000966client # [ 0.364708] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000967lb # [ 0.400974] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]968worker2 # [ 0.362486] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits969worker1 # [ 0.360679] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000970client # [ 0.364720] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000971lb # [ 0.401425] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint972worker2 # [ 0.362510] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]973worker1 # [ 0.360687] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000974lb # [ 0.401613] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]975client # [ 0.364728] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000976worker2 # [ 0.362594] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00977worker1 # [ 0.360708] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits978lb # [ 0.401642] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]979worker2 # [ 0.362603] pci_bus 0000:00: root bus resource [bus 00-ff]980client # [ 0.364749] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits981worker2 # [ 0.362608] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]982lb # [ 0.402028] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint983worker1 # [ 0.360730] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]984client # [ 0.364771] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]985worker2 # [ 0.362614] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]986lb # [ 0.402209] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]987worker1 # [ 0.360804] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00988client # [ 0.364844] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00989worker1 # [ 0.360814] pci_bus 0000:00: root bus resource [bus 00-ff]990worker2 # [ 0.362619] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]991lb # [ 0.402456] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint992client # [ 0.364853] pci_bus 0000:00: root bus resource [bus 00-ff]993lb # [ 0.402721] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]994worker1 # [ 0.360820] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]995client # [ 0.364860] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]996worker2 # [ 0.362677] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint997lb # [ 0.402738] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]998worker1 # [ 0.360825] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]999client # [ 0.364865] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1000worker2 # [ 0.363124] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1001lb # [ 0.402767] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1002worker1 # [ 0.360830] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1003worker2 # [ 0.363315] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1004client # [ 0.364870] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1005worker2 # [ 0.363332] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1006worker1 # [ 0.360906] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1007lb # [ 0.403222] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1008client # [ 0.364924] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1009lb # [ 0.403413] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1010worker2 # [ 0.363364] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1011worker1 # [ 0.361339] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1012lb # [ 0.403429] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1013client # [ 0.365371] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1014worker2 # [ 0.363381] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1015worker1 # [ 0.361524] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1016client # [ 0.365559] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1017lb # [ 0.403471] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1018worker1 # [ 0.361541] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1019worker2 # [ 0.363853] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1020client # [ 0.365575] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1021lb # [ 0.404035] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1022worker2 # [ 0.364044] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1023worker1 # [ 0.361571] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1024client # [ 0.365604] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1025lb # [ 0.404046] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1026worker2 # [ 0.364061] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1027worker1 # [ 0.361587] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1028client # [ 0.365620] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1029worker2 # [ 0.364093] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1030lb # [ 0.404051] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1031worker1 # [ 0.362042] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1032client # [ 0.366076] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1033worker1 # [ 0.362230] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1034lb # [ 0.404095] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1035client # [ 0.366257] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1036worker1 # [ 0.362246] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1037client # [ 0.366273] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1038lb # [ 0.404141] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1039worker1 # [ 0.362276] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1040client # [ 0.366302] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1041worker2 # [ 0.382906] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1042lb # [ 0.404186] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1043worker2 # [ 0.383100] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1044worker1 # [ 0.362737] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1045client # [ 0.366753] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1046lb # [ 0.404231] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1047worker1 # [ 0.362919] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1048worker2 # [ 0.383118] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1049worker1 # [ 0.362935] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1050lb # [ 0.404277] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1051worker2 # [ 0.383150] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1052worker1 # [ 0.362965] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1053lb # [ 0.404323] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1054worker2 # [ 0.383634] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1055worker2 # [ 0.383824] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1056worker1 # [ 0.363412] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1057lb # [ 0.404369] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1058worker1 # [ 0.363615] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1059worker2 # [ 0.383841] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1060lb # [ 0.404414] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1061worker1 # [ 0.363632] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1062worker2 # [ 0.383875] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1063worker1 # [ 0.363665] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1064lb # [ 0.404468] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1065worker2 # [ 0.384387] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1066worker1 # [ 0.364117] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1067lb # [ 0.404535] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1068worker1 # [ 0.364298] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1069lb # [ 0.404581] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1070worker1 # [ 0.364314] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1071lb # [ 0.404602] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1072worker1 # [ 0.364345] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1073lb # [ 0.404622] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1074worker1 # [ 0.364800] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1075lb # [ 0.404644] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1076client # [ 0.391000] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1077worker1 # [ 0.364982] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1078lb # [ 0.404667] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1079client # [ 0.391027] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1080worker1 # [ 0.364998] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1081lb # [ 0.404689] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1082client # [ 0.391057] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1083worker1 # [ 0.365028] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1084lb # [ 0.404710] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1085client # [ 0.391539] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1086worker1 # [ 0.365506] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1087lb # [ 0.404731] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1088client # [ 0.391726] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1089worker1 # [ 0.365690] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1090lb # [ 0.404753] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1091client # [ 0.391742] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1092worker1 # [ 0.365706] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1093lb # [ 0.404774] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1094client # [ 0.391774] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1095worker1 # [ 0.365736] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1096lb # [ 0.404796] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1097worker1 # [ 0.365753] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1098client # [ 0.392228] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1099lb # [ 0.404818] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1100client # [ 0.392410] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1101worker1 # [ 0.366209] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1102lb # [ 0.404840] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1103client # [ 0.392425] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1104worker1 # [ 0.366395] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1105lb # [ 0.404861] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1106client # [ 0.392455] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1107worker1 # [ 0.366425] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1108lb # [ 0.404881] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1109lb # [ 0.404902] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1110client # [ 0.392901] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1111worker1 # [ 0.366883] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1112client # [ 0.393092] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1113lb # [ 0.404924] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1114worker1 # [ 0.367072] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1115worker2 # [ 0.396614] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1116client # [ 0.393107] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1117lb # [ 0.404945] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1118worker1 # [ 0.367103] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1119worker2 # [ 0.396641] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1120client # [ 0.393136] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1121lb # [ 0.404966] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1122worker2 # [ 0.396673] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1123worker1 # [ 0.367496] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1124lb # [ 0.404987] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1125client # [ 0.393616] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1126worker2 # [ 0.397162] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1127lb # [ 0.405009] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1128client # [ 0.393799] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1129worker2 # [ 0.397353] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1130lb # [ 0.405035] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1131client # [ 0.393814] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1132worker2 # [ 0.397370] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1133lb # [ 0.405045] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1134client # [ 0.393844] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1135worker2 # [ 0.397402] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1136lb # [ 0.405050] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1137client # [ 0.393860] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1138worker2 # [ 0.397887] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1139lb # [ 0.406174] pci 0000:00:0a.0: enabling device (0000 -> 0002)1140client # [ 0.394312] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1141worker2 # [ 0.398076] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1142client # [ 0.394499] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1143worker2 # [ 0.398094] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1144client # [ 0.394529] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1145worker2 # [ 0.398125] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1146worker2 # [ 0.398143] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1147worker2 # [ 0.398616] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1148worker2 # [ 0.398809] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1149worker2 # [ 0.398840] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1150worker2 # [ 0.399322] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1151worker2 # [ 0.399517] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1152worker2 # [ 0.399549] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1153worker2 # [ 0.399955] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1154worker2 # [ 0.400143] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1155worker1 # [ 0.415715] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1156worker2 # [ 0.400409] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1157worker1 # [ 0.415990] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1158worker2 # [ 0.400688] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1159worker1 # [ 0.416252] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1160worker2 # [ 0.400706] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1161worker1 # [ 0.416270] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1162worker2 # [ 0.400738] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1163worker1 # [ 0.416300] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1164worker2 # [ 0.401222] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1165worker1 # [ 0.416751] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1166worker2 # [ 0.401404] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1167worker1 # [ 0.416933] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1168worker2 # [ 0.401419] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1169worker1 # [ 0.416950] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1170client # [ 0.419035] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1171worker2 # [ 0.401449] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1172worker1 # [ 0.416980] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1173client # [ 0.419236] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1174worker2 # [ 0.402037] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1175worker1 # [ 0.417563] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1176client # [ 0.419265] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1177worker2 # [ 0.402049] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1178worker1 # [ 0.417575] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1179client # [ 0.419652] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1180worker2 # [ 0.402054] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1181worker1 # [ 0.417580] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1182client # [ 0.419831] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1183worker2 # [ 0.402099] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1184worker1 # [ 0.417624] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1185client # [ 0.420074] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1186worker2 # [ 0.402148] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1187client # [ 0.420338] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1188worker1 # [ 0.417671] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1189worker2 # [ 0.402197] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1190client # [ 0.420355] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1191worker1 # [ 0.417719] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1192client # [ 0.420384] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1193worker2 # [ 0.402246] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1194worker1 # [ 0.417764] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1195client # [ 0.420848] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1196worker2 # [ 0.402294] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1197worker1 # [ 0.417811] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1198client # [ 0.421030] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1199worker2 # [ 0.402343] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1200client # [ 0.421045] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1201worker1 # [ 0.417859] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1202worker2 # [ 0.402391] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1203client # [ 0.421074] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1204worker1 # [ 0.417907] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1205client # [ 0.421659] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1206worker2 # [ 0.402442] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1207worker1 # [ 0.417955] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1208client # [ 0.421671] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1209worker2 # [ 0.402491] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1210worker1 # [ 0.418003] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1211lb # [ 0.481808] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1212client # [ 0.421676] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1213worker2 # [ 0.402568] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1214worker1 # [ 0.418063] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1215worker2 # [ 0.402617] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1216client # [ 0.421721] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1217worker1 # [ 0.418109] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1218worker2 # [ 0.402640] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1219client # [ 0.421766] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1220worker1 # [ 0.418132] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1221worker2 # [ 0.402663] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1222client # [ 0.421813] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1223worker1 # [ 0.418153] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1224worker2 # [ 0.402686] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1225worker1 # [ 0.418175] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1226client # [ 0.421859] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1227worker2 # [ 0.402713] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1228worker1 # [ 0.418201] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1229client # [ 0.421905] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1230worker2 # [ 0.402736] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1231worker1 # [ 0.418223] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1232client # [ 0.421952] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1233worker2 # [ 0.402759] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1234worker1 # [ 0.418245] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1235worker2 # [ 0.402784] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1236client # [ 0.421998] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1237worker1 # [ 0.418267] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1238worker2 # [ 0.402807] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1239worker1 # [ 0.418289] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1240client # [ 0.422045] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1241worker2 # [ 0.402831] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1242worker1 # [ 0.418311] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1243client # [ 0.422092] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1244worker2 # [ 0.402855] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1245worker1 # [ 0.418334] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1246client # [ 0.422153] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1247worker2 # [ 0.402880] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1248worker1 # [ 0.418357] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1249client # [ 0.422198] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1250worker2 # [ 0.402903] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1251worker1 # [ 0.418378] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1252client # [ 0.422220] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1253worker2 # [ 0.402926] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1254worker1 # [ 0.418400] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1255worker2 # [ 0.402949] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1256client # [ 0.422241] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1257worker1 # [ 0.418422] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1258worker2 # [ 0.402972] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1259client # [ 0.422262] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1260worker1 # [ 0.418444] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1261worker2 # [ 0.402995] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1262client # [ 0.422286] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1263worker1 # [ 0.418465] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1264worker2 # [ 0.403018] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1265client # [ 0.422308] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1266worker1 # [ 0.418487] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1267worker2 # [ 0.403041] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1268worker1 # [ 0.418510] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1269client # [ 0.422330] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1270worker2 # [ 0.403064] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1271worker1 # [ 0.418532] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1272client # [ 0.422351] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1273worker2 # [ 0.403088] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1274lb # [ 0.491665] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1275worker1 # [ 0.418554] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1276client # [ 0.422372] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1277lb # [ 0.495043] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1278worker2 # [ 0.403115] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1279worker1 # [ 0.418581] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1280client # [ 0.422394] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1281lb # [ 0.497062] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1282worker2 # [ 0.403126] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1283worker1 # [ 0.418591] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1284client # [ 0.422416] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1285lb # [ 0.498943] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1286worker2 # [ 0.403130] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1287worker1 # [ 0.418596] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1288worker2 # [ 0.404332] pci 0000:00:0a.0: enabling device (0000 -> 0002)1289client # [ 0.422438] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1290worker1 # [ 0.419770] pci 0000:00:0a.0: enabling device (0000 -> 0002)1291client # [ 0.422459] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1292client # [ 0.422480] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1293client # [ 0.422501] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1294client # [ 0.422522] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1295client # [ 0.422543] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1296client # [ 0.422565] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1297client # [ 0.422586] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1298client # [ 0.422607] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1299client # [ 0.422629] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1300client # [ 0.422655] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1301client # [ 0.422665] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1302client # [ 0.422669] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1303client # [ 0.423842] pci 0000:00:0a.0: enabling device (0000 -> 0002)1304lb # [ 0.509069] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1305lb # [ 0.511262] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1306worker2 # [ 0.468666] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 62830 usecs1307lb # [ 0.522420] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1308worker1 # [ 0.481489] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1309lb # [ 0.528745] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1310lb # [ 0.530520] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1311client # [ 0.489041] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1312worker2 # [ 0.489057] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1313worker2 # [ 0.491220] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1314lb # [ 0.540946] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1315worker1 # [ 0.491640] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1316worker1 # [ 0.495151] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1317worker1 # [ 0.497212] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1318worker1 # [ 0.499417] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1319worker2 # [ 0.502190] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1320worker2 # [ 0.504179] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1321client # [ 0.499044] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1322client # [ 0.502531] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1323client # [ 0.504445] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1324client # [ 0.506434] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1325lb # [ 0.555935] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1326worker1 # [ 0.509154] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1327worker1 # [ 0.511221] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1328lb # [ 0.558431] msm_serial: driver initialized1329lb # [ 0.558567] SuperH (H)SCI(F) driver initialized1330lb # [ 0.558621] STM32 USART driver initialized1331worker2 # [ 0.515516] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1332client # [ 0.516623] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1333worker2 # [ 0.518536] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1334worker1 # [ 0.522481] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1335client # [ 0.522955] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1336client # [ 0.525094] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1337worker1 # [ 0.529066] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1338worker1 # [ 0.530936] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1339worker2 # [ 0.528656] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1340worker2 # [ 0.530847] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1341worker2 # [ 0.533055] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1342client # [ 0.535013] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1343worker2 # [ 0.535026] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1344client # [ 0.536910] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1345worker1 # [ 0.541064] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1346lb # [ 0.589633] loop: module loaded1347lb # [ 0.589834] virtio_blk virtio5: 1/0/0 default/read/poll queues1348lb # [ 0.590576] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1349worker2 # [ 0.545881] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1350worker1 # [ 0.550103] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1351client # [ 0.547491] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1352lb # [ 0.595997] megasas: 07.734.00.00-rc11353lb # [ 0.596676] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1354lb # [ 0.598635] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001355lb # [ 0.598685] Intel/Sharp Extended Query Table at 0x00311356worker1 # [ 0.556369] msm_serial: driver initialized1357worker1 # [ 0.556523] SuperH (H)SCI(F) driver initialized1358worker1 # [ 0.556577] STM32 USART driver initialized1359client # [ 0.560043] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1360client # [ 0.562588] msm_serial: driver initialized1361client # [ 0.562736] SuperH (H)SCI(F) driver initialized1362worker2 # [ 0.562993] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1363client # [ 0.562789] STM32 USART driver initialized1364lb # [ 0.608453] Using buffer write method1365lb # [ 0.608523] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1366lb # [ 0.610119] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001367worker2 # [ 0.565570] msm_serial: driver initialized1368lb # [ 0.610145] Intel/Sharp Extended Query Table at 0x00311369worker2 # [ 0.565713] SuperH (H)SCI(F) driver initialized1370worker2 # [ 0.565767] STM32 USART driver initialized1371lb # [ 0.619467] Using buffer write method1372lb # [ 0.619493] Concatenating MTD devices:1373lb # [ 0.619497] (0): "0.flash"1374lb # [ 0.619501] (1): "0.flash"1375lb # [ 0.619504] into device "0.flash"1376worker1 # [ 0.587788] loop: module loaded1377worker1 # [ 0.587976] virtio_blk virtio5: 1/0/0 default/read/poll queues1378worker1 # [ 0.588694] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1379client # [ 0.593775] loop: module loaded1380client # [ 0.593948] virtio_blk virtio5: 1/0/0 default/read/poll queues1381client # [ 0.594681] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1382worker2 # [ 0.597133] loop: module loaded1383worker1 # [ 0.596141] megasas: 07.734.00.00-rc11384worker2 # [ 0.597301] virtio_blk virtio5: 1/0/0 default/read/poll queues1385worker1 # [ 0.596821] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1386worker2 # [ 0.598081] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1387worker1 # [ 0.598577] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001388worker1 # [ 0.598600] Intel/Sharp Extended Query Table at 0x00311389worker1 # [ 0.603430] Using buffer write method1390client # [ 0.599412] megasas: 07.734.00.00-rc11391worker1 # [ 0.603497] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1392client # [ 0.600082] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1393client # [ 0.602470] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001394client # [ 0.602491] Intel/Sharp Extended Query Table at 0x00311395worker1 # [ 0.612637] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001396worker1 # [ 0.612672] Intel/Sharp Extended Query Table at 0x00311397worker1 # [ 0.614216] Using buffer write method1398client # [ 0.611868] Using buffer write method1399worker1 # [ 0.614242] Concatenating MTD devices:1400worker1 # [ 0.614246] (0): "0.flash"1401worker1 # [ 0.614249] (1): "0.flash"1402client # [ 0.611941] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1403worker2 # [ 0.609133] megasas: 07.734.00.00-rc11404worker1 # [ 0.614253] into device "0.flash"1405worker2 # [ 0.609862] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1406client # [ 0.613560] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001407client # [ 0.613590] Intel/Sharp Extended Query Table at 0x00311408worker2 # [ 0.611689] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001409worker2 # [ 0.611714] Intel/Sharp Extended Query Table at 0x00311410worker2 # [ 0.613352] Using buffer write method1411worker2 # [ 0.613423] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1412worker2 # [ 0.615055] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001413worker2 # [ 0.615078] Intel/Sharp Extended Query Table at 0x00311414client # [ 0.627470] Using buffer write method1415client # [ 0.627507] Concatenating MTD devices:1416client # [ 0.627511] (0): "0.flash"1417client # [ 0.627515] (1): "0.flash"1418client # [ 0.627518] into device "0.flash"1419worker2 # [ 0.633203] Using buffer write method1420worker2 # [ 0.633241] Concatenating MTD devices:1421worker2 # [ 0.633246] (0): "0.flash"1422worker2 # [ 0.633250] (1): "0.flash"1423worker2 # [ 0.633254] into device "0.flash"1424lb # [ 0.848592] Freeing initrd memory: 26140K1425lb # [ 0.854610] tun: Universal TUN/TAP device driver, 1.61426lb # [ 0.858243] thunder_xcv, ver 1.01427lb # [ 0.858289] thunder_bgx, ver 1.01428lb # [ 0.858311] nicpf, ver 1.01429lb # [ 0.858849] e1000: Intel(R) PRO/1000 Network Driver1430lb # [ 0.858856] e1000: Copyright (c) 1999-2006 Intel Corporation.1431lb # [ 0.858880] e1000e: Intel(R) PRO/1000 Network Driver1432lb # [ 0.858887] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1433lb # [ 0.858915] igb: Intel(R) Gigabit Ethernet Network Driver1434lb # [ 0.858921] igb: Copyright (c) 2007-2014 Intel Corporation.1435lb # [ 0.858944] igbvf: Intel(R) Gigabit Virtual Function Network Driver1436lb # [ 0.858950] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1437lb # [ 0.859084] sky2: driver version 1.301438lb # [ 0.868077] ehci-pci 0000:00:0a.0: EHCI Host Controller1439lb # [ 0.868108] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11440lb # [ 0.868307] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001441lb # [ 0.871038] usbcore: registered new interface driver usb-storage1442lb # [ 0.871185] usbcore: registered new interface driver usbserial_generic1443lb # [ 0.871200] usbserial: USB Serial support registered for generic1444lb # [ 0.874091] hv_vmbus: registering driver hyperv_keyboard1445lb # [ 0.875649] rtc-pl031 9010000.pl031: registered as rtc01446lb # [ 0.875675] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:25 UTC (1789896745)1447lb # [ 0.875971] i2c_dev: i2c /dev entries driver1448lb # [ 0.880911] sdhci: Secure Digital Host Controller Interface driver1449lb # [ 0.880920] sdhci: Copyright(c) Pierre Ossman1450lb # [ 0.881185] Synopsys Designware Multimedia Card Interface Driver1451lb # [ 0.881578] sdhci-pltfm: SDHCI platform and OF driver helper1452lb # [ 0.883262] hid: raw HID events driver (C) Jiri Kosina1453lb # [ 0.886736] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001454lb # [ 0.887065] hub 1-0:1.0: USB hub found1455lb # [ 0.887095] hub 1-0:1.0: 6 ports detected1456lb # [ 0.889353] usbcore: registered new interface driver usbhid1457lb # [ 0.889364] usbhid: USB HID core driver1458lb # [ 0.891681] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1459worker2 # [ 0.848820] Freeing initrd memory: 26148K1460lb # [ 0.893175] drop_monitor: Initializing network drop monitor service1461lb # [ 0.893372] NET: Registered PF_INET6 protocol family1462lb # [ 0.896381] Segment Routing with IPv61463lb # [ 0.896399] In-situ OAM (IOAM) with IPv61464lb # [ 0.896434] NET: Registered PF_PACKET protocol family1465worker1 # [ 0.853830] Freeing initrd memory: 26148K1466lb # [ 0.898072] 9pnet: Installing 9P2000 support1467worker2 # [ 0.854840] tun: Universal TUN/TAP device driver, 1.61468lb # [ 0.900816] Key type dns_resolver registered1469client # [ 0.857328] Freeing initrd memory: 26160K1470worker1 # [ 0.859901] tun: Universal TUN/TAP device driver, 1.61471worker2 # [ 0.858750] thunder_xcv, ver 1.01472worker2 # [ 0.858797] thunder_bgx, ver 1.01473worker2 # [ 0.858820] nicpf, ver 1.01474worker2 # [ 0.859367] e1000: Intel(R) PRO/1000 Network Driver1475lb # [ 0.907149] registered taskstats version 11476lb # [ 0.907322] Loading compiled-in X.509 certificates1477worker2 # [ 0.859374] e1000: Copyright (c) 1999-2006 Intel Corporation.1478worker2 # [ 0.859399] e1000e: Intel(R) PRO/1000 Network Driver1479worker2 # [ 0.859407] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1480client # [ 0.863357] tun: Universal TUN/TAP device driver, 1.61481worker2 # [ 0.859435] igb: Intel(R) Gigabit Ethernet Network Driver1482worker2 # [ 0.859441] igb: Copyright (c) 2007-2014 Intel Corporation.1483worker2 # [ 0.859464] igbvf: Intel(R) Gigabit Virtual Function Network Driver1484worker2 # [ 0.859469] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1485worker2 # [ 0.859601] sky2: driver version 1.301486worker1 # [ 0.863761] thunder_xcv, ver 1.01487worker1 # [ 0.863800] thunder_bgx, ver 1.01488worker1 # [ 0.863821] nicpf, ver 1.01489worker1 # [ 0.864373] e1000: Intel(R) PRO/1000 Network Driver1490worker1 # [ 0.864380] e1000: Copyright (c) 1999-2006 Intel Corporation.1491worker2 # [ 0.868369] usbcore: registered new interface driver usb-storage1492worker1 # [ 0.864404] e1000e: Intel(R) PRO/1000 Network Driver1493worker2 # [ 0.868425] usbcore: registered new interface driver usbserial_generic1494lb # [ 0.915848] Demotion targets for Node 0: null1495worker1 # [ 0.864412] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1496lb # [ 0.915952] Key type .fscrypt registered1497worker2 # [ 0.868440] usbserial: USB Serial support registered for generic1498worker1 # [ 0.864440] igb: Intel(R) Gigabit Ethernet Network Driver1499lb # [ 0.915958] Key type fscrypt-provisioning registered1500worker2 # [ 0.869133] ehci-pci 0000:00:0a.0: EHCI Host Controller1501worker1 # [ 0.864446] igb: Copyright (c) 2007-2014 Intel Corporation.1502client # [ 0.867179] thunder_xcv, ver 1.01503lb # [ 0.916050] ima: No TPM chip found, activating TPM-bypass!1504client # [ 0.867220] thunder_bgx, ver 1.01505worker2 # [ 0.869164] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11506worker1 # [ 0.864468] igbvf: Intel(R) Gigabit Virtual Function Network Driver1507lb # [ 0.916070] ima: Allocated hash algorithm: sha11508client # [ 0.867247] nicpf, ver 1.01509worker2 # [ 0.869361] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001510lb # [ 0.916091] ima: No architecture policies found1511client # [ 0.867789] e1000: Intel(R) PRO/1000 Network Driver1512worker1 # [ 0.864474] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1513worker1 # [ 0.864608] sky2: driver version 1.301514client # [ 0.867796] e1000: Copyright (c) 1999-2006 Intel Corporation.1515worker1 # [ 0.866177] usbcore: registered new interface driver usb-storage1516client # [ 0.867820] e1000e: Intel(R) PRO/1000 Network Driver1517lb # [ 0.920123] input: gpio-keys as /devices/platform/gpio-keys/input/input01518worker2 # [ 0.874363] hv_vmbus: registering driver hyperv_keyboard1519worker1 # [ 0.866348] usbcore: registered new interface driver usbserial_generic1520client # [ 0.867828] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1521client # [ 0.867857] igb: Intel(R) Gigabit Ethernet Network Driver1522worker1 # [ 0.866364] usbserial: USB Serial support registered for generic1523worker2 # [ 0.875855] rtc-pl031 9010000.pl031: registered as rtc01524worker1 # [ 0.866976] hv_vmbus: registering driver hyperv_keyboard1525client # [ 0.867862] igb: Copyright (c) 2007-2014 Intel Corporation.1526worker1 # [ 0.868211] ehci-pci 0000:00:0a.0: EHCI Host Controller1527client # [ 0.867885] igbvf: Intel(R) Gigabit Virtual Function Network Driver1528worker2 # [ 0.875882] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:25 UTC (1789896745)1529client # [ 0.867891] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1530worker2 # [ 0.876180] i2c_dev: i2c /dev entries driver1531worker1 # [ 0.868236] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11532client # [ 0.868021] sky2: driver version 1.301533worker1 # [ 0.868489] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001534client # [ 0.869583] usbcore: registered new interface driver usb-storage1535client # [ 0.869681] usbcore: registered new interface driver usbserial_generic1536worker1 # [ 0.880648] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001537worker1 # [ 0.880967] hub 1-0:1.0: USB hub found1538client # [ 0.869696] usbserial: USB Serial support registered for generic1539worker1 # [ 0.880987] hub 1-0:1.0: 6 ports detected1540client # [ 0.870285] hv_vmbus: registering driver hyperv_keyboard1541client # [ 0.871458] ehci-pci 0000:00:0a.0: EHCI Host Controller1542worker1 # [ 0.883403] rtc-pl031 9010000.pl031: registered as rtc01543client # [ 0.871484] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11544worker1 # [ 0.883430] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:25 UTC (1789896745)1545client # [ 0.871643] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001546worker2 # [ 0.881099] sdhci: Secure Digital Host Controller Interface driver1547worker1 # [ 0.885530] i2c_dev: i2c /dev entries driver1548worker2 # [ 0.881109] sdhci: Copyright(c) Pierre Ossman1549client # [ 0.884047] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001550client # [ 0.884386] hub 1-0:1.0: USB hub found1551worker2 # [ 0.881379] Synopsys Designware Multimedia Card Interface Driver1552client # [ 0.884406] hub 1-0:1.0: 6 ports detected1553worker2 # [ 0.881788] sdhci-pltfm: SDHCI platform and OF driver helper1554worker2 # [ 0.883437] hid: raw HID events driver (C) Jiri Kosina1555client # [ 0.886748] rtc-pl031 9010000.pl031: registered as rtc01556worker2 # [ 0.883713] usbcore: registered new interface driver usbhid1557worker2 # [ 0.883719] usbhid: USB HID core driver1558client # [ 0.886776] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:25 UTC (1789896745)1559worker2 # [ 0.889053] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001560client # [ 0.888866] i2c_dev: i2c /dev entries driver1561worker2 # [ 0.889413] hub 1-0:1.0: USB hub found1562worker1 # [ 0.888799] sdhci: Secure Digital Host Controller Interface driver1563worker2 # [ 0.889445] hub 1-0:1.0: 6 ports detected1564worker1 # [ 0.888809] sdhci: Copyright(c) Pierre Ossman1565worker1 # [ 0.889082] Synopsys Designware Multimedia Card Interface Driver1566worker1 # [ 0.889459] sdhci-pltfm: SDHCI platform and OF driver helper1567worker2 # [ 0.891787] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1568worker1 # [ 0.891131] hid: raw HID events driver (C) Jiri Kosina1569lb # [ 0.937310] clk: Disabling unused clocks1570worker1 # [ 0.891378] usbcore: registered new interface driver usbhid1571worker1 # [ 0.891385] usbhid: USB HID core driver1572lb # [ 0.937336] PM: genpd: Disabling unused power domains1573worker2 # [ 0.894436] drop_monitor: Initializing network drop monitor service1574client # [ 0.892134] sdhci: Secure Digital Host Controller Interface driver1575worker2 # [ 0.894634] NET: Registered PF_INET6 protocol family1576client # [ 0.892148] sdhci: Copyright(c) Pierre Ossman1577lb # [ 0.941531] Freeing unused kernel memory: 4736K1578worker2 # [ 0.896561] Segment Routing with IPv61579lb # [ 0.941729] Run /init as init process1580client # [ 0.892413] Synopsys Designware Multimedia Card Interface Driver1581worker2 # [ 0.896591] In-situ OAM (IOAM) with IPv61582client # [ 0.892778] sdhci-pltfm: SDHCI platform and OF driver helper1583worker2 # [ 0.896632] NET: Registered PF_PACKET protocol family1584client # [ 0.894483] hid: raw HID events driver (C) Jiri Kosina1585worker1 # [ 0.896966] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1586client # [ 0.894720] usbcore: registered new interface driver usbhid1587worker1 # [ 0.898482] drop_monitor: Initializing network drop monitor service1588client # [ 0.894726] usbhid: USB HID core driver1589worker1 # [ 0.898605] NET: Registered PF_INET6 protocol family1590worker2 # [ 0.898239] 9pnet: Installing 9P2000 support1591worker1 # [ 0.901636] Segment Routing with IPv61592worker1 # [ 0.901659] In-situ OAM (IOAM) with IPv61593worker2 # [ 0.900445] Key type dns_resolver registered1594worker1 # [ 0.901690] NET: Registered PF_PACKET protocol family1595worker1 # [ 0.903319] 9pnet: Installing 9P2000 support1596client # [ 0.900338] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1597client # [ 0.901901] drop_monitor: Initializing network drop monitor service1598client # [ 0.902072] NET: Registered PF_INET6 protocol family1599client # [ 0.905160] Segment Routing with IPv61600client # [ 0.905190] In-situ OAM (IOAM) with IPv61601worker1 # [ 0.906093] Key type dns_resolver registered1602client # [ 0.905222] NET: Registered PF_PACKET protocol family1603worker2 # [ 0.907407] registered taskstats version 11604worker2 # [ 0.907569] Loading compiled-in X.509 certificates1605client # [ 0.907045] 9pnet: Installing 9P2000 support1606client # [ 0.909119] Key type dns_resolver registered1607lb # [ 0.957582] systemd[1]: Successfully made /usr/ read-only.1608worker1 # [ 0.912409] registered taskstats version 11609worker1 # [ 0.912578] Loading compiled-in X.509 certificates1610worker2 # [ 0.916026] Demotion targets for Node 0: null1611worker2 # [ 0.916133] Key type .fscrypt registered1612worker2 # [ 0.916140] Key type fscrypt-provisioning registered1613worker2 # [ 0.916232] ima: No TPM chip found, activating TPM-bypass!1614worker2 # [ 0.916250] ima: Allocated hash algorithm: sha11615client # [ 0.916247] registered taskstats version 11616worker2 # [ 0.916277] ima: No architecture policies found1617client # [ 0.916388] Loading compiled-in X.509 certificates1618worker1 # [ 0.920968] Demotion targets for Node 0: null1619worker2 # [ 0.920417] input: gpio-keys as /devices/platform/gpio-keys/input/input01620worker1 # [ 0.921066] Key type .fscrypt registered1621worker1 # [ 0.921072] Key type fscrypt-provisioning registered1622worker1 # [ 0.921170] ima: No TPM chip found, activating TPM-bypass!1623worker1 # [ 0.921189] ima: Allocated hash algorithm: sha11624worker1 # [ 0.921209] ima: No architecture policies found1625worker1 # [ 0.925193] input: gpio-keys as /devices/platform/gpio-keys/input/input01626client # [ 0.924826] Demotion targets for Node 0: null1627client # [ 0.924929] Key type .fscrypt registered1628client # [ 0.924936] Key type fscrypt-provisioning registered1629client # [ 0.925036] ima: No TPM chip found, activating TPM-bypass!1630client # [ 0.925055] ima: Allocated hash algorithm: sha11631client # [ 0.925090] ima: No architecture policies found1632client # [ 0.929162] input: gpio-keys as /devices/platform/gpio-keys/input/input01633worker2 # [ 0.938284] clk: Disabling unused clocks1634worker2 # [ 0.938307] PM: genpd: Disabling unused power domains1635worker1 # [ 0.943226] clk: Disabling unused clocks1636worker2 # [ 0.942502] Freeing unused kernel memory: 4736K1637worker1 # [ 0.943250] PM: genpd: Disabling unused power domains1638worker2 # [ 0.942714] Run /init as init process1639worker1 # [ 0.947465] Freeing unused kernel memory: 4736K1640worker1 # [ 0.948258] Run /init as init process1641client # [ 0.947887] clk: Disabling unused clocks1642client # [ 0.947910] PM: genpd: Disabling unused power domains1643client # [ 0.952170] Freeing unused kernel memory: 4736K1644client # [ 0.952365] Run /init as init process1645worker2 # [ 0.958722] systemd[1]: Successfully made /usr/ read-only.1646worker1 # [ 0.961766] systemd[1]: Successfully made /usr/ read-only.1647client # [ 0.969089] systemd[1]: Successfully made /usr/ read-only.1648lb # [ 1.131505] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker1 # [ 1.127611] usb 1-1: new high-speed USB device number 2 using ehci-pci1650client # [ 1.130889] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker2 # [ 1.136582] usb 1-1: new high-speed USB device number 2 using ehci-pci1652lb # [ 1.285869] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653lb # [ 1.292361] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1654lb # [ 1.304702] systemd[1]: Detected virtualization qemu.1655lb # [ 1.306719] systemd[1]: Detected architecture arm64.1656lb # [ 1.308688] systemd[1]: Running in initrd.1657lb # [ 1.311230] systemd[1]: Initializing machine ID from random generator.1658lb # [ 1.314150] systemd[1]: Hostname set to <lb>.1659worker1 # [ 1.279871] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11660client # [ 1.283160] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11661worker2 # [ 1.288710] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11662worker2 # [ 1.294724] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1663worker1 # [ 1.296448] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1664worker1 # [ 1.308575] systemd[1]: Detected virtualization qemu.1665worker2 # [ 1.306950] systemd[1]: Detected virtualization qemu.1666worker1 # [ 1.310553] systemd[1]: Detected architecture arm64.1667worker2 # [ 1.307044] systemd[1]: Detected architecture arm64.1668worker1 # [ 1.312538] systemd[1]: Running in initrd.1669worker2 # [ 1.307068] systemd[1]: Running in initrd.1670client # [ 1.303916] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1671worker2 # [ 1.308144] systemd[1]: Initializing machine ID from random generator.1672worker1 # [ 1.315108] systemd[1]: Initializing machine ID from random generator.1673worker2 # [ 1.308448] systemd[1]: Hostname set to <worker2>.1674client # [ 1.315996] systemd[1]: Detected virtualization qemu.1675worker1 # [ 1.318040] systemd[1]: Hostname set to <worker1>.1676client # [ 1.318003] systemd[1]: Detected architecture arm64.1677lb # [ 1.363752] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01678client # [ 1.319977] systemd[1]: Running in initrd.1679client # [ 1.322536] systemd[1]: Initializing machine ID from random generator.1680client # [ 1.325502] systemd[1]: Hostname set to <client>.1681worker1 # [ 1.367811] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682client # [ 1.371099] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker2 # [ 1.372760] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01684lb # [ 1.487502] usb 1-2: new high-speed USB device number 3 using ehci-pci1685worker1 # [ 1.487625] usb 1-2: new high-speed USB device number 3 using ehci-pci1686worker2 # [ 1.492607] usb 1-2: new high-speed USB device number 3 using ehci-pci1687client # [ 1.494896] usb 1-2: new high-speed USB device number 3 using ehci-pci1688lb # [ 1.627996] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689lb # [ 1.645063] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21690lb # [ 1.650145] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01691worker1 # [ 1.613426] systemd[1]: bpf-restrict-fs: LSM BPF program attached1692worker2 # [ 1.619056] systemd[1]: bpf-restrict-fs: LSM BPF program attached1693client # [ 1.635078] systemd[1]: bpf-restrict-fs: LSM BPF program attached1694worker1 # [ 1.644026] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21695worker2 # [ 1.646929] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21696worker1 # [ 1.649095] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01697worker2 # [ 1.652085] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01698client # [ 1.656266] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21699client # [ 1.661854] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01700lb # [ 1.736821] systemd[1]: Queued start job for default target Initrd Default Target.1701lb # [ 1.745812] systemd[1]: Created slice Slice /system/modprobe.1702lb # [ 1.746955] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1703lb # [ 1.748305] systemd[1]: Expecting device /dev/disk/by-label/nixos...1704lb # [ 1.749314] systemd[1]: Reached target Path Units.1705lb # [ 1.750087] systemd[1]: Reached target Slice Units.1706lb # [ 1.750959] systemd[1]: Reached target Swaps.1707lb # [ 1.751694] systemd[1]: Reached target Timer Units.1708lb # [ 1.752665] systemd[1]: Listening on D-Bus System Message Bus Socket.1709lb # [ 1.753835] systemd[1]: Listening on Journal Socket (/dev/log).1710lb # [ 1.754915] systemd[1]: Listening on Journal Sockets.1711lb # [ 1.755917] systemd[1]: Listening on udev Control Socket.1712lb # [ 1.756033] systemd[1]: Listening on udev Kernel Socket.1713lb # [ 1.756054] systemd[1]: Reached target Socket Units.1714lb # [ 1.760003] systemd[1]: Starting Create List of Static Device Nodes...1715lb # [ 1.767607] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1716lb # [ 1.768705] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1717lb # [ 1.774864] systemd[1]: Mounting Kernel Configuration File System...1718worker1 # [ 1.730397] systemd[1]: Queued start job for default target Initrd Default Target.1719worker2 # [ 1.735422] systemd[1]: Queued start job for default target Initrd Default Target.1720worker1 # [ 1.737786] systemd[1]: Created slice Slice /system/modprobe.1721worker1 # [ 1.738906] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1722worker1 # [ 1.740166] systemd[1]: Expecting device /dev/disk/by-label/nixos...1723worker1 # [ 1.741135] systemd[1]: Reached target Path Units.1724worker1 # [ 1.741880] systemd[1]: Reached target Slice Units.1725worker1 # [ 1.742643] systemd[1]: Reached target Swaps.1726worker1 # [ 1.743336] systemd[1]: Reached target Timer Units.1727worker1 # [ 1.744334] systemd[1]: Listening on D-Bus System Message Bus Socket.1728worker1 # [ 1.745478] systemd[1]: Listening on Journal Socket (/dev/log).1729worker1 # [ 1.746511] systemd[1]: Listening on Journal Sockets.1730worker1 # [ 1.747432] systemd[1]: Listening on udev Control Socket.1731worker2 # [ 1.747057] systemd[1]: Created slice Slice /system/modprobe.1732worker1 # [ 1.748446] systemd[1]: Listening on udev Kernel Socket.1733worker1 # [ 1.749365] systemd[1]: Reached target Socket Units.1734worker2 # [ 1.748306] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1735lb # [ 1.794161] systemd[1]: Starting Journal Service...1736worker2 # [ 1.749779] systemd[1]: Expecting device /dev/disk/by-label/nixos...1737worker1 # [ 1.751672] systemd[1]: Starting Create List of Static Device Nodes...1738worker2 # [ 1.750899] systemd[1]: Reached target Path Units.1739worker2 # [ 1.751747] systemd[1]: Reached target Slice Units.1740client # [ 1.750962] systemd[1]: Queued start job for default target Initrd Default Target.1741worker2 # [ 1.752643] systemd[1]: Reached target Swaps.1742worker2 # [ 1.753415] systemd[1]: Reached target Timer Units.1743worker2 # [ 1.754462] systemd[1]: Listening on D-Bus System Message Bus Socket.1744worker2 # [ 1.755717] systemd[1]: Listening on Journal Socket (/dev/log).1745lb # [ 1.804124] systemd[1]: Starting Load Kernel Modules...1746worker2 # [ 1.756947] systemd[1]: Listening on Journal Sockets.1747worker1 # [ 1.759765] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1748worker2 # [ 1.757091] systemd[1]: Listening on udev Control Socket.1749lb # [ 1.804230] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1750worker2 # [ 1.757209] systemd[1]: Listening on udev Kernel Socket.1751worker1 # [ 1.760795] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1752worker2 # [ 1.757233] systemd[1]: Reached target Socket Units.1753client # [ 1.761390] systemd[1]: Created slice Slice /system/modprobe.1754worker2 # [ 1.762357] systemd[1]: Starting Create List of Static Device Nodes...1755client # [ 1.762573] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1756client # [ 1.764045] systemd[1]: Expecting device /dev/disk/by-label/nixos...1757client # [ 1.765100] systemd[1]: Reached target Path Units.1758client # [ 1.765906] systemd[1]: Reached target Slice Units.1759client # [ 1.766724] systemd[1]: Reached target Swaps.1760client # [ 1.767529] systemd[1]: Reached target Timer Units.1761client # [ 1.768536] systemd[1]: Listening on D-Bus System Message Bus Socket.1762worker2 # [ 1.769214] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1763client # [ 1.769783] systemd[1]: Listening on Journal Socket (/dev/log).1764client # [ 1.770939] systemd[1]: Listening on Journal Sockets.1765worker2 # [ 1.770403] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1766client # [ 1.771944] systemd[1]: Listening on udev Control Socket.1767client # [ 1.772953] systemd[1]: Listening on udev Kernel Socket.1768lb # [ 1.817230] systemd[1]: Starting Coldplug All udev Devices...1769client # [ 1.773868] systemd[1]: Reached target Socket Units.1770client # [ 1.776372] systemd[1]: Starting Create List of Static Device Nodes...1771worker1 # [ 1.775951] systemd[1]: Mounting Kernel Configuration File System...1772worker2 # [ 1.780707] systemd[1]: Mounting Kernel Configuration File System...1773client # [ 1.786996] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1774client # [ 1.788115] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1775worker2 # [ 1.790043] systemd[1]: Starting Journal Service...1776lb # [ 1.835565] systemd[1]: Finished Create List of Static Device Nodes.1777lb # [ 1.836566] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1778client # [ 1.791564] systemd[1]: Mounting Kernel Configuration File System...1779worker1 # [ 1.795257] systemd[1]: Starting Journal Service...1780worker1 # [ 1.799969] systemd[1]: Starting Load Kernel Modules...1781worker1 # [ 1.800794] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1782client # [ 1.803310] systemd[1]: Starting Journal Service...1783lb # [ 1.853509] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1784worker2 # [ 1.813780] systemd[1]: Starting Load Kernel Modules...1785worker2 # [ 1.815250] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1786lb # [ 1.861846] systemd-journald[73]: Collecting audit messages is disabled.1787lb # [ 1.862880] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1788lb # [ 1.867823] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1789lb # [ 1.869003] systemd[1]: Mounted Kernel Configuration File System.1790worker2 # [ 1.828694] systemd[1]: Starting Coldplug All udev Devices...1791worker1 # [ 1.836655] systemd-journald[73]: Collecting audit messages is disabled.1792worker1 # [ 1.837667] systemd[1]: Starting Coldplug All udev Devices...1793lb # [ 1.879531] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1794lb # [ 1.884042] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01795lb # [ 1.884291] [drm] features: -virgl +edid -resource_blob -host_visible1796lb # [ 1.884301] [drm] features: -context_init1797lb # [ 1.885019] [drm] number of scanouts: 11798lb # [ 1.885037] [drm] number of cap sets: 01799client # [ 1.843012] systemd[1]: Starting Load Kernel Modules...1800client # [ 1.843136] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1801client # [ 1.846369] systemd[1]: Starting Coldplug All udev Devices...1802worker2 # [ 1.846449] systemd[1]: Finished Create List of Static Device Nodes.1803worker1 # [ 1.847771] systemd[1]: Finished Create List of Static Device Nodes.1804worker2 # [ 1.847238] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1805worker1 # [ 1.848613] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1806worker2 # [ 1.847501] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1807worker1 # [ 1.848901] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1808worker2 # [ 1.847719] systemd[1]: Mounted Kernel Configuration File System.1809client # [ 1.857277] systemd-journald[73]: Collecting audit messages is disabled.1810lb # [ 1.899879] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1811lb # [ 1.899899] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01812worker2 # [ 1.859004] systemd-journald[73]: Collecting audit messages is disabled.1813worker2 # [ 1.861059] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1814worker1 # [ 1.871315] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1815worker1 # [ 1.873181] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1816worker1 # [ 1.873682] systemd[1]: Mounted Kernel Configuration File System.1817client # [ 1.871226] systemd[1]: Finished Create List of Static Device Nodes.1818client # [ 1.872504] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1819lb # [ 1.920287] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1820client # [ 1.872810] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1821lb # [ 1.923847] systemd[1]: Starting Create Static Device Nodes in /dev...1822client # [ 1.879203] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1823worker2 # [ 1.878694] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1824client # [ 1.880383] systemd[1]: Mounted Kernel Configuration File System.1825worker1 # [ 1.883742] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1826worker1 # [ 1.888233] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01827worker1 # [ 1.888462] [drm] features: -virgl +edid -resource_blob -host_visible1828worker1 # [ 1.888471] [drm] features: -context_init1829worker1 # [ 1.889165] [drm] number of scanouts: 11830worker1 # [ 1.889182] [drm] number of cap sets: 01831worker2 # [ 1.896817] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1832lb # [ 1.940301] Console: switching to colour frame buffer device 160x501833client # [ 1.905485] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1834worker2 # [ 1.907981] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01835worker2 # [ 1.908213] [drm] features: -virgl +edid -resource_blob -host_visible1836worker2 # [ 1.908223] [drm] features: -context_init1837worker1 # [ 1.907853] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1838worker1 # [ 1.907874] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01839worker2 # [ 1.911209] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1840worker1 # [ 1.924109] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1841worker2 # [ 1.920959] systemd[1]: Starting Create Static Device Nodes in /dev...1842worker1 # [ 1.926588] systemd[1]: Starting Create Static Device Nodes in /dev...1843worker2 # [ 1.925824] [drm] number of scanouts: 11844worker2 # [ 1.925851] [drm] number of cap sets: 01845lb # [ 1.972036] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1846client # [ 1.930850] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1847lb # [ 1.975350] systemd[1]: Finished Create Static Device Nodes in /dev.1848lb # [ 1.975553] systemd[1]: Reached target Preparation for Local File Systems.1849lb # [ 1.975585] systemd[1]: Reached target Local File Systems.1850worker2 # [ 1.928855] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1851worker2 # [ 1.928870] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01852lb # [ 1.980278] systemd[1]: Starting Rule-based Manager for Device Events and Files...1853client # [ 1.939496] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1854client # [ 1.941984] systemd[1]: Starting Create Static Device Nodes in /dev...1855client # [ 1.948410] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01856client # [ 1.948644] [drm] features: -virgl +edid -resource_blob -host_visible1857lb # [ 1.996041] systemd[1]: Finished Load Kernel Modules.1858client # [ 1.948653] [drm] features: -context_init1859client # [ 1.949379] [drm] number of scanouts: 11860client # [ 1.949397] [drm] number of cap sets: 01861lb # [ 2.000790] systemd[1]: Starting Apply Kernel Variables...1862worker2 # [ 1.956408] systemd[1]: Finished Create Static Device Nodes in /dev.1863worker2 # [ 1.956764] systemd[1]: Reached target Preparation for Local File Systems.1864worker2 # [ 1.956796] systemd[1]: Reached target Local File Systems.1865worker1 # [ 1.968108] systemd[1]: Finished Create Static Device Nodes in /dev.1866worker2 # [ 1.964953] systemd[1]: Starting Rule-based Manager for Device Events and Files...1867worker1 # [ 1.968275] systemd[1]: Reached target Preparation for Local File Systems.1868worker1 # [ 1.968300] systemd[1]: Reached target Local File Systems.1869worker1 # [ 1.972167] systemd[1]: Starting Rule-based Manager for Device Events and Files...1870client # [ 1.967186] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1871client # [ 1.967210] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01872worker2 # [ 1.969721] Console: switching to colour frame buffer device 160x501873worker1 # [ 1.976690] Console: switching to colour frame buffer device 160x501874worker2 # [ 1.976192] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1875worker1 # [ 1.977342] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1876worker1 # [ 1.991803] systemd[1]: Finished Load Kernel Modules.1877client # [ 1.991137] Console: switching to colour frame buffer device 160x501878client # [ 1.999699] systemd[1]: Finished Create Static Device Nodes in /dev.1879client # [ 1.999941] systemd[1]: Reached target Preparation for Local File Systems.1880client # [ 1.999970] systemd[1]: Reached target Local File Systems.1881lb # [ 2.047860] systemd[1]: Started Journal Service.1882worker1 # [ 2.004776] systemd[1]: Starting Apply Kernel Variables...1883worker2 # [ 2.008750] systemd[1]: Finished Load Kernel Modules.1884client # [ 2.007282] systemd[1]: Starting Rule-based Manager for Device Events and Files...1885worker2 # [ 2.011768] systemd[1]: Starting Apply Kernel Variables...1886lb # [ 2.031883] systemd-modules-load[74]: Inserted module 'dm_mod'1887lb # [ 2.049011] systemd-modules-load[74]: Module 'virtio_balloon' is built in1888lb # [ 2.050209] systemd-modules-load[74]: Module 'virtio_console' is built in1889client # [ 2.025451] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1890lb # [ 2.060437] systemd-modules-load[74]: Inserted module 'virtio_gpu'1891lb # [ 2.064329] systemd-modules-load[74]: Module 'virtio_rng' is built in1892worker1 # [ 2.020298] systemd-modules-load[75]: Inserted module 'dm_mod'1893lb # [ 2.065543] systemd[1]: Finished Apply Kernel Variables.1894worker1 # [ 2.021415] systemd-modules-load[75]: Module 'virtio_balloon' is built in1895lb # [ 2.066438] systemd[1]: Starting Create System Files and Directories...1896worker1 # [ 2.022501] systemd-modules-load[75]: Module 'virtio_console' is built in1897worker1 # [ 2.023572] systemd-modules-load[75]: Inserted module 'virtio_gpu'1898worker1 # [ 2.040139] systemd[1]: Started Journal Service.1899client # [ 2.039431] systemd[1]: Finished Load Kernel Modules.1900client # [ 2.042609] systemd[1]: Starting Apply Kernel Variables...1901worker1 # [ 2.038335] systemd-modules-load[75]: Module 'virtio_rng' is built in1902lb # [ 2.084461] systemd-udevd[79]: Using default interface naming scheme 'v261'.1903lb # [ 2.086884] systemd[1]: Finished Create System Files and Directories.1904worker2 # [ 2.057127] systemd[1]: Finished Apply Kernel Variables.1905worker2 # [ 2.043296] systemd-modules-load[74]: Inserted module 'dm_mod'1906worker1 # [ 2.048210] systemd[1]: Starting Create System Files and Directories...1907worker2 # [ 2.060994] systemd[1]: Started Journal Service.1908worker2 # [ 2.051353] systemd-modules-load[74]: Module 'virtio_balloon' is built in1909worker1 # [ 2.058097] systemd[1]: Finished Apply Kernel Variables.1910worker2 # [ 2.056430] systemd-modules-load[74]: Module 'virtio_console' is built in1911worker2 # [ 2.057560] systemd-modules-load[74]: Inserted module 'virtio_gpu'1912worker1 # [ 2.060368] systemd-udevd[80]: Using default interface naming scheme 'v261'.1913worker2 # [ 2.058518] systemd-modules-load[74]: Module 'virtio_rng' is built in1914worker2 # [ 2.059506] systemd[1]: Starting Create System Files and Directories...1915client # [ 2.064382] systemd-modules-load[74]: Inserted module 'dm_mod'1916lb # [ 2.110839] systemd[1]: Started Rule-based Manager for Device Events and Files.1917client # [ 2.068257] systemd-modules-load[74]: Module 'virtio_balloon' is built in1918client # [ 2.069417] systemd-modules-load[74]: Module 'virtio_console' is built in1919client # [ 2.070497] systemd-modules-load[74]: Inserted module 'virtio_gpu'1920client # [ 2.071453] systemd-modules-load[74]: Module 'virtio_rng' is built in1921client # [ 2.087346] systemd[1]: Started Journal Service.1922worker2 # [ 2.075520] systemd-udevd[79]: Using default interface naming scheme 'v261'.1923worker1 # [ 2.085285] systemd[1]: Finished Create System Files and Directories.1924worker2 # [ 2.090167] systemd[1]: Finished Create System Files and Directories.1925client # [ 2.099913] systemd-udevd[79]: Using default interface naming scheme 'v261'.1926worker1 # [ 2.102216] systemd[1]: Started Rule-based Manager for Device Events and Files.1927client # [ 2.102298] systemd[1]: Starting Create System Files and Directories...1928client # [ 2.113679] systemd[1]: Finished Apply Kernel Variables.1929worker2 # [ 2.115054] systemd[1]: Started Rule-based Manager for Device Events and Files.1930lb # [ 2.168116] systemd[1]: Starting Virtual Console Setup...1931client # [ 2.137579] systemd[1]: Finished Create System Files and Directories.1932client # [ 2.152761] systemd[1]: Started Rule-based Manager for Device Events and Files.1933worker1 # [ 2.162240] systemd[1]: Starting Virtual Console Setup...1934worker2 # [ 2.163129] systemd[1]: Starting Virtual Console Setup...1935lb # [ 2.216478] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1936lb # [ 2.219859] systemd[1]: Finished Virtual Console Setup.1937client # [ 2.208174] systemd[1]: Starting Virtual Console Setup...1938worker1 # [ 2.208463] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1939worker1 # [ 2.211799] systemd[1]: Finished Virtual Console Setup.1940worker2 # [ 2.212457] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1941worker2 # [ 2.215778] systemd[1]: Finished Virtual Console Setup.1942client # [ 2.256460] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1943client # [ 2.259797] systemd[1]: Finished Virtual Console Setup.1944lb # [ 2.816074] systemd[1]: Finished Coldplug All udev Devices.1945lb # [ 2.817124] systemd[1]: Reached target System Initialization.1946lb # [ 2.818129] systemd[1]: Reached target Basic System.1947worker1 # [ 2.811458] systemd[1]: Finished Coldplug All udev Devices.1948worker1 # [ 2.812460] systemd[1]: Reached target System Initialization.1949worker1 # [ 2.813270] systemd[1]: Reached target Basic System.1950worker2 # [ 2.834037] systemd[1]: Finished Coldplug All udev Devices.1951worker2 # [ 2.834985] systemd[1]: Reached target System Initialization.1952worker2 # [ 2.835985] systemd[1]: Reached target Basic System.1953client # [ 2.889401] systemd[1]: Finished Coldplug All udev Devices.1954client # [ 2.890334] systemd[1]: Reached target System Initialization.1955client # [ 2.891140] systemd[1]: Reached target Basic System.1956lb # [ 2.980379] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line.1957worker1 # [ 2.943902] (udev-worker)[102]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1958lb # [ 2.996561] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1959lb # [ 3.001747] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1960worker1 # [ 2.985030] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1961worker1 # [ 2.989179] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1962worker2 # [ 3.000393] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1963lb # [ 3.060786] systemd[1]: Found device /dev/disk/by-label/nixos.1964worker2 # [ 3.018071] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1965lb # [ 3.067237] systemd[1]: Reached target Initrd Root Device.1966lb # [ 3.071219] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1967worker2 # [ 3.028109] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1968client # [ 3.043369] (udev-worker)[97]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1969client # [ 3.048247] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1970client # [ 3.052153] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1971worker1 # [ 3.071981] systemd[1]: Found device /dev/disk/by-label/nixos.1972worker1 # [ 3.076652] systemd[1]: Reached target Initrd Root Device.1973lb # [ 3.124142] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1974worker1 # [ 3.083997] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1975lb # [ 3.131589] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1976lb # [ 3.136135] systemd[1]: Mounting /sysroot...1977worker2 # [ 3.109907] systemd[1]: Found device /dev/disk/by-label/nixos.1978worker2 # [ 3.111543] systemd[1]: Reached target Initrd Root Device.1979worker2 # [ 3.115734] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1980worker1 # [ 3.119441] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1981lb # [ 3.183470] EXT4-fs (vda): mounted filesystem 60128c9d-a0b3-4659-9c05-9ec5bacc3a31 r/w with ordered data mode. Quota mode: none.1982worker1 # [ 3.127100] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1983lb # [ 3.173138] systemd[1]: Mounted /sysroot.1984worker1 # [ 3.130456] systemd[1]: Mounting /sysroot...1985lb # [ 3.178285] systemd[1]: Reached target Initrd Root File System.1986lb # [ 3.180208] systemd[1]: Starting Mountpoints Configured in the Real Root...1987client # [ 3.142097] systemd[1]: Found device /dev/disk/by-label/nixos.1988client # [ 3.143849] systemd[1]: Reached target Initrd Root Device.1989client # [ 3.154164] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1990worker1 # [ 3.170876] EXT4-fs (vda): mounted filesystem 89fb4fd6-9498-48e9-b243-95b6bca472df r/w with ordered data mode. Quota mode: none.1991lb # [ 3.202862] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload.1992worker1 # [ 3.160718] systemd[1]: Mounted /sysroot.1993worker1 # [ 3.162506] systemd[1]: Reached target Initrd Root File System.1994worker2 # [ 3.160683] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1995worker1 # [ 3.164093] systemd[1]: Starting Mountpoints Configured in the Real Root...1996lb # [ 3.211038] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)...1997lb # [ 3.213102] systemd[1]: Reloading...1998worker2 # [ 3.167913] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1999worker2 # [ 3.169506] systemd[1]: Mounting /sysroot...2000worker1 # [ 3.186534] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.
loading 1,395 hidden lines…
3396lb # [ 15.755060] systemd[1]: Starting Virtual Console Setup...3397lb # [ 15.810715] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3398lb # [ 15.819554] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3399lb # [ 15.824391] systemd[1]: Stopped Virtual Console Setup.3400lb # [ 15.850156] systemd[1]: Starting Virtual Console Setup...3401lb # [ 15.934824] systemd-logind[523]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3402lb # [ 16.388193] systemd-vconsole-setup[785]: Configuration of first virtual console was skipped, ignoring remaining ones.3403lb # [ 16.392839] systemd[1]: Finished Virtual Console Setup.3404lb # [ 16.450143] postgresql-pre-start[706]: selecting default time zone ... UTC3405lb # [ 16.455589] postgresql-pre-start[706]: creating configuration files ... ok3406lb # [ 16.463205] dhcpcd[666]: eth0: soliciting an IPv6 router3407lb # [ 16.465125] dhcpcd[666]: eth0: Router Advertisement from fe80::23408lb # [ 16.466206] dhcpcd[666]: eth0: adding address fec0::5054:ff:fe12:3456/643409lb # [ 16.467597] dhcpcd[666]: eth0: adding route to fec0::/643410lb # [ 16.468880] dhcpcd[666]: eth0: adding default route via fe80::23411lb # [ 16.749648] postgresql-pre-start[706]: running bootstrap script ... ok3412lb # [ 17.446120] postgresql-pre-start[706]: performing post-bootstrap initialization ... ok3413lb # [ 17.600771] postgresql-pre-start[706]: syncing data to disk ... ok3414lb # [ 17.602927] postgresql-pre-start[706]: initdb: warning: enabling "trust" authentication for local connections3415lb # [ 17.604606] postgresql-pre-start[706]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3416lb # [ 17.606766] postgresql-pre-start[706]: Success. You can now start the database server using:3417lb # [ 17.607953] postgresql-pre-start[706]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3418lb # [ 17.739092] postgres[813]: [813] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3419lb # [ 17.743936] postgres[813]: [813] LOG: listening on IPv6 address "::1", port 54323420lb # [ 17.745687] postgres[813]: [813] LOG: listening on IPv4 address "127.0.0.1", port 54323421lb # [ 17.747814] postgres[813]: [813] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3422lb # [ 17.766940] postgres[822]: [822] LOG: database system was shut down at 2026-09-20 09:32:42 GMT3423lb # [ 17.773453] postgres[813]: [813] LOG: database system is ready to accept connections3424lb # [ 17.781061] systemd[1]: Started PostgreSQL Server.3425lb # [ 17.792297] systemd[1]: Starting PostgreSQL Setup Scripts...3426lb # [ 18.040620] postgresql-setup-start[833]: CREATE DATABASE3427lb # [ 18.096799] postgresql-setup-start[838]: CREATE ROLE3428lb # [ 18.122095] postgresql-setup-start[840]: ALTER DATABASE3429lb # [ 18.128984] systemd[1]: Finished PostgreSQL Setup Scripts.3430lb # [ 18.130891] systemd[1]: Reached target PostgreSQL.3431worker1 # [ 18.357823] dhcpcd[644]: eth0: leased 10.0.2.15 for 86400 seconds3432worker1 # [ 18.362365] dhcpcd[644]: eth0: adding route to 10.0.2.0/243433worker1 # [ 18.365847] dhcpcd[644]: eth0: adding default route via 10.0.2.23434worker1 # [ 18.524140] systemd[1]: Started DHCP Client.3435worker1 # [ 18.526276] systemd[1]: Reached target Multi-User System.3436worker1 # [ 18.527103] systemd[1]: Startup finished in 936ms (kernel) + 5.448s (initrd) + 12.141s (userspace) = 18.526s.3437lb # [ 18.577132] dhcpcd[666]: eth0: leased 10.0.2.15 for 86400 seconds3438lb # [ 18.579926] dhcpcd[666]: eth0: adding route to 10.0.2.0/243439lb # [ 18.583924] dhcpcd[666]: eth0: adding default route via 10.0.2.23440lb # [ 18.746381] systemd[1]: Started DHCP Client.3441lb # [ 18.749610] systemd[1]: Reached target Network is Online.3442lb # [ 18.755176] systemd[1]: Started Envoy reverse proxy.3443lb # [ 18.760381] systemd[1]: Started mock-oidc.service.3444lb # [ 18.859247] mock-oidc-server[913]: Mock OIDC Server running3445lb # [ 18.860431] mock-oidc-server[913]: OIDC Address: 192.168.1.2:80803446lb # [ 18.862767] mock-oidc-server[913]: Issue Address: 0.0.0.0:80813447lb # [ 18.864129] mock-oidc-server[913]: Issuer: http://192.168.1.2:8080/oidc3448lb # [ 18.865290] mock-oidc-server[913]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3449lb # [ 18.866954] mock-oidc-server[913]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3450lb # [ 18.868777] mock-oidc-server[913]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3451lb # [ 19.403045] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3452lb # [ 19.405099] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:469] statically linked extensions:3453lb # [ 19.407002] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3454lb # [ 19.409516] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3455lb # [ 19.412224] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3456lb # [ 19.417841] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3457lb # [ 19.448493] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3458lb # [ 19.451359] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3459lb # [ 19.457502] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3460lb # [ 19.466103] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3461client # [ 19.425045] dhcpcd[540]: eth0: leased 10.0.2.15 for 86400 seconds3462lb # [ 19.469156] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3463client # [ 19.428407] dhcpcd[540]: eth0: adding route to 10.0.2.0/243464client # [ 19.430716] dhcpcd[540]: eth0: adding default route via 10.0.2.23465lb # [ 19.474871] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3466lb # [ 19.485415] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3467lb # [ 19.487840] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23468worker2 # [ 19.444802] dhcpcd[640]: eth0: leased 10.0.2.15 for 86400 seconds3469lb # [ 19.495830] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3470worker2 # [ 19.452938] dhcpcd[640]: eth0: adding route to 10.0.2.0/243471lb # [ 19.499974] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3472worker2 # [ 19.455322] dhcpcd[640]: eth0: adding default route via 10.0.2.23473lb # [ 19.510052] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3474lb # [ 19.512298] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3475lb # [ 19.520916] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3476lb # [ 19.523682] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3477lb # [ 19.528947] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3478lb # [ 19.532433] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3479lb # [ 19.537565] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3480lb # [ 19.552316] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3481lb # [ 19.555225] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3482lb # [ 19.562414] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3483lb # [ 19.566625] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3484lb # [ 19.571042] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3485lb # [ 19.574177] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3486lb # [ 19.576162] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3487lb # [ 19.579825] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23488lb # [ 19.582309] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3489lb # [ 19.586079] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3490lb # [ 19.590100] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3491lb # [ 19.596195] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3492lb # [ 19.599948] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3493lb # [ 19.602849] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3494lb # [ 19.605257] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3495lb # [ 19.613064] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3496lb # [ 19.616413] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3497lb # [ 19.618752] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3498lb # [ 19.621124] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3499lb # [ 19.624376] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3500lb # [ 19.656685] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3501lb # [ 19.665991] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3502lb # [ 19.670814] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3503client # [ 19.631205] systemd[1]: Started DHCP Client.3504client # [ 19.633092] systemd[1]: Reached target Multi-User System.3505lb # [ 19.674154] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3506client # [ 19.634517] systemd[1]: Startup finished in 942ms (kernel) + 5.464s (initrd) + 13.227s (userspace) = 19.634s.3507lb # [ 19.681275] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3508lb # [ 19.684336] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3509worker2 # [ 19.642020] systemd[1]: Started DHCP Client.3510lb # [ 19.688127] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3511worker2 # [ 19.643650] systemd[1]: Reached target Multi-User System.3512worker2 # [ 19.644989] systemd[1]: Startup finished in 930ms (kernel) + 5.459s (initrd) + 13.254s (userspace) = 19.644s.3513lb # [ 19.690663] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3514lb # [ 19.694452] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3515lb # [ 19.697795] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3516lb # [ 19.699955] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3517lb # [ 19.701968] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3518lb # [ 19.704420] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3519lb # [ 19.708407] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3520lb # [ 19.711148] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3521lb # [ 19.718145] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3522lb # [ 19.720109] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3523lb # [ 19.724179] envoy[912]: [2026-09-20 09:32:44.041][912][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3524lb # [ 19.735433] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3525lb # [ 19.738451] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3526lb # [ 19.741328] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3527lb # [ 19.743558] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3528lb # [ 19.747238] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3529lb # [ 19.751621] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3530lb # [ 19.757480] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3531lb # [ 19.762918] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3532lb # [ 19.770838] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3533lb # [ 19.773332] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3534lb # [ 19.775031] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13535lb # [ 19.778436] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3536lb # [ 19.781273] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3537lb # [ 19.783415] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83538lb # [ 19.785987] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3539lb # [ 19.789083] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3540lb # [ 19.792209] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3541lb # [ 19.796069] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3542worker1 # [ 19.760453] systemd[1]: Starting Nix worker-protocol over gRPC...3543lb # [ 19.806348] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3544lb # [ 19.810339] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3545worker2 # [ 19.763301] systemd[1]: Starting Nix worker-protocol over gRPC...3546lb # [ 19.812474] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3547lb # [ 19.817563] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3548lb # [ 19.831843] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3549lb # [ 19.835051] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23550lb # [ 19.837053] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3551lb # [ 19.839362] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3552lb # [ 19.842064] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3553lb # [ 19.844089] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3554lb # [ 19.846117] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3555lb # [ 19.848895] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3556lb # [ 19.856451] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3557lb # [ 19.858871] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3558lb # [ 19.861068] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3559lb # [ 19.863015] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3560lb # [ 19.865297] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3561lb # [ 19.867185] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3562lb # [ 19.871077] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3563lb # [ 19.875085] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3564lb # [ 19.877133] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3565lb # [ 19.880443] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3566lb # [ 19.883912] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3567lb # [ 19.886632] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3568lb # [ 19.889040] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3569lb # [ 19.893147] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3570lb # [ 19.895329] envoy[912]: [2026-09-20 09:32:44.042][912][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3571lb # [ 19.900008] envoy[912]: [2026-09-20 09:32:44.076][912][info][main] [source/server/server.cc:531] HTTP header map info:3572lb # [ 19.901331] envoy[912]: [2026-09-20 09:32:44.080][912][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3573lb # [ 19.916750] envoy[912]: [2026-09-20 09:32:44.080][912][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3574lb # [ 19.918189] envoy[912]: [2026-09-20 09:32:44.080][912][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3575lb # [ 19.926871] envoy[912]: [2026-09-20 09:32:44.080][912][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3576lb # [ 19.928643] envoy[912]: [2026-09-20 09:32:44.188][912][info][main] [source/server/server.cc:968] runtime: {}3577lb # [ 19.929864] envoy[912]: [2026-09-20 09:32:44.191][912][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3578lb # [ 19.931479] envoy[912]: [2026-09-20 09:32:44.191][912][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013579lb # [ 19.933128] envoy[912]: [2026-09-20 09:32:44.191][912][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013580lb # [ 19.934612] envoy[912]: [2026-09-20 09:32:44.199][912][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3581lb # [ 19.936414] envoy[912]: [2026-09-20 09:32:44.199][912][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3582lb # [ 19.937939] envoy[912]: [2026-09-20 09:32:44.199][912][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3583lb # [ 19.939429] envoy[912]: [2026-09-20 09:32:44.436][912][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3584lb # [ 19.940963] envoy[912]: [2026-09-20 09:32:44.509][912][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3585lb # [ 19.942487] envoy[912]: [2026-09-20 09:32:44.510][912][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3586lb # [ 19.945582] envoy[912]: [2026-09-20 09:32:44.510][912][info][main] [source/server/server.cc:1077] starting main dispatch loop3587worker1 # [ 20.010982] nix-grpc-daemon[774]: ts=2026-09-20T09:32:44Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3588worker2 # [ 20.017126] nix-grpc-daemon[774]: ts=2026-09-20T09:32:44Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3589worker1 # [ 20.023343] nix-grpc-daemon[774]: ts=2026-09-20T09:32:44Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13590worker2 # [ 20.028320] nix-grpc-daemon[774]: ts=2026-09-20T09:32:44Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13591worker1 # [ 20.067333] nix-grpc-daemon[774]: ts=2026-09-20T09:32:44Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3592worker1 # [ 20.072869] systemd[1]: Started Nix worker-protocol over gRPC.3593worker2 # [ 20.070146] nix-grpc-daemon[774]: ts=2026-09-20T09:32:44Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3594worker2 # [ 20.074385] systemd[1]: Started Nix worker-protocol over gRPC.3595lb # [ 20.156396] envoy[912]: [2026-09-20 09:32:44.795][912][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3596lb # [ 20.164898] envoy[912]: [2026-09-20 09:32:44.795][912][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3597lb # [ 20.173655] envoy[912]: [2026-09-20 09:32:44.795][912][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3598lb # [ 20.184297] envoy[912]: [2026-09-20 09:32:44.795][912][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3599worker1 # [ 20.151491] nix-grpc-daemon[774]: ts=2026-09-20T09:32:44Z level=info event=scheduler_connected addr=lb:500513600worker2 # [ 20.151774] nix-grpc-daemon[774]: ts=2026-09-20T09:32:44Z level=info event=scheduler_connected addr=lb:500513601worker2 # [ 20.154702] nix-grpc-daemon[774]: ts=2026-09-20T09:32:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3602worker1 # [ 20.156811] nix-grpc-daemon[774]: ts=2026-09-20T09:32:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3603worker1 # [ 20.358090] nix-grpc-daemon[774]: ts=2026-09-20T09:32:44Z level=info event=scheduler_connected addr=lb:500513604worker2 # [ 20.355909] nix-grpc-daemon[774]: ts=2026-09-20T09:32:44Z level=info event=scheduler_connected addr=lb:500513605worker2 # [ 20.361173] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3606worker1 # [ 20.363679] nix-grpc-daemon[774]: ts=2026-09-20T09:32:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3607worker2 # [ 20.561812] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_connected addr=lb:500513608worker1 # [ 20.564602] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_connected addr=lb:500513609worker2 # [ 20.567191] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3610worker1 # [ 20.569769] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3611worker2 # [ 20.768182] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_connected addr=lb:500513612worker1 # [ 20.770630] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_connected addr=lb:500513613worker2 # [ 20.773285] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3614worker1 # [ 20.775802] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3615worker2 # [ 20.974176] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_connected addr=lb:500513616worker1 # [ 20.976672] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_connected addr=lb:500513617worker2 # [ 20.979435] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3618worker1 # [ 20.981765] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3619worker2 # [ 21.182258] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_connected addr=lb:500513620worker1 # [ 21.184481] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_connected addr=lb:500513621worker1 # [ 21.188594] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3622worker2 # [ 21.186601] nix-grpc-daemon[774]: ts=2026-09-20T09:32:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3623worker2 # [ 21.383059] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_connected addr=lb:500513624worker1 # [ 21.385035] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_connected addr=lb:500513625worker1 # [ 21.390271] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3626worker2 # [ 21.388534] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3627worker1 # [ 21.590945] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_connected addr=lb:500513628worker2 # [ 21.589456] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_connected addr=lb:500513629worker1 # [ 21.596289] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3630worker2 # [ 21.594783] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3631worker1 # [ 21.797145] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_connected addr=lb:500513632worker2 # [ 21.795713] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_connected addr=lb:500513633worker1 # [ 21.802427] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3634worker2 # [ 21.801202] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3635worker1 # [ 22.003341] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_connected addr=lb:500513636worker2 # [ 22.002204] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_connected addr=lb:500513637worker1 # [ 22.008761] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3638worker2 # [ 22.007514] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3639worker1 # [ 22.211341] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_connected addr=lb:500513640worker2 # [ 22.210107] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_connected addr=lb:500513641worker1 # [ 22.215399] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3642worker2 # [ 22.214040] nix-grpc-daemon[774]: ts=2026-09-20T09:32:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3643worker1 # [ 22.412372] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_connected addr=lb:500513644worker2 # [ 22.410356] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_connected addr=lb:500513645worker1 # [ 22.417487] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3646worker2 # [ 22.415743] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3647worker1 # [ 22.618349] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_connected addr=lb:500513648worker2 # [ 22.616655] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_connected addr=lb:500513649worker1 # [ 22.623612] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3650worker2 # [ 22.621864] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3651worker1 # [ 22.824519] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_connected addr=lb:500513652worker2 # [ 22.823300] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_connected addr=lb:500513653worker2 # [ 22.827898] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3654worker1 # [ 22.829743] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3655worker2 # [ 23.025312] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_connected addr=lb:500513656worker1 # [ 23.030289] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_connected addr=lb:500513657worker2 # [ 23.030922] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3658worker1 # [ 23.035689] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3659worker2 # [ 23.233524] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_connected addr=lb:500513660worker1 # [ 23.238890] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_connected addr=lb:500513661worker2 # [ 23.237870] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3662worker1 # [ 23.243720] nix-grpc-daemon[774]: ts=2026-09-20T09:32:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3663worker2 # [ 23.434235] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_connected addr=lb:500513664worker1 # [ 23.439156] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_connected addr=lb:500513665worker2 # [ 23.439491] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3666worker1 # [ 23.444477] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3667worker2 # [ 23.640374] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_connected addr=lb:500513668worker1 # [ 23.645272] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_connected addr=lb:500513669worker2 # [ 23.645538] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3670worker1 # [ 23.650388] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3671worker2 # [ 23.846384] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_connected addr=lb:500513672worker1 # [ 23.851446] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_connected addr=lb:500513673worker2 # [ 23.851750] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3674worker1 # [ 23.857103] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3675worker2 # [ 24.052641] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_connected addr=lb:500513676worker1 # [ 24.057888] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_connected addr=lb:500513677worker2 # [ 24.058879] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3678worker1 # [ 24.063662] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3679worker2 # [ 24.261830] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_connected addr=lb:500513680worker1 # [ 24.266438] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_connected addr=lb:500513681worker2 # [ 24.266050] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3682worker1 # [ 24.270708] nix-grpc-daemon[774]: ts=2026-09-20T09:32:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3683worker2 # [ 24.462615] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_connected addr=lb:500513684worker1 # [ 24.466980] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_connected addr=lb:500513685worker2 # [ 24.467901] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3686worker1 # [ 24.472342] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3687worker2 # [ 24.668800] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_connected addr=lb:500513688worker1 # [ 24.673498] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_connected addr=lb:500513689worker2 # [ 24.674086] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3690worker1 # [ 24.678995] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3691worker2 # [ 24.874937] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_connected addr=lb:500513692worker1 # [ 24.879840] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_connected addr=lb:500513693worker2 # [ 24.880436] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3694worker1 # [ 24.885201] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3695worker2 # [ 25.081471] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_connected addr=lb:500513696worker1 # [ 25.086337] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_connected addr=lb:500513697worker2 # [ 25.087178] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3698worker1 # [ 25.091659] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3699worker2 # [ 25.290301] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_connected addr=lb:500513700worker1 # [ 25.294460] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_connected addr=lb:500513701worker2 # [ 25.294887] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3702worker1 # [ 25.298682] nix-grpc-daemon[774]: ts=2026-09-20T09:32:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3703worker2 # [ 25.490958] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_connected addr=lb:500513704worker1 # [ 25.494839] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_connected addr=lb:500513705worker2 # [ 25.496420] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3706worker1 # [ 25.500382] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3707worker2 # [ 25.697336] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_connected addr=lb:500513708worker1 # [ 25.701364] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_connected addr=lb:500513709worker2 # [ 25.702861] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3710worker1 # [ 25.706567] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3711worker2 # [ 25.903670] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_connected addr=lb:500513712worker1 # [ 25.907636] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_connected addr=lb:500513713worker2 # [ 25.909632] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3714worker1 # [ 25.913542] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3715worker2 # [ 26.110907] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_connected addr=lb:500513716worker1 # [ 26.115806] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_connected addr=lb:500513717worker1 # [ 26.120508] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3718worker2 # [ 26.121888] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3719worker1 # [ 26.318989] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_connected addr=lb:500513720worker2 # [ 26.319461] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_connected addr=lb:500513721worker1 # [ 26.323312] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3722worker2 # [ 26.323749] nix-grpc-daemon[774]: ts=2026-09-20T09:32:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3723worker1 # [ 26.519458] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_connected addr=lb:500513724worker2 # [ 26.520150] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_connected addr=lb:500513725worker1 # [ 26.525048] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3726worker2 # [ 26.524998] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3727worker2 # [ 26.721984] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_connected addr=lb:500513728worker1 # [ 26.725865] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_connected addr=lb:500513729worker2 # [ 26.727329] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3730worker1 # [ 26.731136] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3731worker2 # [ 26.928290] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_connected addr=lb:500513732worker1 # [ 26.932219] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_connected addr=lb:500513733worker2 # [ 26.933533] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3734worker1 # [ 26.937380] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3735worker2 # [ 27.134417] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_connected addr=lb:500513736worker1 # [ 27.138077] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_connected addr=lb:500513737worker2 # [ 27.139739] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3738worker1 # [ 27.143302] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3739worker2 # [ 27.342414] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_connected addr=lb:500513740worker1 # [ 27.345935] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_connected addr=lb:500513741worker2 # [ 27.346654] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3742worker1 # [ 27.350118] nix-grpc-daemon[774]: ts=2026-09-20T09:32:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3743worker2 # [ 27.543354] nix-grpc-daemon[774]: ts=2026-09-20T09:32:52Z level=info event=scheduler_connected addr=lb:500513744worker1 # [ 27.546287] nix-grpc-daemon[774]: ts=2026-09-20T09:32:52Z level=info event=scheduler_connected addr=lb:500513745worker2 # [ 27.548779] nix-grpc-daemon[774]: ts=2026-09-20T09:32:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3746worker1 # [ 27.551586] nix-grpc-daemon[774]: ts=2026-09-20T09:32:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3747worker2 # [ 27.749844] nix-grpc-daemon[774]: ts=2026-09-20T09:32:52Z level=info event=scheduler_connected addr=lb:500513748worker1 # [ 27.752472] nix-grpc-daemon[774]: ts=2026-09-20T09:32:52Z level=info event=scheduler_connected addr=lb:500513749worker2 # [ 27.755271] nix-grpc-daemon[774]: ts=2026-09-20T09:32:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3750worker1 # [ 27.757723] nix-grpc-daemon[774]: ts=2026-09-20T09:32:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3751worker2 # [ 27.956257] nix-grpc-daemon[774]: ts=2026-09-20T09:32:52Z level=info event=scheduler_connected addr=lb:500513752worker1 # [ 27.958572] nix-grpc-daemon[774]: ts=2026-09-20T09:32:52Z level=info event=scheduler_connected addr=lb:500513753worker2 # [ 27.961471] nix-grpc-daemon[774]: ts=2026-09-20T09:32:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3754worker1 # [ 27.963773] nix-grpc-daemon[774]: ts=2026-09-20T09:32:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3755worker2 # [ 28.162227] nix-grpc-daemon[774]: ts=2026-09-20T09:32:52Z level=info event=scheduler_connected addr=lb:500513756worker1 # [ 28.164651] nix-grpc-daemon[774]: ts=2026-09-20T09:32:52Z level=info event=scheduler_connected addr=lb:500513757worker2 # [ 28.167567] nix-grpc-daemon[774]: ts=2026-09-20T09:32:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3758worker1 # [ 28.170131] nix-grpc-daemon[774]: ts=2026-09-20T09:32:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3759worker2 # [ 28.369831] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_connected addr=lb:500513760worker1 # [ 28.372899] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_connected addr=lb:500513761worker1 # [ 28.377109] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3762worker2 # [ 28.375119] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3763worker1 # [ 28.573735] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_connected addr=lb:500513764worker2 # [ 28.576160] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_connected addr=lb:500513765worker1 # [ 28.579159] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3766worker2 # [ 28.581331] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3767worker1 # [ 28.780107] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_connected addr=lb:500513768worker2 # [ 28.782251] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_connected addr=lb:500513769worker1 # [ 28.785397] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3770worker2 # [ 28.787473] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3771worker1 # [ 28.986457] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_connected addr=lb:500513772worker2 # [ 28.988396] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_connected addr=lb:500513773worker1 # [ 28.992145] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3774worker2 # [ 28.993554] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3775worker1 # [ 29.192806] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_connected addr=lb:500513776worker2 # [ 29.194258] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_connected addr=lb:500513777worker1 # [ 29.198457] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3778worker2 # [ 29.199169] nix-grpc-daemon[774]: ts=2026-09-20T09:32:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3779worker2 # [ 29.397705] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_connected addr=lb:500513780worker1 # [ 29.400681] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_connected addr=lb:500513781worker2 # [ 29.403098] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3782worker1 # [ 29.405874] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3783worker2 # [ 29.603939] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_connected addr=lb:500513784worker1 # [ 29.606817] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_connected addr=lb:500513785worker2 # [ 29.609511] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3786worker1 # [ 29.612534] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3787worker2 # [ 29.810492] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_connected addr=lb:500513788worker1 # [ 29.813412] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_connected addr=lb:500513789worker2 # [ 29.816184] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3790worker1 # [ 29.818963] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3791worker2 # [ 30.017062] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_connected addr=lb:500513792worker1 # [ 30.019848] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_connected addr=lb:500513793worker2 # [ 30.022316] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3794worker1 # [ 30.025414] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3795worker2 # [ 30.223069] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_connected addr=lb:500513796worker1 # [ 30.226608] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_connected addr=lb:500513797worker2 # [ 30.228486] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3798worker1 # [ 30.231580] nix-grpc-daemon[774]: ts=2026-09-20T09:32:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3799worker1 # [ 30.430619] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_connected addr=lb:500513800worker2 # [ 30.431242] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_connected addr=lb:500513801worker1 # [ 30.435093] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3802worker2 # [ 30.435500] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3803worker1 # [ 30.631535] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_connected addr=lb:500513804worker2 # [ 30.631596] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_connected addr=lb:500513805worker1 # [ 30.637111] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3806worker2 # [ 30.637001] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3807worker1 # [ 30.837873] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_connected addr=lb:500513808worker2 # [ 30.837806] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_connected addr=lb:500513809worker1 # [ 30.843324] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3810worker2 # [ 30.842964] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3811worker1 # [ 31.044199] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_connected addr=lb:500513812worker2 # [ 31.043941] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_connected addr=lb:500513813worker1 # [ 31.049516] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3814worker2 # [ 31.049170] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3815lb # [ 31.157207] rustfs-bucket-start[1032]: mb s3://farm3816lb # [ 31.168894] systemd[1]: Finished rustfs-bucket.service.3817lb # [ 31.183354] systemd[1]: Starting niks3 server...3818worker1 # [ 31.250240] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_connected addr=lb:500513819worker2 # [ 31.250145] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_connected addr=lb:500513820worker1 # [ 31.254003] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3821worker2 # [ 31.255184] nix-grpc-daemon[774]: ts=2026-09-20T09:32:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3822lb # [ 31.409368] postgres[1048]: [1048] ERROR: relation "goose_db_version" does not exist at character 363823lb # [ 31.410674] postgres[1048]: [1048] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3824lb # [ 31.443624] niks3-server[1042]: 2026/09/20 09:32:56 OK 20241026095416_initial_model.sql (19.55ms)3825lb # [ 31.447053] niks3-server[1042]: 2026/09/20 09:32:56 OK 20251210153512_drop_unused_gin_index.sql (3.8ms)3826lb # [ 31.452880] niks3-server[1042]: 2026/09/20 09:32:56 OK 20251218171726_add_pins.sql (5.77ms)3827lb # [ 31.457719] niks3-server[1042]: 2026/09/20 09:32:56 OK 20260628120000_add_object_size_and_stats.sql (4.84ms)3828lb # [ 31.463328] niks3-server[1042]: 2026/09/20 09:32:56 OK 20260905000000_add_claims.sql (4.11ms)3829lb # [ 31.468231] niks3-server[1042]: 2026/09/20 09:32:56 OK 20260920000000_drop_claims.sql (4.72ms)3830lb # [ 31.470242] niks3-server[1042]: 2026/09/20 09:32:56 goose: successfully migrated database to version: 202609200000003831lb # [ 31.474807] niks3-server[1042]: 2026/09/20 09:32:56 OK 1_commit_pending_closure.sql (6.52ms)3832lb # [ 31.477821] niks3-server[1042]: 2026/09/20 09:32:56 OK 2_object_stats_trigger.sql (2.9ms)3833lb # [ 31.479241] niks3-server[1042]: 2026/09/20 09:32:56 goose: up to current file version: 23834lb # [ 31.483283] niks3-server[1042]: 2026/09/20 09:32:56 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3835worker2 # [ 31.454133] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_connected addr=lb:500513836worker1 # [ 31.456859] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_connected addr=lb:500513837worker2 # [ 31.458730] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3838worker1 # [ 31.461366] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3839lb # [ 31.531466] niks3-server[1042]: 2026/09/20 09:32:56 INFO Read proxy enabled — serving cache objects from S33840lb # [ 31.533282] niks3-server[1042]: 2026/09/20 09:32:56 INFO Using socket-activated listener address=0.0.0.0:57513841lb # [ 31.537169] systemd[1]: Started niks3 server.3842lb # [ 31.539581] niks3-server[1042]: 2026/09/20 09:32:56 INFO systemd watchdog enabled interval=15s3843lb # [ 31.543398] niks3-server[1042]: 2026/09/20 09:32:56 INFO Starting HTTP server address=0.0.0.0:57513844lb # [ 31.546805] systemd[1]: Reached target Multi-User System.3845lb # [ 31.547560] niks3-server[1042]: 2026/09/20 09:32:56 INFO lead: acquired remote=192.168.1.4:330363846worker2 # [ 31.500001] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_take_over3847lb # [ 31.553256] systemd[1]: Startup finished in 930ms (kernel) + 5.411s (initrd) + 25.197s (userspace) = 31.539s.3848worker2 # [ 31.655066] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_connected addr=lb:500513849worker1 # [ 31.657574] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_connected addr=lb:500513850worker2 # [ 31.661711] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3851worker1 # [ 31.663980] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3852worker2 # [ 31.862674] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_connected addr=lb:500513853worker1 # [ 31.865053] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_connected addr=lb:500513854worker2 # [ 31.868934] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3855worker1 # [ 31.871196] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3856lb: (finished: waiting for unit niks3.service, in 17.17 seconds)3857lb: waiting for TCP port 5751 on localhost3858lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3859lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds)3860lb: waiting for unit envoy.service3861worker2 # [ 32.069657] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_connected addr=lb:500513862worker1 # [ 32.071813] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_connected addr=lb:500513863worker2 # [ 32.075148] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3864worker1 # [ 32.078027] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3865lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3866lb: waiting for TCP port 50051 on localhost3867lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3868lb # [ 32.229718] envoy[912]: conn peer=[::1]:51128 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=43869lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds)3870worker1 # [ 32.277797] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_connected addr=lb:500513871worker2 # [ 32.276095] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=scheduler_connected addr=lb:500513872worker2 # [ 32.288230] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03873worker2 # [ 32.297735] nix-grpc-daemon[774]: ts=2026-09-20T09:32:56Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03874lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3875??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3876 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283877lb: must succeed: curl -sf localhost:9901/clusters3878lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)3879lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds)3880subtest: one node schedules and both builders hold a WorkerSession on it3881lb: must succeed: curl -sf localhost:9901/clusters3882lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3883worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true3884worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)3885(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.15 seconds)3886subtest: balancer auth: client cert, bearer token, nothing, unknown CN3887worker2 # [ 33.005019] nix-grpc-daemon[774]: ts=2026-09-20T09:32:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:375843888worker2 # [ 33.023663] systemd[1]: Started Nix Daemon.3889worker2 # [ 33.325542] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3890worker2 # [ 33.362454] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 44 ms (attempt 1/5)3891worker2 # [ 33.411303] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 159 ms (attempt 2/5)3892worker2 # [ 33.570743] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 178 ms (attempt 3/5)3893worker2 # [ 33.749324] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 301 ms (attempt 4/5)3894worker2 # [ 34.061632] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3895worker2 # [ 34.085099] nix-grpc-daemon[774]: ts=2026-09-20T09:32:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:375843896worker2 # [ 34.100328] nix-grpc-daemon[774]: ts=2026-09-20T09:32:58Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3897worker2 # [ 34.114317] nix-grpc-daemon[774]: ts=2026-09-20T09:32:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:375843898worker2 # [ 34.122306] nix-grpc-daemon[774]: ts=2026-09-20T09:32:58Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3899client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3900client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.12 seconds)3901client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3902client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3903worker1 # [ 34.591734] nix-grpc-daemon[774]: ts=2026-09-20T09:32:59Z level=info event=oidc_jwks provider=mock keys=13904worker1 # [ 34.596554] nix-grpc-daemon[774]: ts=2026-09-20T09:32:59Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:343543905worker1 # [ 34.613333] systemd[1]: Started Nix Daemon.3906worker1 # [ 34.905449] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3907worker1 # [ 34.933581] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 66 ms (attempt 1/5)3908worker1 # [ 35.004413] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 148 ms (attempt 2/5)3909worker1 # [ 35.160104] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 3/5)3910worker1 # [ 35.238989] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 514 ms (attempt 4/5)3911worker1 # [ 35.756901] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3912worker2 # [ 35.787626] nix-grpc-daemon[774]: ts=2026-09-20T09:33:00Z level=info event=oidc_jwks provider=mock keys=13913worker2 # [ 35.793502] nix-grpc-daemon[774]: ts=2026-09-20T09:33:00Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:375843914worker2 # [ 35.805268] nix-grpc-daemon[774]: ts=2026-09-20T09:33:00Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3915worker2 # [ 35.820545] nix-grpc-daemon[774]: ts=2026-09-20T09:33:00Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:375843916worker2 # [ 35.830040] nix-grpc-daemon[774]: ts=2026-09-20T09:33:00Z level=debug event=path_info_miss path=ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test error="error: path '/nix/store/ch6v9cmx4p6yzx1sg5ai83rbraxmkacx-nixos-system-client-test' is required, but there is no substituter that can build it"3917client: must succeed: rm -r /var/lib/nix-grpc-store3918client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds)3919worker1 # [ 38.159950] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=denied method=QueryMissing cn=- role=none3920worker2 # [ 38.408789] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=denied method=QueryMissing cn=stranger role=none3921(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.81 seconds)3922subtest: DAG build is scheduled across workers and lands in the cache3923client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23924worker2 # [ 38.684542] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:375843925client # don't know how to build these paths:3926client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3927worker2 # [ 38.699339] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375843928worker2 # [ 38.738849] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03929worker2 # [ 38.744936] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13930worker1 # [ 38.794383] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343543931worker1 # [ 38.817338] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343543932client # copying 1 paths to 'lb:50051'...3933worker1 # [ 38.834239] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343543934client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3935worker1 # [ 38.866103] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3936worker1 # [ 38.901475] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=niks3_push_started pid=8423937worker1 # [ 39.364179] nix-daemon[832]: accepted connection from pid 855, user nix-grpc-daemon (trusted)3938worker1 # [ 39.382682] nix-daemon[832]: reaped child process 858, status = succeeded3939worker1 # [ 39.575674] nix-daemon[832]: accepted connection from pid 860, user nix-grpc-daemon (trusted)3940worker1 # [ 39.591993] nix-daemon[832]: reaped child process 864, status = succeeded3941lb # [ 39.651825] niks3-server[1042]: 2026/09/20 09:33:04 INFO Received uploads request method=POST path=/api/pending_closures3942worker1 # [ 39.632778] nix-grpc-daemon[842]: time=2026-09-20T09:33:04.263Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3943worker1 # [ 39.635769] nix-grpc-daemon[842]: time=2026-09-20T09:33:04.263Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3944lb # [ 39.725121] niks3-server[1042]: 2026/09/20 09:33:04 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3945lb # [ 39.738005] niks3-server[1042]: 2026/09/20 09:33:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3946lb # [ 39.746073] niks3-server[1042]: 2026/09/20 09:33:04 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3947lb # [ 39.767608] niks3-server[1042]: 2026/09/20 09:33:04 INFO Signed narinfos id=1 count=13948worker1 # [ 39.727900] nix-grpc-daemon[842]: time=2026-09-20T09:33:04.358Z level=INFO msg="Uploading 1 narinfos"3949lb # [ 39.782203] niks3-server[1042]: 2026/09/20 09:33:04 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3950lb # [ 39.791984] niks3-server[1042]: 2026/09/20 09:33:04 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3951lb # [ 39.800408] envoy[912]: conn peer=[2001:db8:1::1]:54562 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=365 ms=11583952lb # [ 39.809265] envoy[912]: conn peer=[2001:db8:1::1]:54570 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=365 ms=12863953lb # [ 39.811594] envoy[912]: conn peer=[2001:db8:1::1]:54576 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=153954lb # [ 39.816444] envoy[912]: conn peer=[2001:db8:1::1]:54586 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=193955lb # [ 39.819148] niks3-server[1042]: 2026/09/20 09:33:04 INFO Completed upload id=13956worker1 # [ 39.774961] nix-grpc-daemon[842]: time=2026-09-20T09:33:04.406Z level=INFO msg="Upload complete. (596ms)"3957worker1 # [ 39.786602] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=0 paths=1 nar_bytes_in=5043958worker1 # [ 39.804692] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343543959worker1 # [ 39.818294] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3960worker1 # [ 39.823604] nix-daemon[832]: reaped child process 840, status = succeeded3961client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3962worker1 # [ 39.836420] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3963client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3964client # farm-a> LOG-farm-a-t13965worker1 # [ 40.867768] nix-daemon[832]: reaped child process 868, status = succeeded3966worker1 # [ 41.034355] nix-daemon[832]: accepted connection from pid 883, user nix-grpc-daemon (trusted)3967worker1 # [ 41.054497] nix-daemon[832]: reaped child process 886, status = succeeded3968lb # [ 41.111280] niks3-server[1042]: 2026/09/20 09:33:05 INFO Received uploads request method=POST path=/api/pending_closures3969worker1 # [ 41.084157] nix-grpc-daemon[842]: time=2026-09-20T09:33:05.714Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3970worker1 # [ 41.086215] nix-grpc-daemon[842]: time=2026-09-20T09:33:05.714Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3971lb # [ 41.161129] niks3-server[1042]: 2026/09/20 09:33:05 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3972lb # [ 41.176255] niks3-server[1042]: 2026/09/20 09:33:05 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3973lb # [ 41.196196] niks3-server[1042]: 2026/09/20 09:33:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3974lb # [ 41.204711] niks3-server[1042]: 2026/09/20 09:33:05 INFO Signed narinfos id=2 count=13975worker1 # [ 41.160485] nix-grpc-daemon[842]: time=2026-09-20T09:33:05.790Z level=INFO msg="Uploading 1 narinfos"3976lb # [ 41.209214] niks3-server[1042]: 2026/09/20 09:33:05 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3977lb # [ 41.222209] niks3-server[1042]: 2026/09/20 09:33:05 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3978lb # [ 41.236973] niks3-server[1042]: 2026/09/20 09:33:05 INFO Completed upload id=23979worker1 # [ 41.192573] nix-grpc-daemon[842]: time=2026-09-20T09:33:05.824Z level=INFO msg="Upload complete. (341ms)"3980lb # [ 41.239865] niks3-server[1042]: 2026/09/20 09:33:05 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3981worker1 # [ 41.207730] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13982worker2 # [ 41.215685] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03983worker1 # [ 41.225725] nix-daemon[832]: reaped child process 866, status = succeeded3984worker2 # [ 41.222548] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13985worker1 # [ 41.271109] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343543986worker1 # [ 41.287135] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343543987worker1 # [ 41.302169] nix-grpc-daemon[842]: time=2026-09-20T09:33:05.934Z level=INFO msg="All 1 paths already cached"3988client # copying 1 paths to 'lb:50051'...3989worker1 # [ 41.313076] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343543990client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3991worker1 # [ 41.332201] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3992worker1 # [ 41.551771] nix-daemon[832]: accepted connection from pid 890, user nix-grpc-daemon (trusted)3993worker1 # [ 41.570157] nix-daemon[832]: reaped child process 893, status = succeeded3994worker1 # [ 41.745778] nix-daemon[832]: accepted connection from pid 895, user nix-grpc-daemon (trusted)3995worker1 # [ 41.764333] nix-daemon[832]: reaped child process 898, status = succeeded3996lb # [ 41.820106] niks3-server[1042]: 2026/09/20 09:33:06 INFO Received uploads request method=POST path=/api/pending_closures3997worker1 # [ 41.785264] nix-grpc-daemon[842]: time=2026-09-20T09:33:06.416Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3998worker1 # [ 41.786789] nix-grpc-daemon[842]: time=2026-09-20T09:33:06.416Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3999lb # [ 41.848586] niks3-server[1042]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst4000lb # [ 41.862217] niks3-server[1042]: 2026/09/20 09:33:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4001worker1 # [ 41.824573] nix-grpc-daemon[842]: time=2026-09-20T09:33:06.456Z level=INFO msg="Uploading 1 narinfos"4002lb # [ 41.874664] niks3-server[1042]: 2026/09/20 09:33:06 INFO Signed narinfos id=3 count=14003lb # [ 41.880802] niks3-server[1042]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls4004lb # [ 41.887965] niks3-server[1042]: 2026/09/20 09:33:06 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4005lb # [ 41.894781] niks3-server[1042]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo4006lb # [ 41.900415] niks3-server[1042]: 2026/09/20 09:33:06 INFO Completed upload id=34007worker1 # [ 41.856003] nix-grpc-daemon[842]: time=2026-09-20T09:33:06.487Z level=INFO msg="Upload complete. (502ms)"4008worker1 # [ 41.864392] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=0 paths=1 nar_bytes_in=6244009worker1 # [ 41.873987] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343544010worker1 # [ 41.886137] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4011worker1 # [ 41.891274] nix-daemon[832]: reaped child process 888, status = succeeded4012client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...4013client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4014worker1 # [ 41.905370] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4015client # farm-b> LOG-farm-b-t14016worker1 # [ 42.736291] nix-daemon[832]: reaped child process 902, status = succeeded4017worker1 # [ 42.926662] nix-daemon[832]: accepted connection from pid 917, user nix-grpc-daemon (trusted)4018worker1 # [ 42.947073] nix-daemon[832]: reaped child process 921, status = succeeded4019lb # [ 43.005596] niks3-server[1042]: 2026/09/20 09:33:07 INFO Received uploads request method=POST path=/api/pending_closures4020worker1 # [ 42.972754] nix-grpc-daemon[842]: time=2026-09-20T09:33:07.603Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4021worker1 # [ 42.974834] nix-grpc-daemon[842]: time=2026-09-20T09:33:07.603Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"4022lb # [ 43.040106] niks3-server[1042]: 2026/09/20 09:33:07 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst4023lb # [ 43.055724] niks3-server[1042]: 2026/09/20 09:33:07 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4024lb # [ 43.062879] niks3-server[1042]: 2026/09/20 09:33:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4025worker1 # [ 43.023557] nix-grpc-daemon[842]: time=2026-09-20T09:33:07.655Z level=INFO msg="Uploading 1 narinfos"4026lb # [ 43.074091] niks3-server[1042]: 2026/09/20 09:33:07 INFO Signed narinfos id=4 count=14027lb # [ 43.079845] niks3-server[1042]: 2026/09/20 09:33:07 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls4028lb # [ 43.088681] niks3-server[1042]: 2026/09/20 09:33:07 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4029lb # [ 43.096238] niks3-server[1042]: 2026/09/20 09:33:07 INFO Completed upload id=44030worker1 # [ 43.051928] nix-grpc-daemon[842]: time=2026-09-20T09:33:07.683Z level=INFO msg="Upload complete. (336ms)"4031lb # [ 43.099224] niks3-server[1042]: 2026/09/20 09:33:07 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo4032worker1 # [ 43.065176] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=14033worker2 # [ 43.068709] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=04034worker2 # [ 43.069095] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=14035worker1 # [ 43.085158] nix-daemon[832]: reaped child process 900, status = succeeded4036worker1 # [ 43.116168] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343544037worker1 # [ 43.132127] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343544038worker1 # [ 43.147428] nix-grpc-daemon[842]: time=2026-09-20T09:33:07.779Z level=INFO msg="All 2 paths already cached"4039client # copying 1 paths to 'lb:50051'...4040worker1 # [ 43.159509] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343544041client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...4042worker1 # [ 43.181610] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4043worker1 # [ 43.387145] nix-daemon[832]: accepted connection from pid 925, user nix-grpc-daemon (trusted)4044worker1 # [ 43.407502] nix-daemon[832]: reaped child process 928, status = succeeded4045worker1 # [ 43.584283] nix-daemon[832]: accepted connection from pid 930, user nix-grpc-daemon (trusted)4046worker1 # [ 43.603027] nix-daemon[832]: reaped child process 933, status = succeeded4047lb # [ 43.659763] niks3-server[1042]: 2026/09/20 09:33:08 INFO Received uploads request method=POST path=/api/pending_closures4048worker1 # [ 43.625230] nix-grpc-daemon[842]: time=2026-09-20T09:33:08.256Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4049worker1 # [ 43.626822] nix-grpc-daemon[842]: time=2026-09-20T09:33:08.256Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"4050lb # [ 43.688316] niks3-server[1042]: 2026/09/20 09:33:08 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst4051lb # [ 43.702549] niks3-server[1042]: 2026/09/20 09:33:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4052worker1 # [ 43.665924] nix-grpc-daemon[842]: time=2026-09-20T09:33:08.297Z level=INFO msg="Uploading 1 narinfos"4053lb # [ 43.715877] niks3-server[1042]: 2026/09/20 09:33:08 INFO Signed narinfos id=5 count=14054lb # [ 43.722006] niks3-server[1042]: 2026/09/20 09:33:08 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls4055lb # [ 43.731668] niks3-server[1042]: 2026/09/20 09:33:08 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4056lb # [ 43.736768] niks3-server[1042]: 2026/09/20 09:33:08 INFO Completed upload id=54057worker1 # [ 43.691748] nix-grpc-daemon[842]: time=2026-09-20T09:33:08.323Z level=INFO msg="Upload complete. (491ms)"4058lb # [ 43.740049] niks3-server[1042]: 2026/09/20 09:33:08 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo4059worker1 # [ 43.700320] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=0 paths=1 nar_bytes_in=7524060worker1 # [ 43.715293] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343544061worker1 # [ 43.722105] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4062worker1 # [ 43.727139] nix-daemon[832]: reaped child process 923, status = succeeded4063client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...4064worker1 # [ 43.740218] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4065client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4066client # farm-top> LOG-farm-top-t14067worker1 # [ 44.972686] nix-daemon[832]: reaped child process 937, status = succeeded4068worker1 # [ 45.145169] nix-daemon[832]: accepted connection from pid 952, user nix-grpc-daemon (trusted)4069worker1 # [ 45.165108] nix-daemon[832]: reaped child process 955, status = succeeded4070lb # [ 45.221759] niks3-server[1042]: 2026/09/20 09:33:09 INFO Received uploads request method=POST path=/api/pending_closures4071worker1 # [ 45.191479] nix-grpc-daemon[842]: time=2026-09-20T09:33:09.821Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4072worker1 # [ 45.193105] nix-grpc-daemon[842]: time=2026-09-20T09:33:09.821Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4073lb # [ 45.266242] niks3-server[1042]: 2026/09/20 09:33:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4074worker1 # [ 45.232938] nix-grpc-daemon[842]: time=2026-09-20T09:33:09.864Z level=INFO msg="Uploading 1 narinfos"4075lb # [ 45.283298] niks3-server[1042]: 2026/09/20 09:33:09 INFO Signed narinfos id=6 count=14076lb # [ 45.293117] niks3-server[1042]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4077lb # [ 45.304899] niks3-server[1042]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4078lb # [ 45.311531] niks3-server[1042]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4079worker1 # [ 45.276274] nix-grpc-daemon[842]: time=2026-09-20T09:33:09.908Z level=INFO msg="Upload complete. (323ms)"4080lb # [ 45.320792] niks3-server[1042]: 2026/09/20 09:33:09 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4081lb # [ 45.324956] niks3-server[1042]: 2026/09/20 09:33:09 INFO Completed upload id=64082lb # [ 45.328552] niks3-server[1042]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4083worker1 # [ 45.287981] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14084worker1 # [ 45.306367] nix-daemon[832]: reaped child process 935, status = succeeded4085client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 6.89 seconds)4086client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4087client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.25 seconds)4088client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4089client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.04 seconds)4090client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4091client # copying 3 paths...4092client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4093client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4094client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4095client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds)4096(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.57 seconds)4097subtest: repeat is answered Cached by the scheduler without building4098worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4099worker1 # finding garbage collector roots...4100worker1 # deleting specified paths...4101worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4102worker1 # deleting unused links...4103worker1 # note: hard linking is currently saving 0.0 KiB4104worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.33 seconds)4105worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4106worker2 # finding garbage collector roots...4107worker2 # deleting specified paths...4108worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4109worker2 # deleting unused links...4110worker2 # note: hard linking is currently saving 0.0 KiB4111worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds)4112client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24113worker1 # [ 46.908654] nix-grpc-daemon[774]: ts=2026-09-20T09:33:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:343544114client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4115client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4116worker2 # [ 46.929476] nix-grpc-daemon[774]: ts=2026-09-20T09:33:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375844117worker2 # [ 46.953680] nix-grpc-daemon[774]: ts=2026-09-20T09:33:11Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14118client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.33 seconds)4119client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4120client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.22 seconds)4121lb: must succeed: curl -sf localhost:9901/clusters4122lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4123lb: must succeed: curl -sf localhost:9901/clusters4124lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4125worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4126worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.08 seconds)4127(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.51 seconds)4128subtest: inputs already in the cache are not sent to the scheduler4129lb: must succeed: curl -sf localhost:9901/clusters4130lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4131lb: must succeed: curl -sf localhost:9901/clusters4132lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4133worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4134worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4135client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24136client # don't know how to build these paths:4137client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4138worker2 # [ 48.004968] nix-grpc-daemon[774]: ts=2026-09-20T09:33:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:375844139worker1 # [ 48.010899] nix-grpc-daemon[774]: ts=2026-09-20T09:33:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343544140worker1 # [ 48.021509] nix-grpc-daemon[842]: time=2026-09-20T09:33:12.652Z level=INFO msg="All 2 paths already cached"4141worker2 # [ 48.034174] nix-grpc-daemon[774]: ts=2026-09-20T09:33:12Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04142worker2 # [ 48.040710] nix-grpc-daemon[774]: ts=2026-09-20T09:33:12Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=14143worker1 # [ 48.084554] nix-grpc-daemon[774]: ts=2026-09-20T09:33:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343544144worker1 # [ 48.101013] nix-grpc-daemon[774]: ts=2026-09-20T09:33:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343544145client # copying 1 paths to 'lb:50051'...4146worker1 # [ 48.117041] nix-grpc-daemon[842]: time=2026-09-20T09:33:12.747Z level=INFO msg="All 2 paths already cached"4147client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4148worker1 # [ 48.122482] nix-grpc-daemon[774]: ts=2026-09-20T09:33:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343544149worker1 # [ 48.137519] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4150worker1 # [ 48.343002] nix-daemon[832]: accepted connection from pid 973, user nix-grpc-daemon (trusted)4151worker1 # [ 48.363645] nix-daemon[832]: reaped child process 976, status = succeeded4152worker1 # [ 48.542900] nix-daemon[832]: accepted connection from pid 978, user nix-grpc-daemon (trusted)4153worker1 # [ 48.561586] nix-daemon[832]: reaped child process 981, status = succeeded4154lb # [ 48.623176] niks3-server[1042]: 2026/09/20 09:33:13 INFO Received uploads request method=POST path=/api/pending_closures4155worker1 # [ 48.595237] nix-grpc-daemon[842]: time=2026-09-20T09:33:13.226Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4156worker1 # [ 48.596867] nix-grpc-daemon[842]: time=2026-09-20T09:33:13.226Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4157lb # [ 48.657899] niks3-server[1042]: 2026/09/20 09:33:13 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4158lb # [ 48.672720] niks3-server[1042]: 2026/09/20 09:33:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4159worker1 # [ 48.633935] nix-grpc-daemon[842]: time=2026-09-20T09:33:13.265Z level=INFO msg="Uploading 1 narinfos"4160lb # [ 48.683474] niks3-server[1042]: 2026/09/20 09:33:13 INFO Signed narinfos id=7 count=14161lb # [ 48.690070] niks3-server[1042]: 2026/09/20 09:33:13 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4162lb # [ 48.697467] niks3-server[1042]: 2026/09/20 09:33:13 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4163lb # [ 48.704660] niks3-server[1042]: 2026/09/20 09:33:13 INFO Completed upload id=74164worker1 # [ 48.660327] nix-grpc-daemon[842]: time=2026-09-20T09:33:13.292Z level=INFO msg="Upload complete. (504ms)"4165lb # [ 48.707737] niks3-server[1042]: 2026/09/20 09:33:13 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4166worker1 # [ 48.670765] nix-grpc-daemon[774]: ts=2026-09-20T09:33:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=0 paths=1 nar_bytes_in=7524167worker1 # [ 48.684368] nix-grpc-daemon[774]: ts=2026-09-20T09:33:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343544168worker1 # [ 48.691950] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4169worker1 # [ 48.697535] nix-daemon[832]: reaped child process 971, status = succeeded4170client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4171client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4172worker1 # [ 48.712451] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4173lb # [ 49.797102] envoy[912]: conn peer=[2001:db8:1::1]:54600 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9536 tx=3863 ms=66304174lb # [ 49.802175] envoy[912]: conn peer=[2001:db8:1::1]:59028 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=734175client # farm-top> LOG-farm-top-t1b4176worker1 # [ 50.559130] nix-daemon[832]: reaped child process 985, status = succeeded4177worker1 # [ 50.737090] nix-daemon[832]: accepted connection from pid 1000, user nix-grpc-daemon (trusted)4178worker1 # [ 50.755157] nix-daemon[832]: reaped child process 1003, status = succeeded4179lb # [ 50.812965] niks3-server[1042]: 2026/09/20 09:33:15 INFO Received uploads request method=POST path=/api/pending_closures4180worker1 # [ 50.780492] nix-grpc-daemon[842]: time=2026-09-20T09:33:15.410Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4181worker1 # [ 50.782471] nix-grpc-daemon[842]: time=2026-09-20T09:33:15.410Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4182lb # [ 50.858132] niks3-server[1042]: 2026/09/20 09:33:15 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4183lb # [ 50.869736] niks3-server[1042]: 2026/09/20 09:33:15 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4184worker1 # [ 50.834091] nix-grpc-daemon[842]: time=2026-09-20T09:33:15.465Z level=INFO msg="Uploading 1 narinfos"4185lb # [ 50.879726] niks3-server[1042]: 2026/09/20 09:33:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4186lb # [ 50.888499] niks3-server[1042]: 2026/09/20 09:33:15 INFO Signed narinfos id=8 count=14187lb # [ 50.890258] niks3-server[1042]: 2026/09/20 09:33:15 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4188lb # [ 50.898716] niks3-server[1042]: 2026/09/20 09:33:15 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4189lb # [ 50.903579] niks3-server[1042]: 2026/09/20 09:33:15 INFO Completed upload id=84190worker1 # [ 50.858009] nix-grpc-daemon[842]: time=2026-09-20T09:33:15.489Z level=INFO msg="Upload complete. (333ms)"4191lb # [ 50.905625] niks3-server[1042]: 2026/09/20 09:33:15 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4192worker1 # [ 50.869197] nix-grpc-daemon[774]: ts=2026-09-20T09:33:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=2 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14193worker1 # [ 50.888582] nix-daemon[832]: reaped child process 983, status = succeeded4194client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 3.16 seconds)4195client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4196client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.23 seconds)4197lb: must succeed: curl -sf localhost:9901/clusters4198lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4199lb: must succeed: curl -sf localhost:9901/clusters4200lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4201worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4202worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4203(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.83 seconds)4204subtest: two clients wanting the same drv build it once4205client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4206client # [ 51.463480] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4207client # Running as unit: dedup1.service; invocation ID: 167b58c1e7b34d6eacbeb8980ce12f9f4208client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.11 seconds)4209client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4210client # [ 51.728460] nix[886]: don't know how to build these paths:4211client # [ 51.730366] nix[886]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4212worker2 # [ 51.726435] nix-grpc-daemon[774]: ts=2026-09-20T09:33:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:375844213worker2 # [ 51.743710] nix-grpc-daemon[774]: ts=2026-09-20T09:33:16Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04214worker2 # [ 51.751713] nix-grpc-daemon[774]: ts=2026-09-20T09:33:16Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14215worker2 # [ 51.790687] nix-grpc-daemon[774]: ts=2026-09-20T09:33:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375844216worker2 # [ 51.813286] nix-grpc-daemon[774]: ts=2026-09-20T09:33:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375844217client # [ 51.830502] nix[886]: copying 1 paths to 'lb:50051'...4218worker2 # [ 51.831128] nix-grpc-daemon[774]: ts=2026-09-20T09:33:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375844219client # [ 51.835526] nix[886]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4220worker2 # [ 51.855005] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4221worker2 # [ 51.887986] nix-grpc-daemon[774]: ts=2026-09-20T09:33:16Z level=info event=niks3_push_started pid=8904222worker2 # [ 52.397302] nix-daemon[837]: accepted connection from pid 903, user nix-grpc-daemon (trusted)4223worker2 # [ 52.417699] nix-daemon[837]: reaped child process 906, status = succeeded4224client # [ 52.593656] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4225client # Running as unit: dedup2.service; invocation ID: 66ddd2507f2e4176a6a1ebf1f6fec9c54226client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.14 seconds)4227worker2 # [ 52.636210] nix-daemon[837]: accepted connection from pid 908, user nix-grpc-daemon (trusted)4228worker2 # [ 52.656492] nix-daemon[837]: reaped child process 911, status = succeeded4229lb # [ 52.721958] niks3-server[1042]: 2026/09/20 09:33:17 INFO Received uploads request method=POST path=/api/pending_closures4230worker2 # [ 52.693455] nix-grpc-daemon[890]: time=2026-09-20T09:33:17.330Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4231worker2 # [ 52.695400] nix-grpc-daemon[890]: time=2026-09-20T09:33:17.331Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4232lb # [ 52.771278] niks3-server[1042]: 2026/09/20 09:33:17 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4233lb # [ 52.789913] niks3-server[1042]: 2026/09/20 09:33:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4234worker2 # [ 52.749865] nix-grpc-daemon[890]: time=2026-09-20T09:33:17.389Z level=INFO msg="Uploading 1 narinfos"4235lb # [ 52.799897] niks3-server[1042]: 2026/09/20 09:33:17 INFO Signed narinfos id=9 count=14236lb # [ 52.814626] niks3-server[1042]: 2026/09/20 09:33:17 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4237lb # [ 52.823083] niks3-server[1042]: 2026/09/20 09:33:17 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4238worker2 # [ 52.783085] nix-grpc-daemon[890]: time=2026-09-20T09:33:17.423Z level=INFO msg="Upload complete. (597ms)"4239lb # [ 52.830563] niks3-server[1042]: 2026/09/20 09:33:17 INFO Completed upload id=94240lb # [ 52.833737] niks3-server[1042]: 2026/09/20 09:33:17 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4241worker2 # [ 52.799069] nix-grpc-daemon[774]: ts=2026-09-20T09:33:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37584 duration_s=0 paths=1 nar_bytes_in=4324242worker2 # [ 52.804306] nix-grpc-daemon[774]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375844243worker2 # [ 52.816135] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4244worker2 # [ 52.818155] nix-daemon[837]: reaped child process 888, status = succeeded4245worker2 # [ 52.827964] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4246client # [ 52.830799] nix[886]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4247worker1 # [ 52.962657] nix-grpc-daemon[774]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:343544248client # [ 52.970983] nix[902]: don't know how to build these paths:4249client # [ 52.973595] nix[902]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4250worker2 # [ 52.983855] nix-grpc-daemon[774]: ts=2026-09-20T09:33:17Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04251worker2 # [ 52.998048] nix-grpc-daemon[774]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375844252client # [ 53.007448] nix[902]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4253client: must succeed: sleep 24254client: (finished: must succeed: sleep 2, in 2.08 seconds)4255??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4256 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394257client: waiting for success: ! systemctl is-active dedup1 dedup24258??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4259 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394260worker2 # [ 57.460855] nix-daemon[837]: reaped child process 919, status = succeeded4261worker2 # [ 57.632084] nix-daemon[837]: accepted connection from pid 950, user nix-grpc-daemon (trusted)4262worker2 # [ 57.651215] nix-daemon[837]: reaped child process 953, status = succeeded4263lb # [ 57.714479] niks3-server[1042]: 2026/09/20 09:33:22 INFO Received uploads request method=POST path=/api/pending_closures4264worker2 # [ 57.679914] nix-grpc-daemon[890]: time=2026-09-20T09:33:22.318Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4265worker2 # [ 57.681939] nix-grpc-daemon[890]: time=2026-09-20T09:33:22.319Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4266lb # [ 57.777681] niks3-server[1042]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4267lb # [ 57.788376] niks3-server[1042]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4268lb # [ 57.800229] niks3-server[1042]: 2026/09/20 09:33:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4269worker2 # [ 57.754100] nix-grpc-daemon[890]: time=2026-09-20T09:33:22.393Z level=INFO msg="Uploading 1 narinfos"4270lb # [ 57.803982] niks3-server[1042]: 2026/09/20 09:33:22 INFO Signed narinfos id=10 count=14271lb # [ 57.806993] niks3-server[1042]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4272lb # [ 57.816652] niks3-server[1042]: 2026/09/20 09:33:22 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4273lb # [ 57.824544] niks3-server[1042]: 2026/09/20 09:33:22 INFO Completed upload id=104274worker2 # [ 57.775964] nix-grpc-daemon[890]: time=2026-09-20T09:33:22.416Z level=INFO msg="Upload complete. (332ms)"4275lb # [ 57.827120] niks3-server[1042]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4276worker2 # [ 57.792225] nix-grpc-daemon[774]: ts=2026-09-20T09:33:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37584 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14277worker2 # [ 57.807754] nix-grpc-daemon[774]: ts=2026-09-20T09:33:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37584 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14278worker2 # [ 57.813407] nix-daemon[837]: reaped child process 917, status = succeeded4279client # [ 57.867808] systemd[1]: dedup1.service: Deactivated successfully.4280client # [ 57.871324] systemd[1]: dedup1.service: Consumed 183ms CPU time over 6.408s wall clock time, 37.2M memory peak, 8.4K incoming IP traffic, 8.7K outgoing IP traffic.4281client # [ 57.879417] systemd[1]: dedup2.service: Deactivated successfully.4282client # [ 57.882796] systemd[1]: dedup2.service: Consumed 225ms CPU time over 5.287s wall clock time, 31M memory peak, 7.3K incoming IP traffic, 6.4K outgoing IP traffic.4283client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.16 seconds)4284client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4285client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.08 seconds)4286worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4287worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4288worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4289worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4290worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4291worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.10 seconds)4292worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4293worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4294(finished: subtest: two clients wanting the same drv build it once, in 7.64 seconds)4295subtest: build hook: nix-daemon with builders = grpc://lb4296client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4297client # [ 59.266123] systemd[1]: Started Nix Daemon.4298client # [ 59.464671] nix-daemon[943]: accepted connection from pid 940, user root (trusted)4299worker1 # [ 59.687547] nix-grpc-daemon[774]: ts=2026-09-20T09:33:24Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:343544300worker2 # [ 59.694076] nix-grpc-daemon[774]: ts=2026-09-20T09:33:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375844301worker2 # [ 59.716173] nix-grpc-daemon[774]: ts=2026-09-20T09:33:24Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04302worker2 # [ 59.722354] nix-grpc-daemon[774]: ts=2026-09-20T09:33:24Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14303lb # [ 59.799296] envoy[912]: conn peer=[2001:db8:1::1]:59040 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4198 tx=1728 ms=28754304lb # [ 59.804688] envoy[912]: conn peer=[2001:db8:1::1]:48596 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1086 ms=48604305lb # [ 59.809703] envoy[912]: conn peer=[2001:db8:1::1]:48580 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2962 tx=1357 ms=60924306worker1 # [ 59.777928] nix-grpc-daemon[774]: ts=2026-09-20T09:33:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343544307worker1 # [ 59.800184] nix-grpc-daemon[774]: ts=2026-09-20T09:33:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343544308worker1 # [ 59.818081] nix-grpc-daemon[774]: ts=2026-09-20T09:33:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343544309worker1 # [ 59.842246] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4310worker1 # [ 60.079023] nix-daemon[832]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4311worker1 # [ 60.103499] nix-daemon[832]: reaped child process 1037, status = succeeded4312worker1 # [ 60.281420] nix-daemon[832]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)4313worker1 # [ 60.299798] nix-daemon[832]: reaped child process 1042, status = succeeded4314lb # [ 60.361081] niks3-server[1042]: 2026/09/20 09:33:24 INFO Received uploads request method=POST path=/api/pending_closures4315worker1 # [ 60.327276] nix-grpc-daemon[842]: time=2026-09-20T09:33:24.957Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4316worker1 # [ 60.328916] nix-grpc-daemon[842]: time=2026-09-20T09:33:24.958Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4317lb # [ 60.391977] niks3-server[1042]: 2026/09/20 09:33:25 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4318lb # [ 60.412803] niks3-server[1042]: 2026/09/20 09:33:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4319worker1 # [ 60.378419] nix-grpc-daemon[842]: time=2026-09-20T09:33:25.009Z level=INFO msg="Uploading 1 narinfos"4320lb # [ 60.427992] niks3-server[1042]: 2026/09/20 09:33:25 INFO Signed narinfos id=11 count=14321lb # [ 60.435810] niks3-server[1042]: 2026/09/20 09:33:25 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4322lb # [ 60.446898] niks3-server[1042]: 2026/09/20 09:33:25 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4323lb # [ 60.453493] niks3-server[1042]: 2026/09/20 09:33:25 INFO Completed upload id=114324worker1 # [ 60.408501] nix-grpc-daemon[842]: time=2026-09-20T09:33:25.040Z level=INFO msg="Upload complete. (542ms)"4325lb # [ 60.456155] niks3-server[1042]: 2026/09/20 09:33:25 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4326worker1 # [ 60.416365] nix-grpc-daemon[774]: ts=2026-09-20T09:33:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=0 paths=1 nar_bytes_in=5124327worker1 # [ 60.428364] nix-grpc-daemon[774]: ts=2026-09-20T09:33:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343544328worker1 # [ 60.441792] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4329worker1 # [ 60.448534] nix-daemon[832]: reaped child process 1032, status = succeeded4330worker1 # [ 60.464232] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4331worker1 # [ 61.295047] nix-daemon[832]: reaped child process 1046, status = succeeded4332worker1 # [ 61.465692] nix-daemon[832]: accepted connection from pid 1061, user nix-grpc-daemon (trusted)4333worker1 # [ 61.484650] nix-daemon[832]: reaped child process 1064, status = succeeded4334lb # [ 61.543445] niks3-server[1042]: 2026/09/20 09:33:26 INFO Received uploads request method=POST path=/api/pending_closures4335worker1 # [ 61.512448] nix-grpc-daemon[842]: time=2026-09-20T09:33:26.142Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4336worker1 # [ 61.514032] nix-grpc-daemon[842]: time=2026-09-20T09:33:26.142Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4337lb # [ 61.592231] niks3-server[1042]: 2026/09/20 09:33:26 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4338lb # [ 61.605797] niks3-server[1042]: 2026/09/20 09:33:26 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4339lb # [ 61.619084] niks3-server[1042]: 2026/09/20 09:33:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4340worker1 # [ 61.581587] nix-grpc-daemon[842]: time=2026-09-20T09:33:26.212Z level=INFO msg="Uploading 1 narinfos"4341lb # [ 61.631263] niks3-server[1042]: 2026/09/20 09:33:26 INFO Signed narinfos id=12 count=14342lb # [ 61.637289] niks3-server[1042]: 2026/09/20 09:33:26 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4343lb # [ 61.646620] niks3-server[1042]: 2026/09/20 09:33:26 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4344lb # [ 61.654177] niks3-server[1042]: 2026/09/20 09:33:26 INFO Completed upload id=124345worker1 # [ 61.608240] nix-grpc-daemon[842]: time=2026-09-20T09:33:26.240Z level=INFO msg="Upload complete. (332ms)"4346lb # [ 61.657300] niks3-server[1042]: 2026/09/20 09:33:26 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4347worker1 # [ 61.621329] nix-grpc-daemon[774]: ts=2026-09-20T09:33:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14348worker2 # [ 61.626954] nix-grpc-daemon[774]: ts=2026-09-20T09:33:26Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:375844349worker1 # [ 61.641906] nix-daemon[832]: reaped child process 1044, status = succeeded4350worker2 # [ 61.639088] nix-grpc-daemon[774]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4351worker1 # [ 61.696864] nix-grpc-daemon[774]: ts=2026-09-20T09:33:26Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:343544352worker1 # [ 61.706078] nix-grpc-daemon[774]: ts=2026-09-20T09:33:26Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=0 paths=1 nar_bytes_out=1284353worker1 # [ 61.973264] nix-grpc-daemon[774]: ts=2026-09-20T09:33:26Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:343544354worker2 # [ 61.976467] nix-grpc-daemon[774]: ts=2026-09-20T09:33:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375844355worker2 # [ 61.988823] nix-grpc-daemon[890]: time=2026-09-20T09:33:26.628Z level=INFO msg="All 1 paths already cached"4356worker2 # [ 62.008146] nix-grpc-daemon[774]: ts=2026-09-20T09:33:26Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04357worker2 # [ 62.014852] nix-grpc-daemon[774]: ts=2026-09-20T09:33:26Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14358worker1 # [ 62.020918] nix-grpc-daemon[774]: ts=2026-09-20T09:33:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343544359worker1 # [ 62.041326] nix-grpc-daemon[774]: ts=2026-09-20T09:33:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343544360worker1 # [ 62.059257] nix-grpc-daemon[842]: time=2026-09-20T09:33:26.691Z level=INFO msg="All 1 paths already cached"4361worker1 # [ 62.071745] nix-grpc-daemon[774]: ts=2026-09-20T09:33:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343544362worker1 # [ 62.087111] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4363worker1 # [ 62.307005] nix-daemon[832]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)4364worker1 # [ 62.328230] nix-daemon[832]: reaped child process 1071, status = succeeded4365worker1 # [ 62.508327] nix-daemon[832]: accepted connection from pid 1073, user nix-grpc-daemon (trusted)4366worker1 # [ 62.526851] nix-daemon[832]: reaped child process 1076, status = succeeded4367lb # [ 62.585775] niks3-server[1042]: 2026/09/20 09:33:27 INFO Received uploads request method=POST path=/api/pending_closures4368worker1 # [ 62.553094] nix-grpc-daemon[842]: time=2026-09-20T09:33:27.184Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4369worker1 # [ 62.554576] nix-grpc-daemon[842]: time=2026-09-20T09:33:27.184Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4370lb # [ 62.622859] niks3-server[1042]: 2026/09/20 09:33:27 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4371worker1 # [ 62.588588] nix-grpc-daemon[842]: time=2026-09-20T09:33:27.220Z level=INFO msg="Uploading 1 narinfos"4372lb # [ 62.639498] niks3-server[1042]: 2026/09/20 09:33:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4373lb # [ 62.649100] niks3-server[1042]: 2026/09/20 09:33:27 INFO Signed narinfos id=13 count=14374lb # [ 62.651735] niks3-server[1042]: 2026/09/20 09:33:27 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4375lb # [ 62.661151] niks3-server[1042]: 2026/09/20 09:33:27 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4376lb # [ 62.665896] niks3-server[1042]: 2026/09/20 09:33:27 INFO Completed upload id=134377worker1 # [ 62.621001] nix-grpc-daemon[842]: time=2026-09-20T09:33:27.252Z level=INFO msg="Upload complete. (514ms)"4378lb # [ 62.668429] niks3-server[1042]: 2026/09/20 09:33:27 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4379worker1 # [ 62.628978] nix-grpc-daemon[774]: ts=2026-09-20T09:33:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=0 paths=1 nar_bytes_in=6244380worker1 # [ 62.643542] nix-grpc-daemon[774]: ts=2026-09-20T09:33:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343544381worker1 # [ 62.651783] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4382worker1 # [ 62.657584] nix-daemon[832]: reaped child process 1066, status = succeeded4383worker1 # [ 62.671991] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4384worker1 # [ 63.901434] nix-daemon[832]: reaped child process 1080, status = succeeded4385worker1 # [ 64.084523] nix-daemon[832]: accepted connection from pid 1095, user nix-grpc-daemon (trusted)4386worker1 # [ 64.105231] nix-daemon[832]: reaped child process 1098, status = succeeded4387lb # [ 64.162314] niks3-server[1042]: 2026/09/20 09:33:28 INFO Received uploads request method=POST path=/api/pending_closures4388worker1 # [ 64.132861] nix-grpc-daemon[842]: time=2026-09-20T09:33:28.761Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4389worker1 # [ 64.134520] nix-grpc-daemon[842]: time=2026-09-20T09:33:28.761Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4390lb # [ 64.210563] niks3-server[1042]: 2026/09/20 09:33:28 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4391worker1 # [ 64.181958] nix-grpc-daemon[842]: time=2026-09-20T09:33:28.813Z level=INFO msg="Uploading 1 narinfos"4392lb # [ 64.226247] niks3-server[1042]: 2026/09/20 09:33:28 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4393lb # [ 64.238188] niks3-server[1042]: 2026/09/20 09:33:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4394lb # [ 64.250342] niks3-server[1042]: 2026/09/20 09:33:28 INFO Signed narinfos id=14 count=14395worker1 # [ 64.205704] nix-grpc-daemon[842]: time=2026-09-20T09:33:28.837Z level=INFO msg="Upload complete. (323ms)"4396lb # [ 64.254705] niks3-server[1042]: 2026/09/20 09:33:28 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4397lb # [ 64.261755] niks3-server[1042]: 2026/09/20 09:33:28 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4398lb # [ 64.266748] niks3-server[1042]: 2026/09/20 09:33:28 INFO Completed upload id=144399worker1 # [ 64.218345] nix-grpc-daemon[774]: ts=2026-09-20T09:33:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14400lb # [ 64.271323] niks3-server[1042]: 2026/09/20 09:33:28 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4401worker1 # [ 64.238356] nix-grpc-daemon[774]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:343544402worker1 # [ 64.243248] nix-daemon[832]: reaped child process 1078, status = succeeded4403worker1 # [ 64.258135] nix-grpc-daemon[774]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:343544404worker1 # [ 64.263702] nix-grpc-daemon[774]: ts=2026-09-20T09:33:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=0 paths=1 nar_bytes_out=1764405worker2 # [ 64.590533] nix-grpc-daemon[774]: ts=2026-09-20T09:33:29Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:375844406worker1 # [ 64.595910] nix-grpc-daemon[774]: ts=2026-09-20T09:33:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343544407worker1 # [ 64.605569] nix-grpc-daemon[842]: time=2026-09-20T09:33:29.237Z level=INFO msg="All 2 paths already cached"4408worker2 # [ 64.623210] nix-grpc-daemon[774]: ts=2026-09-20T09:33:29Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04409worker2 # [ 64.629531] nix-grpc-daemon[774]: ts=2026-09-20T09:33:29Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14410worker1 # [ 64.634799] nix-grpc-daemon[774]: ts=2026-09-20T09:33:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343544411worker1 # [ 64.651288] nix-grpc-daemon[774]: ts=2026-09-20T09:33:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343544412worker1 # [ 64.666109] nix-grpc-daemon[842]: time=2026-09-20T09:33:29.298Z level=INFO msg="All 2 paths already cached"4413worker1 # [ 64.675869] nix-grpc-daemon[774]: ts=2026-09-20T09:33:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343544414worker1 # [ 64.690422] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4415worker1 # [ 64.891515] nix-daemon[832]: accepted connection from pid 1102, user nix-grpc-daemon (trusted)4416worker1 # [ 64.912115] nix-daemon[832]: reaped child process 1105, status = succeeded4417worker1 # [ 65.082817] nix-daemon[832]: accepted connection from pid 1107, user nix-grpc-daemon (trusted)4418worker1 # [ 65.100852] nix-daemon[832]: reaped child process 1110, status = succeeded4419lb # [ 65.156218] niks3-server[1042]: 2026/09/20 09:33:29 INFO Received uploads request method=POST path=/api/pending_closures4420worker1 # [ 65.121048] nix-grpc-daemon[842]: time=2026-09-20T09:33:29.752Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4421worker1 # [ 65.122529] nix-grpc-daemon[842]: time=2026-09-20T09:33:29.752Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4422lb # [ 65.186773] niks3-server[1042]: 2026/09/20 09:33:29 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4423worker1 # [ 65.156420] nix-grpc-daemon[842]: time=2026-09-20T09:33:29.787Z level=INFO msg="Uploading 1 narinfos"4424lb # [ 65.204942] niks3-server[1042]: 2026/09/20 09:33:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4425lb # [ 65.213940] niks3-server[1042]: 2026/09/20 09:33:29 INFO Signed narinfos id=15 count=14426worker1 # [ 65.175065] nix-grpc-daemon[842]: time=2026-09-20T09:33:29.807Z level=INFO msg="Upload complete. (467ms)"4427lb # [ 65.222149] niks3-server[1042]: 2026/09/20 09:33:29 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4428worker1 # [ 65.181542] nix-grpc-daemon[774]: ts=2026-09-20T09:33:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=0 paths=1 nar_bytes_in=7524429lb # [ 65.228209] niks3-server[1042]: 2026/09/20 09:33:29 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4430lb # [ 65.233542] niks3-server[1042]: 2026/09/20 09:33:29 INFO Completed upload id=154431worker1 # [ 65.189351] nix-grpc-daemon[774]: ts=2026-09-20T09:33:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343544432lb # [ 65.236101] niks3-server[1042]: 2026/09/20 09:33:29 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4433worker1 # [ 65.199231] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4434worker1 # [ 65.203465] nix-daemon[832]: reaped child process 1100, status = succeeded4435worker1 # [ 65.213449] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4436worker1 # [ 66.452585] nix-daemon[832]: reaped child process 1114, status = succeeded4437worker1 # [ 66.623411] nix-daemon[832]: accepted connection from pid 1129, user nix-grpc-daemon (trusted)4438worker1 # [ 66.640837] nix-daemon[832]: reaped child process 1132, status = succeeded4439lb # [ 66.701445] niks3-server[1042]: 2026/09/20 09:33:31 INFO Received uploads request method=POST path=/api/pending_closures4440worker1 # [ 66.668441] nix-grpc-daemon[842]: time=2026-09-20T09:33:31.297Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4441worker1 # [ 66.670053] nix-grpc-daemon[842]: time=2026-09-20T09:33:31.297Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4442lb # [ 66.743085] niks3-server[1042]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4443lb # [ 66.765350] niks3-server[1042]: 2026/09/20 09:33:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4444lb # [ 66.771919] niks3-server[1042]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4445lb # [ 66.780100] niks3-server[1042]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4446lb # [ 66.789224] niks3-server[1042]: 2026/09/20 09:33:31 INFO Signed narinfos id=16 count=14447worker1 # [ 66.745394] nix-grpc-daemon[842]: time=2026-09-20T09:33:31.376Z level=INFO msg="Uploading 1 narinfos"4448lb # [ 66.798531] niks3-server[1042]: 2026/09/20 09:33:31 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4449lb # [ 66.806523] niks3-server[1042]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4450lb # [ 66.822958] niks3-server[1042]: 2026/09/20 09:33:31 INFO Completed upload id=164451worker1 # [ 66.778710] nix-grpc-daemon[842]: time=2026-09-20T09:33:31.410Z level=INFO msg="Upload complete. (354ms)"4452worker1 # [ 66.789174] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14453worker1 # [ 66.809521] nix-daemon[832]: reaped child process 1112, status = succeeded4454worker2 # [ 66.834784] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:375844455worker2 # [ 66.855980] nix-grpc-daemon[774]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4456worker2 # [ 66.873046] nix-grpc-daemon[774]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4457worker1 # [ 66.916106] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:343544458worker1 # [ 66.922919] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=0 paths=1 nar_bytes_out=2324459client # [ 67.017011] nix-daemon[943]: reaped child process 945, status = succeeded4460client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.02 seconds)4461client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4462client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4463client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4464client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4465client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4466client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4467(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.15 seconds)4468subtest: an input only one worker has still reaches the builder4469client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4470client # this derivation will be built:4471client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4472client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4473client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.44 seconds)4474client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4475client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds)4476worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4477worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.25 seconds)4478worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4479worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4480client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24481client # [ 68.304220] nix-daemon[943]: accepted connection from pid 1025, user root (trusted)4482client # this derivation will be built:4483client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4484worker2 # [ 68.500662] nix-grpc-daemon[774]: ts=2026-09-20T09:33:33Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:375844485client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4486worker1 # [ 68.506917] nix-grpc-daemon[774]: ts=2026-09-20T09:33:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343544487worker1 # [ 68.709836] nix-daemon[832]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)4488worker1 # [ 68.727527] nix-daemon[832]: reaped child process 1142, status = succeeded4489lb # [ 68.785600] niks3-server[1042]: 2026/09/20 09:33:33 INFO Received uploads request method=POST path=/api/pending_closures4490worker1 # [ 68.752701] nix-grpc-daemon[842]: time=2026-09-20T09:33:33.384Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4491worker1 # [ 68.754260] nix-grpc-daemon[842]: time=2026-09-20T09:33:33.384Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4492lb # [ 68.822966] niks3-server[1042]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4493worker1 # [ 68.793217] nix-grpc-daemon[842]: time=2026-09-20T09:33:33.424Z level=INFO msg="Uploading 1 narinfos"4494lb # [ 68.837508] niks3-server[1042]: 2026/09/20 09:33:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4495lb # [ 68.848656] niks3-server[1042]: 2026/09/20 09:33:33 INFO Signed narinfos id=17 count=14496lb # [ 68.852383] niks3-server[1042]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4497lb # [ 68.859152] niks3-server[1042]: 2026/09/20 09:33:33 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4498lb # [ 68.865483] niks3-server[1042]: 2026/09/20 09:33:33 INFO Completed upload id=174499worker1 # [ 68.820471] nix-grpc-daemon[842]: time=2026-09-20T09:33:33.452Z level=INFO msg="Upload complete. (307ms)"4500lb # [ 68.868295] niks3-server[1042]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4501worker2 # [ 68.843380] nix-grpc-daemon[774]: ts=2026-09-20T09:33:33Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04502worker2 # [ 68.850886] nix-grpc-daemon[774]: ts=2026-09-20T09:33:33Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14503worker2 # [ 68.890080] nix-grpc-daemon[774]: ts=2026-09-20T09:33:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375844504worker2 # [ 68.906147] nix-grpc-daemon[774]: ts=2026-09-20T09:33:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375844505client # copying 2 paths to 'lb:50051'...4506client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4507worker2 # [ 68.925891] nix-grpc-daemon[774]: ts=2026-09-20T09:33:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375844508client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4509worker2 # [ 68.946725] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4510worker2 # [ 69.162025] nix-daemon[837]: accepted connection from pid 982, user nix-grpc-daemon (trusted)4511worker2 # [ 69.182333] nix-daemon[837]: reaped child process 985, status = succeeded4512worker2 # [ 69.355424] nix-daemon[837]: accepted connection from pid 987, user nix-grpc-daemon (trusted)4513worker2 # [ 69.374952] nix-daemon[837]: reaped child process 990, status = succeeded4514lb # [ 69.432535] niks3-server[1042]: 2026/09/20 09:33:34 INFO Received uploads request method=POST path=/api/pending_closures4515lb # [ 69.444062] niks3-server[1042]: 2026/09/20 09:33:34 INFO Received uploads request method=POST path=/api/pending_closures4516worker2 # [ 69.408907] nix-grpc-daemon[890]: time=2026-09-20T09:33:34.048Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4517worker2 # [ 69.410389] nix-grpc-daemon[890]: time=2026-09-20T09:33:34.048Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4518worker2 # [ 69.412298] nix-grpc-daemon[890]: time=2026-09-20T09:33:34.048Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4519lb # [ 69.486226] niks3-server[1042]: 2026/09/20 09:33:34 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4520lb # [ 69.495967] niks3-server[1042]: 2026/09/20 09:33:34 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4521worker2 # [ 69.461095] nix-grpc-daemon[890]: time=2026-09-20T09:33:34.101Z level=INFO msg="Uploading 3 narinfos"4522lb # [ 69.509526] niks3-server[1042]: 2026/09/20 09:33:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4523lb # [ 69.516481] niks3-server[1042]: 2026/09/20 09:33:34 INFO Signed narinfos id=18 count=14524lb # [ 69.518221] niks3-server[1042]: 2026/09/20 09:33:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4525lb # [ 69.526504] niks3-server[1042]: 2026/09/20 09:33:34 INFO Signed narinfos id=19 count=24526lb # [ 69.529398] niks3-server[1042]: 2026/09/20 09:33:34 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4527lb # [ 69.531863] niks3-server[1042]: 2026/09/20 09:33:34 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4528lb # [ 69.543657] niks3-server[1042]: 2026/09/20 09:33:34 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4529lb # [ 69.552651] niks3-server[1042]: 2026/09/20 09:33:34 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4530lb # [ 69.555892] niks3-server[1042]: 2026/09/20 09:33:34 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4531lb # [ 69.559166] niks3-server[1042]: 2026/09/20 09:33:34 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4532lb # [ 69.563804] niks3-server[1042]: 2026/09/20 09:33:34 INFO Completed upload id=184533lb # [ 69.565716] niks3-server[1042]: 2026/09/20 09:33:34 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4534lb # [ 69.569277] niks3-server[1042]: 2026/09/20 09:33:34 INFO Completed upload id=194535worker2 # [ 69.522344] nix-grpc-daemon[890]: time=2026-09-20T09:33:34.162Z level=INFO msg="Upload complete. (555ms)"4536worker2 # [ 69.533601] nix-grpc-daemon[774]: ts=2026-09-20T09:33:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37584 duration_s=0 paths=2 nar_bytes_in=9844537worker2 # [ 69.552599] nix-grpc-daemon[774]: ts=2026-09-20T09:33:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375844538worker2 # [ 69.562607] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4539worker2 # [ 69.571424] nix-daemon[837]: reaped child process 980, status = succeeded4540worker2 # [ 69.581617] nix-grpc-daemon[774]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4541client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4542worker2 # [ 69.601263] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4543client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4544lb # [ 69.802506] envoy[912]: conn peer=[2001:db8:1::1]:49242 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=334 ms=314545lb # [ 69.808407] envoy[912]: conn peer=[2001:db8:1::1]:48612 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3401 tx=1776 ms=20414546lb # [ 69.813242] envoy[912]: conn peer=[2001:db8:1::1]:49254 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3886 tx=1876 ms=23444547lb # [ 69.825361] envoy[912]: conn peer=[2001:db8:1::1]:49270 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=664548lb # [ 69.829483] envoy[912]: conn peer=[2001:db8:1::1]:49280 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=406 ms=274549lb # [ 69.833561] envoy[912]: conn peer=[2001:db8:1::1]:49278 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4325 tx=2199 ms=23524550worker2 # [ 71.049497] nix-daemon[837]: reaped child process 995, status = succeeded4551worker2 # [ 71.230920] nix-daemon[837]: accepted connection from pid 1010, user nix-grpc-daemon (trusted)4552worker2 # [ 71.249844] nix-daemon[837]: reaped child process 1013, status = succeeded4553lb # [ 71.310594] niks3-server[1042]: 2026/09/20 09:33:35 INFO Received uploads request method=POST path=/api/pending_closures4554worker2 # [ 71.273600] nix-grpc-daemon[890]: time=2026-09-20T09:33:35.913Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4555lb # [ 71.341675] niks3-server[1042]: 2026/09/20 09:33:35 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4556lb # [ 71.352447] niks3-server[1042]: 2026/09/20 09:33:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4557worker2 # [ 71.311781] nix-grpc-daemon[890]: time=2026-09-20T09:33:35.951Z level=INFO msg="Uploading 1 narinfos"4558lb # [ 71.363591] niks3-server[1042]: 2026/09/20 09:33:35 INFO Signed narinfos id=20 count=14559lb # [ 71.369869] niks3-server[1042]: 2026/09/20 09:33:36 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4560lb # [ 71.378370] niks3-server[1042]: 2026/09/20 09:33:36 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4561lb # [ 71.385706] niks3-server[1042]: 2026/09/20 09:33:36 INFO Completed upload id=204562worker2 # [ 71.338567] nix-grpc-daemon[890]: time=2026-09-20T09:33:35.979Z level=INFO msg="Upload complete. (319ms)"4563lb # [ 71.388700] niks3-server[1042]: 2026/09/20 09:33:36 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4564worker2 # [ 71.348998] nix-grpc-daemon[774]: ts=2026-09-20T09:33:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37584 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14565worker2 # [ 71.364612] nix-daemon[837]: reaped child process 992, status = succeeded4566client # copying 1 paths...4567worker1 # [ 71.401892] nix-grpc-daemon[774]: ts=2026-09-20T09:33:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:343544568worker1 # [ 71.418781] nix-grpc-daemon[774]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4569client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4570worker2 # [ 71.466730] nix-grpc-daemon[774]: ts=2026-09-20T09:33:36Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:375844571worker2 # [ 71.474778] nix-grpc-daemon[774]: ts=2026-09-20T09:33:36Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37584 duration_s=0 paths=1 nar_bytes_out=1204572client # [ 71.604278] nix-daemon[943]: reaped child process 1028, status = succeeded4573client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.54 seconds)4574client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24575client # [ 71.825431] nix-daemon[943]: accepted connection from pid 1047, user root (trusted)4576client # this derivation will be built:4577client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4578worker1 # [ 72.021439] nix-grpc-daemon[774]: ts=2026-09-20T09:33:36Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:343544579client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4580worker1 # [ 72.029342] nix-grpc-daemon[774]: ts=2026-09-20T09:33:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343544581worker1 # [ 72.037089] nix-grpc-daemon[842]: time=2026-09-20T09:33:36.666Z level=INFO msg="All 1 paths already cached"4582worker2 # [ 72.046918] nix-grpc-daemon[774]: ts=2026-09-20T09:33:36Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04583worker2 # [ 72.053844] nix-grpc-daemon[774]: ts=2026-09-20T09:33:36Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14584worker1 # [ 72.058643] nix-grpc-daemon[774]: ts=2026-09-20T09:33:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343544585worker1 # [ 72.073923] nix-grpc-daemon[774]: ts=2026-09-20T09:33:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343544586client # copying 1 paths to 'lb:50051'...4587client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4588worker1 # [ 72.094397] nix-grpc-daemon[774]: ts=2026-09-20T09:33:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343544589worker1 # [ 72.109915] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4590worker1 # [ 72.132635] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 1/5)4591worker1 # [ 72.228596] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 2/5)4592worker1 # [ 72.237814] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 3/5)4593worker1 # [ 72.259718] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 593 ms (attempt 4/5)4594worker1 # [ 72.862056] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4595worker1 # [ 72.871900] nix-grpc-daemon[774]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4596worker1 # [ 73.110894] nix-daemon[832]: accepted connection from pid 1151, user nix-grpc-daemon (trusted)4597worker1 # [ 73.130169] nix-daemon[832]: reaped child process 1154, status = succeeded4598worker1 # [ 73.307877] nix-daemon[832]: accepted connection from pid 1156, user nix-grpc-daemon (trusted)4599worker1 # [ 73.324485] nix-daemon[832]: reaped child process 1159, status = succeeded4600lb # [ 73.385996] niks3-server[1042]: 2026/09/20 09:33:38 INFO Received uploads request method=POST path=/api/pending_closures4601worker1 # [ 73.349854] nix-grpc-daemon[842]: time=2026-09-20T09:33:37.981Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4602worker1 # [ 73.351372] nix-grpc-daemon[842]: time=2026-09-20T09:33:37.981Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4603lb # [ 73.413988] niks3-server[1042]: 2026/09/20 09:33:38 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4604worker1 # [ 73.386208] nix-grpc-daemon[842]: time=2026-09-20T09:33:38.018Z level=INFO msg="Uploading 1 narinfos"4605lb # [ 73.430513] niks3-server[1042]: 2026/09/20 09:33:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4606lb # [ 73.442217] niks3-server[1042]: 2026/09/20 09:33:38 INFO Signed narinfos id=21 count=14607lb # [ 73.448381] niks3-server[1042]: 2026/09/20 09:33:38 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4608lb # [ 73.457897] niks3-server[1042]: 2026/09/20 09:33:38 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4609lb # [ 73.464120] niks3-server[1042]: 2026/09/20 09:33:38 INFO Completed upload id=214610worker1 # [ 73.419538] nix-grpc-daemon[842]: time=2026-09-20T09:33:38.051Z level=INFO msg="Upload complete. (512ms)"4611lb # [ 73.467083] niks3-server[1042]: 2026/09/20 09:33:38 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4612worker1 # [ 73.428282] nix-grpc-daemon[774]: ts=2026-09-20T09:33:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=1 paths=1 nar_bytes_in=5684613worker1 # [ 73.436636] nix-grpc-daemon[774]: ts=2026-09-20T09:33:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343544614worker1 # [ 73.448878] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4615worker1 # [ 73.454071] nix-daemon[832]: reaped child process 1145, status = succeeded4616client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4617worker1 # [ 73.468203] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4618client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4619worker1 # [ 74.117357] nix-daemon[832]: reaped child process 1163, status = succeeded4620worker1 # [ 74.298876] nix-daemon[832]: accepted connection from pid 1178, user nix-grpc-daemon (trusted)4621worker1 # [ 74.317670] nix-daemon[832]: reaped child process 1181, status = succeeded4622lb # [ 74.373090] niks3-server[1042]: 2026/09/20 09:33:39 INFO Received uploads request method=POST path=/api/pending_closures4623worker1 # [ 74.339813] nix-grpc-daemon[842]: time=2026-09-20T09:33:38.970Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4624lb # [ 74.406203] niks3-server[1042]: 2026/09/20 09:33:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4625worker1 # [ 74.369395] nix-grpc-daemon[842]: time=2026-09-20T09:33:39.000Z level=INFO msg="Uploading 1 narinfos"4626lb # [ 74.422069] niks3-server[1042]: 2026/09/20 09:33:39 INFO Signed narinfos id=22 count=14627lb # [ 74.428884] niks3-server[1042]: 2026/09/20 09:33:39 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4628lb # [ 74.435857] niks3-server[1042]: 2026/09/20 09:33:39 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4629lb # [ 74.443976] niks3-server[1042]: 2026/09/20 09:33:39 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4630lb # [ 74.448532] niks3-server[1042]: 2026/09/20 09:33:39 INFO Completed upload id=224631worker1 # [ 74.403791] nix-grpc-daemon[842]: time=2026-09-20T09:33:39.035Z level=INFO msg="Upload complete. (321ms)"4632lb # [ 74.451485] niks3-server[1042]: 2026/09/20 09:33:39 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4633client # copying 1 paths...4634worker1 # [ 74.417129] nix-grpc-daemon[774]: ts=2026-09-20T09:33:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=0 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14635worker1 # [ 74.433467] nix-grpc-daemon[774]: ts=2026-09-20T09:33:39Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:343544636worker1 # [ 74.437942] nix-daemon[832]: reaped child process 1161, status = succeeded4637client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4638worker1 # [ 74.462437] nix-grpc-daemon[774]: ts=2026-09-20T09:33:39Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:343544639worker1 # [ 74.468430] nix-grpc-daemon[774]: ts=2026-09-20T09:33:39Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34354 duration_s=0 paths=1 nar_bytes_out=1204640client # [ 74.601160] nix-daemon[943]: reaped child process 1050, status = succeeded4641client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.99 seconds)4642client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24643client # [ 74.820320] nix-daemon[943]: accepted connection from pid 1069, user root (trusted)4644client # this derivation will be built:4645client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4646worker1 # [ 75.017613] nix-grpc-daemon[774]: ts=2026-09-20T09:33:39Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:343544647client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4648worker1 # [ 75.025241] nix-grpc-daemon[774]: ts=2026-09-20T09:33:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343544649worker1 # [ 75.033367] nix-grpc-daemon[842]: time=2026-09-20T09:33:39.665Z level=INFO msg="All 1 paths already cached"4650worker2 # [ 75.052154] nix-grpc-daemon[774]: ts=2026-09-20T09:33:39Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04651worker2 # [ 75.052580] nix-grpc-daemon[774]: ts=2026-09-20T09:33:39Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14652worker2 # [ 75.098597] nix-grpc-daemon[774]: ts=2026-09-20T09:33:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375844653worker2 # [ 75.114349] nix-grpc-daemon[774]: ts=2026-09-20T09:33:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375844654worker2 # [ 75.131142] nix-grpc-daemon[890]: time=2026-09-20T09:33:39.770Z level=INFO msg="All 1 paths already cached"4655client # copying 1 paths to 'lb:50051'...4656client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4657worker2 # [ 75.142288] nix-grpc-daemon[774]: ts=2026-09-20T09:33:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375844658worker2 # [ 75.157156] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4659worker2 # [ 75.363347] nix-daemon[837]: accepted connection from pid 1021, user nix-grpc-daemon (trusted)4660worker2 # [ 75.384241] nix-daemon[837]: reaped child process 1024, status = succeeded4661worker2 # [ 75.556749] nix-daemon[837]: accepted connection from pid 1026, user nix-grpc-daemon (trusted)4662worker2 # [ 75.573913] nix-daemon[837]: reaped child process 1029, status = succeeded4663lb # [ 75.633217] niks3-server[1042]: 2026/09/20 09:33:40 INFO Received uploads request method=POST path=/api/pending_closures4664worker2 # [ 75.597908] nix-grpc-daemon[890]: time=2026-09-20T09:33:40.238Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4665worker2 # [ 75.599390] nix-grpc-daemon[890]: time=2026-09-20T09:33:40.238Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4666lb # [ 75.665384] niks3-server[1042]: 2026/09/20 09:33:40 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4667lb # [ 75.679868] niks3-server[1042]: 2026/09/20 09:33:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4668worker2 # [ 75.639234] nix-grpc-daemon[890]: time=2026-09-20T09:33:40.279Z level=INFO msg="Uploading 1 narinfos"4669lb # [ 75.692339] niks3-server[1042]: 2026/09/20 09:33:40 INFO Signed narinfos id=23 count=14670lb # [ 75.699607] niks3-server[1042]: 2026/09/20 09:33:40 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4671worker2 # [ 75.661997] nix-grpc-daemon[890]: time=2026-09-20T09:33:40.302Z level=INFO msg="Upload complete. (487ms)"4672lb # [ 75.709259] niks3-server[1042]: 2026/09/20 09:33:40 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4673lb # [ 75.715501] niks3-server[1042]: 2026/09/20 09:33:40 INFO Completed upload id=234674lb # [ 75.719064] niks3-server[1042]: 2026/09/20 09:33:40 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4675worker2 # [ 75.668356] nix-grpc-daemon[774]: ts=2026-09-20T09:33:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37584 duration_s=0 paths=1 nar_bytes_in=5684676worker2 # [ 75.681560] nix-grpc-daemon[774]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375844677worker2 # [ 75.689022] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4678worker2 # [ 75.693890] nix-daemon[837]: reaped child process 1019, status = succeeded4679client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4680worker2 # [ 75.707888] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4681client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4682worker2 # [ 76.937963] nix-daemon[837]: reaped child process 1033, status = succeeded4683worker2 # [ 77.104510] nix-daemon[837]: accepted connection from pid 1048, user nix-grpc-daemon (trusted)4684worker2 # [ 77.121698] nix-daemon[837]: reaped child process 1051, status = succeeded4685lb # [ 77.182207] niks3-server[1042]: 2026/09/20 09:33:41 INFO Received uploads request method=POST path=/api/pending_closures4686worker2 # [ 77.146205] nix-grpc-daemon[890]: time=2026-09-20T09:33:41.785Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4687lb # [ 77.215455] niks3-server[1042]: 2026/09/20 09:33:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4688worker2 # [ 77.176401] nix-grpc-daemon[890]: time=2026-09-20T09:33:41.816Z level=INFO msg="Uploading 1 narinfos"4689lb # [ 77.227027] niks3-server[1042]: 2026/09/20 09:33:41 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4690lb # [ 77.237725] niks3-server[1042]: 2026/09/20 09:33:41 INFO Signed narinfos id=24 count=14691worker2 # [ 77.199235] nix-grpc-daemon[890]: time=2026-09-20T09:33:41.839Z level=INFO msg="Upload complete. (281ms)"4692lb # [ 77.246490] niks3-server[1042]: 2026/09/20 09:33:41 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4693lb # [ 77.253385] niks3-server[1042]: 2026/09/20 09:33:41 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4694worker2 # [ 77.206943] nix-grpc-daemon[774]: ts=2026-09-20T09:33:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37584 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14695lb # [ 77.258298] niks3-server[1042]: 2026/09/20 09:33:41 INFO Completed upload id=244696lb # [ 77.261345] niks3-server[1042]: 2026/09/20 09:33:41 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4697worker2 # [ 77.219362] nix-daemon[837]: reaped child process 1031, status = succeeded4698client # copying 1 paths...4699worker2 # [ 77.253749] nix-grpc-daemon[774]: ts=2026-09-20T09:33:41Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:375844700client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4701worker2 # [ 77.287834] nix-grpc-daemon[774]: ts=2026-09-20T09:33:41Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:375844702worker2 # [ 77.293384] nix-grpc-daemon[774]: ts=2026-09-20T09:33:41Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:37584 duration_s=0 paths=1 nar_bytes_out=1204703client # [ 77.422070] nix-daemon[943]: reaped child process 1072, status = succeeded4704client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.82 seconds)4705(finished: subtest: an input only one worker has still reaches the builder, in 10.27 seconds)4706subtest: upload whose reference the worker lacks is completed from the cache4707client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4708client # this derivation will be built:4709client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4710client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4711client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.46 seconds)4712client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4713client # this derivation will be built:4714client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4715client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4716client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.43 seconds)4717client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4718client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds)4719worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4720worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds)4721worker2 # [ 78.833182] systemd[1]: Stopping Nix worker-protocol over gRPC...4722worker2 # [ 79.109596] nix-grpc-daemon[774]: ts=2026-09-20T09:33:43Z level=info event=signal_exit4723worker2 # [ 79.377224] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_yield4724worker2 # [ 79.382749] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_restarting addr=lb:500514725worker2 # [ 79.388293] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:375724726lb # [ 79.431367] niks3-server[1042]: 2026/09/20 09:33:44 INFO lead: released remote=192.168.1.4:330364727worker2 # [ 79.392795] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=worker_gone addr=192.168.1.4:500514728worker1 # [ 79.398393] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_restarting addr=lb:500514729worker2 # [ 79.398633] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:375724730worker2 # [ 79.403200] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=worker_gone addr=192.168.1.3:500514731worker2 # [ 79.583637] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_connected addr=lb:500514732worker2 # [ 79.588929] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4733worker1 # [ 79.598620] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_connected addr=lb:500514734worker1 # [ 79.604160] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4735lb # [ 79.798315] envoy[912]: conn peer=[2001:db8:1::1]:49290 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3845 tx=1880 ms=30344736lb # [ 79.803479] envoy[912]: conn peer=[2001:db8:1::1]:55758 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=724737lb # [ 79.808304] envoy[912]: conn peer=[2001:db8:1::1]:55760 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3696 tx=1805 ms=25074738lb # [ 79.813017] envoy[912]: conn peer=[2001:db8:1::1]:55762 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=724739lb # [ 79.817615] envoy[912]: conn peer=[2001:db8:1::1]:55774 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3727 tx=1821 ms=23344740lb # [ 79.822398] envoy[912]: conn peer=[2001:db8:1::1]:55780 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=664741worker2 # [ 79.789973] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_connected addr=lb:500514742worker2 # [ 79.795139] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4743worker1 # [ 79.805025] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_connected addr=lb:500514744worker1 # [ 79.810293] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4745worker2 # [ 79.995855] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_connected addr=lb:500514746worker2 # [ 80.001104] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4747worker1 # [ 80.011186] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_connected addr=lb:500514748worker1 # [ 80.016572] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4749worker2 # [ 80.203942] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_connected addr=lb:500514750worker2 # [ 80.208117] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4751worker1 # [ 80.217528] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_connected addr=lb:500514752worker1 # [ 80.222896] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4753worker2 # [ 80.383092] nix-grpc-daemon[774]: ts=2026-09-20T09:33:45Z level=info event=scheduler_restarting4754worker1 # [ 80.424092] nix-grpc-daemon[774]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500514755worker1 # [ 80.429193] nix-grpc-daemon[774]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4756worker2 # [ 80.427902] nix-grpc-daemon[774]: ts=2026-09-20T09:33:45Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4757worker2 # [ 80.444983] nix-daemon[837]: reaped child process 839, status = succeeded4758worker1 # [ 80.630030] nix-grpc-daemon[774]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500514759worker1 # [ 80.635305] nix-grpc-daemon[774]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4760worker1 # [ 80.836234] nix-grpc-daemon[774]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500514761worker1 # [ 80.841372] nix-grpc-daemon[774]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4762worker1 # [ 81.042246] nix-grpc-daemon[774]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500514763worker1 # [ 81.047639] nix-grpc-daemon[774]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4764worker2 # [ 81.075771] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4765worker2 # [ 81.080853] systemd[1]: Stopped Nix worker-protocol over gRPC.4766worker2 # [ 81.089050] systemd[1]: nix-grpc-daemon.service: Consumed 1.945s CPU time over 1min 1.317s wall clock time, 54.6M memory peak, 56.3K incoming IP traffic, 103.7K outgoing IP traffic.4767worker2 # [ 81.101881] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4768worker2 # [ 81.106499] systemd[1]: Closed Nix worker-protocol over gRPC.4769worker2 # [ 81.109289] systemd[1]: nix-grpc-daemon.socket: Consumed 575us CPU time over 1min 9.463s wall clock time, 256K memory peak, 73.1K incoming IP traffic, 61.5K outgoing IP traffic.4770lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4771lb: must succeed: curl -sf localhost:9901/clusters4772lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4773lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4774client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24775worker1 # [ 81.248482] nix-grpc-daemon[774]: ts=2026-09-20T09:33:45Z level=info event=scheduler_connected addr=lb:500514776worker1 # [ 81.253702] nix-grpc-daemon[774]: ts=2026-09-20T09:33:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4777worker1 # [ 81.456650] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500514778worker1 # [ 81.460830] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4779worker1 # [ 81.468936] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:343544780client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4781worker1 # [ 81.476339] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:343544782worker1 # [ 81.498261] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=info event=scheduler_take_over4783lb # [ 81.543701] niks3-server[1042]: 2026/09/20 09:33:46 INFO lead: acquired remote=192.168.1.3:370544784client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.29 seconds)4785worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4786worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4787worker2 # [ 81.610308] systemd[1]: Listening on Nix worker-protocol over gRPC.4788worker1 # [ 81.658706] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500514789worker1 # [ 81.663627] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4790worker1 # [ 81.703554] systemd[1]: Stopping Nix worker-protocol over gRPC...4791worker1 # [ 81.859902] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500514792worker1 # [ 81.865136] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4793worker1 # [ 82.065836] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500514794worker1 # [ 82.071001] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4795worker1 # [ 82.108403] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=info event=signal_exit4796worker2 # [ 82.256819] systemd[1]: Starting Nix worker-protocol over gRPC...4797worker1 # [ 82.271698] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=info event=scheduler_connected addr=lb:500514798worker1 # [ 82.277037] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4799worker1 # [ 82.370756] nix-grpc-daemon[774]: ts=2026-09-20T09:33:47Z level=info event=scheduler_yield4800lb # [ 82.423500] niks3-server[1042]: 2026/09/20 09:33:47 INFO lead: released remote=192.168.1.3:370544801worker2 # [ 82.473434] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4802worker2 # [ 82.476867] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14803worker1 # [ 82.479057] nix-grpc-daemon[774]: ts=2026-09-20T09:33:47Z level=info event=scheduler_connected addr=lb:500514804worker1 # [ 82.483931] nix-grpc-daemon[774]: ts=2026-09-20T09:33:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4805worker2 # [ 82.485393] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4806worker2 # [ 82.487192] systemd[1]: Started Nix worker-protocol over gRPC.4807worker2 # [ 82.499304] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:47Z level=info event=scheduler_take_over4808lb # [ 82.547191] niks3-server[1042]: 2026/09/20 09:33:47 INFO lead: acquired remote=192.168.1.4:396384809worker2 # [ 82.531972] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:47Z level=info event=scheduler_connected addr=lb:500514810worker2 # [ 82.536375] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04811worker1 # [ 82.681162] nix-grpc-daemon[774]: ts=2026-09-20T09:33:47Z level=info event=scheduler_connected addr=lb:500514812worker2 # [ 82.681368] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04813worker1 # [ 83.372228] nix-grpc-daemon[774]: ts=2026-09-20T09:33:48Z level=info event=scheduler_restarting4814worker2 # [ 83.380124] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:459764815worker2 # [ 83.380524] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:48Z level=info event=worker_gone addr=192.168.1.3:500514816worker1 # [ 83.409299] nix-grpc-daemon[774]: ts=2026-09-20T09:33:48Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4817worker1 # [ 83.439565] nix-daemon[832]: reaped child process 834, status = succeeded4818worker1 # [ 84.250935] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4819worker1 # [ 84.255510] nix-grpc-daemon[774]: E0000 00:00:1789896828.881533 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true4820worker1 # [ 84.286915] nix-grpc-daemon[774]: E0000 00:00:1789896828.918757 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4821worker1 # [ 84.994060] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4822worker1 # [ 85.000804] systemd[1]: Stopped Nix worker-protocol over gRPC.4823worker1 # [ 85.003379] systemd[1]: nix-grpc-daemon.service: Consumed 3.685s CPU time over 1min 5.233s wall clock time, 59.3M memory peak, 92.7K incoming IP traffic, 168.5K outgoing IP traffic.4824worker1 # [ 85.022686] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4825worker1 # [ 85.025981] systemd[1]: Closed Nix worker-protocol over gRPC.4826worker1 # [ 85.029358] systemd[1]: nix-grpc-daemon.socket: Consumed 624us CPU time over 1min 13.432s wall clock time, 256K memory peak, 79.5K incoming IP traffic, 65K outgoing IP traffic.4827lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4828lb: must succeed: curl -sf localhost:9901/clusters4829lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4830lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4831client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24832worker2 # [ 85.373328] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:459784833worker2 # [ 85.389141] nix-daemon[837]: accepted connection from pid 1072, user nix-grpc-daemon (trusted)4834worker2 # [ 85.418745] nix-grpc-daemon[1072]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 1/5)4835worker2 # [ 85.471673] nix-grpc-daemon[1072]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 57 ms (attempt 2/5)4836worker2 # [ 85.536569] nix-grpc-daemon[1072]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 141 ms (attempt 3/5)4837worker2 # [ 85.685389] nix-grpc-daemon[1072]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 203 ms (attempt 4/5)4838worker2 # [ 85.897021] nix-grpc-daemon[1072]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4839client # copying 2 paths...4840client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4841worker2 # [ 85.924135] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:459784842client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4843worker2 # [ 85.942574] nix-daemon[837]: accepted connection from pid 1072, user nix-grpc-daemon (trusted)4844worker2 # [ 85.971783] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:50Z level=info event=niks3_push_started pid=11284845worker2 # [ 86.366826] nix-daemon[837]: accepted connection from pid 1141, user nix-grpc-daemon (trusted)4846worker2 # [ 86.387016] nix-daemon[837]: reaped child process 1144, status = succeeded4847lb # [ 86.448917] niks3-server[1042]: 2026/09/20 09:33:51 INFO Received uploads request method=POST path=/api/pending_closures4848lb # [ 86.457478] niks3-server[1042]: 2026/09/20 09:33:51 INFO Received uploads request method=POST path=/api/pending_closures4849worker2 # [ 86.420623] nix-grpc-daemon[1128]: time=2026-09-20T09:33:51.059Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4850worker2 # [ 86.422119] nix-grpc-daemon[1128]: time=2026-09-20T09:33:51.059Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4851worker2 # [ 86.423829] nix-grpc-daemon[1128]: time=2026-09-20T09:33:51.060Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4852lb # [ 86.508214] niks3-server[1042]: 2026/09/20 09:33:51 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4853lb # [ 86.521586] niks3-server[1042]: 2026/09/20 09:33:51 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4854lb # [ 86.532461] niks3-server[1042]: 2026/09/20 09:33:51 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4855lb # [ 86.540378] niks3-server[1042]: 2026/09/20 09:33:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4856lb # [ 86.552055] niks3-server[1042]: 2026/09/20 09:33:51 INFO Signed narinfos id=26 count=24857worker2 # [ 86.503843] nix-grpc-daemon[1128]: time=2026-09-20T09:33:51.141Z level=INFO msg="Uploading 3 narinfos"4858lb # [ 86.554308] niks3-server[1042]: 2026/09/20 09:33:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4859lb # [ 86.572239] niks3-server[1042]: 2026/09/20 09:33:51 INFO Signed narinfos id=25 count=14860lb # [ 86.579803] niks3-server[1042]: 2026/09/20 09:33:51 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4861lb # [ 86.589329] niks3-server[1042]: 2026/09/20 09:33:51 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4862lb # [ 86.599683] niks3-server[1042]: 2026/09/20 09:33:51 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4863lb # [ 86.608644] niks3-server[1042]: 2026/09/20 09:33:51 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4864lb # [ 86.615208] niks3-server[1042]: 2026/09/20 09:33:51 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4865lb # [ 86.618051] niks3-server[1042]: 2026/09/20 09:33:51 INFO Completed upload id=254866lb # [ 86.620426] niks3-server[1042]: 2026/09/20 09:33:51 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4867lb # [ 86.623244] niks3-server[1042]: 2026/09/20 09:33:51 INFO Completed upload id=264868worker2 # [ 86.576968] nix-grpc-daemon[1128]: time=2026-09-20T09:33:51.217Z level=INFO msg="Upload complete. (381ms)"4869worker2 # [ 86.589253] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45978 duration_s=0 paths=2 nar_bytes_in=3124870worker2 # [ 86.606591] nix-daemon[837]: reaped child process 1126, status = succeeded4871client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.51 seconds)4872worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4873worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds)4874worker1 # [ 86.751002] systemd[1]: Listening on Nix worker-protocol over gRPC.4875worker1 # [ 86.760791] systemd[1]: Starting Nix worker-protocol over gRPC...4876worker1 # [ 86.963891] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4877worker1 # [ 86.966694] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14878worker1 # [ 86.974814] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4879worker1 # [ 86.998894] systemd[1]: Started Nix worker-protocol over gRPC.4880lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4881lb: must succeed: curl -sf localhost:9901/clusters4882worker1 # [ 87.026271] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:51Z level=info event=scheduler_connected addr=lb:500514883worker2 # [ 87.027382] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04884lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4885lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4886(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.66 seconds)4887subtest: scheduler down: the other node takes the lock and keeps it4888lb: must succeed: curl -sf localhost:9901/clusters4889lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4890lb: must succeed: curl -sf localhost:9901/clusters4891lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4892lb: must succeed: curl -sf localhost:9901/clusters4893lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4894lb: must succeed: curl -sf localhost:9901/clusters4895lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4896worker2 # [ 87.369586] systemd[1]: Stopping Nix worker-protocol over gRPC...4897worker2 # [ 87.489133] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:52Z level=info event=signal_exit4898worker2 # [ 87.500149] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:52Z level=info event=scheduler_yield4899lb # [ 87.554706] niks3-server[1042]: 2026/09/20 09:33:52 INFO lead: released remote=192.168.1.4:396384900worker1 # [ 87.510146] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:52Z level=info event=scheduler_restarting addr=lb:500514901worker2 # [ 87.513104] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:459764902worker2 # [ 87.522297] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:52Z level=info event=worker_gone addr=192.168.1.3:500514903worker2 # [ 87.528506] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:52Z level=info event=scheduler_restarting addr=lb:500514904worker2 # [ 87.532476] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:459764905worker2 # [ 87.536836] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:52Z level=info event=worker_gone addr=192.168.1.4:500514906worker1 # [ 87.711479] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:52Z level=info event=scheduler_connected addr=lb:500514907worker1 # [ 87.716984] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4908worker2 # [ 87.723238] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:52Z level=info event=scheduler_connected addr=lb:500514909worker2 # [ 87.727566] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4910worker1 # [ 87.917964] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:52Z level=info event=scheduler_connected addr=lb:500514911worker1 # [ 87.923307] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4912worker2 # [ 87.923650] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:52Z level=info event=scheduler_connected addr=lb:500514913worker2 # [ 87.929422] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4914worker1 # [ 88.126116] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:52Z level=info event=scheduler_connected addr=lb:500514915worker1 # [ 88.130320] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4916worker2 # [ 88.130620] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:52Z level=info event=scheduler_connected addr=lb:500514917worker2 # [ 88.135926] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4918worker1 # [ 88.326859] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:52Z level=info event=scheduler_connected addr=lb:500514919worker1 # [ 88.332245] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4920worker2 # [ 88.336848] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:52Z level=info event=scheduler_connected addr=lb:500514921worker2 # [ 88.342148] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4922worker2 # [ 88.505941] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:53Z level=info event=scheduler_restarting4923worker2 # [ 88.524888] nix-grpc-daemon[1072]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4924worker1 # [ 88.533194] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:53Z level=info event=scheduler_connected addr=lb:500514925worker2 # [ 88.532626] nix-grpc-daemon[1072]: E0000 00:00:1789896833.164947 1115 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4926worker1 # [ 88.538599] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4927worker2 # [ 88.564782] nix-grpc-daemon[1072]: E0000 00:00:1789896833.165360 1115 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4928worker2 # [ 88.573487] nix-grpc-daemon[1072]: ts=2026-09-20T09:33:53Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4929worker2 # [ 88.578125] nix-daemon[837]: reaped child process 1121, status = succeeded4930worker1 # [ 88.739524] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:53Z level=info event=scheduler_connected addr=lb:500514931worker1 # [ 88.745012] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4932worker1 # [ 88.945861] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:53Z level=info event=scheduler_connected addr=lb:500514933worker1 # [ 88.951189] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4934worker1 # [ 89.154231] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:53Z level=info event=scheduler_connected addr=lb:500514935worker1 # [ 89.158486] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4936worker1 # [ 89.355165] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:53Z level=info event=scheduler_connected addr=lb:500514937worker1 # [ 89.360640] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4938worker1 # [ 89.561461] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:54Z level=info event=scheduler_connected addr=lb:500514939worker1 # [ 89.566768] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4940lb # [ 89.803425] envoy[912]: conn peer=[2001:db8:1::4]:54444 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9301 tx=2574 ms=602804941lb # [ 89.808618] envoy[912]: conn peer=[2001:db8:1::1]:40364 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=224942worker1 # [ 89.767470] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:54Z level=info event=scheduler_connected addr=lb:500514943lb # [ 89.814885] envoy[912]: conn peer=[2001:db8:1::3]:52400 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=12190 tx=3351 ms=632564944worker1 # [ 89.772825] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4945lb # [ 89.820364] envoy[912]: conn peer=[2001:db8:1::1]:40376 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1005 tx=305 ms=12304946lb # [ 89.825206] envoy[912]: conn peer=[2001:db8:1::4]:59220 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1003 tx=326 ms=60254947worker1 # [ 89.973598] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:54Z level=info event=scheduler_connected addr=lb:500514948worker1 # [ 89.979582] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4949worker1 # [ 90.182077] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:54Z level=info event=scheduler_connected addr=lb:500514950worker1 # [ 90.186277] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4951worker1 # [ 90.382930] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:55Z level=info event=scheduler_connected addr=lb:500514952worker1 # [ 90.388249] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4953worker2 # [ 90.525255] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4954worker2 # [ 90.531503] systemd[1]: Stopped Nix worker-protocol over gRPC.4955worker2 # [ 90.534956] systemd[1]: nix-grpc-daemon.service: Consumed 493ms CPU time over 8.265s wall clock time, 33.6M memory peak, 17.5K incoming IP traffic, 21.6K outgoing IP traffic.4956worker2 # [ 90.548620] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4957worker2 # [ 90.550628] systemd[1]: Closed Nix worker-protocol over gRPC.4958worker2 # [ 90.553654] systemd[1]: nix-grpc-daemon.socket: Consumed 777us CPU time over 8.946s wall clock time, 256K memory peak, 18.7K incoming IP traffic, 13.9K outgoing IP traffic.4959worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4960worker1 # [ 90.589205] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:55Z level=info event=scheduler_connected addr=lb:500514961worker1 # [ 90.599846] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4962worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.09 seconds)4963worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4964worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)4965worker1 # [ 90.797974] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:55Z level=info event=scheduler_connected addr=lb:500514966worker1 # [ 90.803264] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4967worker1 # [ 91.004797] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:55Z level=info event=scheduler_connected addr=lb:500514968worker1 # [ 91.010392] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4969worker1 # [ 91.212831] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:55Z level=info event=scheduler_connected addr=lb:500514970worker1 # [ 91.216966] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4971worker1 # [ 91.413575] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:56Z level=info event=scheduler_connected addr=lb:500514972worker1 # [ 91.418757] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4973worker1 # [ 91.619659] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:56Z level=info event=scheduler_connected addr=lb:500514974worker1 # [ 91.625028] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4975worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4976worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)4977worker1 # [ 91.825854] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:56Z level=info event=scheduler_connected addr=lb:500514978worker1 # [ 91.831484] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4979lb # [ 92.034357] niks3-server[1042]: 2026/09/20 09:33:56 INFO lead: acquired remote=192.168.1.3:468884980worker1 # [ 91.990814] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:56Z level=info event=scheduler_take_over4981worker1 # [ 92.032177] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:56Z level=info event=scheduler_connected addr=lb:500514982worker1 # [ 92.041521] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:56Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04983worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4984worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)4985client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24986worker1 # [ 93.145241] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:568664987worker1 # [ 93.160400] nix-daemon[832]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)4988client # don't know how to build these paths:4989client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4990worker1 # [ 93.179588] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:568664991worker1 # [ 93.197325] nix-grpc-daemon[1204]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 24 ms (attempt 1/5)4992worker1 # [ 93.228850] nix-grpc-daemon[1204]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 179 ms (attempt 2/5)4993worker1 # [ 93.415578] nix-grpc-daemon[1204]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 217 ms (attempt 3/5)4994worker1 # [ 93.632854] nix-grpc-daemon[1204]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 704 ms (attempt 4/5)4995worker1 # [ 94.346379] nix-grpc-daemon[1204]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4996worker1 # [ 94.382199] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:59Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04997worker1 # [ 94.389537] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:59Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14998worker1 # [ 94.428617] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568664999worker1 # [ 94.445709] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:568665000client # copying 1 paths to 'lb:50051'...5001client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...5002worker1 # [ 94.461497] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:568665003worker1 # [ 94.477136] nix-daemon[832]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5004worker1 # [ 94.504484] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:59Z level=info event=niks3_push_started pid=12835005worker1 # [ 94.894192] nix-daemon[832]: accepted connection from pid 1296, user nix-grpc-daemon (trusted)5006worker1 # [ 94.911881] nix-daemon[832]: reaped child process 1299, status = succeeded5007worker1 # [ 95.090524] nix-daemon[832]: accepted connection from pid 1301, user nix-grpc-daemon (trusted)5008worker1 # [ 95.107154] nix-daemon[832]: reaped child process 1304, status = succeeded5009lb # [ 95.167709] niks3-server[1042]: 2026/09/20 09:33:59 INFO Received uploads request method=POST path=/api/pending_closures5010worker1 # [ 95.136450] nix-grpc-daemon[1283]: time=2026-09-20T09:33:59.767Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5011worker1 # [ 95.137944] nix-grpc-daemon[1283]: time=2026-09-20T09:33:59.767Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"5012lb # [ 95.206884] niks3-server[1042]: 2026/09/20 09:33:59 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst5013worker1 # [ 95.179159] nix-grpc-daemon[1283]: time=2026-09-20T09:33:59.810Z level=INFO msg="Uploading 1 narinfos"5014lb # [ 95.223161] niks3-server[1042]: 2026/09/20 09:33:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5015lb # [ 95.236818] niks3-server[1042]: 2026/09/20 09:33:59 INFO Signed narinfos id=27 count=15016lb # [ 95.247349] niks3-server[1042]: 2026/09/20 09:33:59 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls5017worker1 # [ 95.213747] nix-grpc-daemon[1283]: time=2026-09-20T09:33:59.845Z level=INFO msg="Upload complete. (490ms)"5018lb # [ 95.260150] niks3-server[1042]: 2026/09/20 09:33:59 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5019lb # [ 95.265841] niks3-server[1042]: 2026/09/20 09:33:59 INFO Completed upload id=275020worker1 # [ 95.223802] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56866 duration_s=0 paths=1 nar_bytes_in=5205021worker1 # [ 95.232996] nix-grpc-daemon[1204]: ts=2026-09-20T09:33:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568665022worker1 # [ 95.239828] nix-grpc-daemon[1283]: time=2026-09-20T09:33:59.864Z level=WARN msg="Failed to register uploaded object" key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo error="server returned 404: object is not pending upload\n"5023worker1 # [ 95.249071] nix-daemon[832]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5024worker1 # [ 95.252404] nix-daemon[832]: reaped child process 1281, status = succeeded5025client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5026worker1 # [ 95.261595] nix-daemon[832]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5027client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5028client # farm-a> LOG-farm-a-on-standby5029worker1 # [ 96.503284] nix-daemon[832]: reaped child process 1308, status = succeeded5030worker1 # [ 96.697194] nix-daemon[832]: accepted connection from pid 1323, user nix-grpc-daemon (trusted)5031worker1 # [ 96.716798] nix-daemon[832]: reaped child process 1326, status = succeeded5032lb # [ 96.773648] niks3-server[1042]: 2026/09/20 09:34:01 INFO Received uploads request method=POST path=/api/pending_closures5033worker1 # [ 96.748390] nix-grpc-daemon[1283]: time=2026-09-20T09:34:01.376Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5034worker1 # [ 96.749923] nix-grpc-daemon[1283]: time=2026-09-20T09:34:01.376Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5035lb # [ 96.835438] niks3-server[1042]: 2026/09/20 09:34:01 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5036worker1 # [ 96.802795] nix-grpc-daemon[1283]: time=2026-09-20T09:34:01.433Z level=INFO msg="Uploading 1 narinfos"5037lb # [ 96.844654] niks3-server[1042]: 2026/09/20 09:34:01 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5038lb # [ 96.855869] niks3-server[1042]: 2026/09/20 09:34:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5039lb # [ 96.862440] niks3-server[1042]: 2026/09/20 09:34:01 INFO Signed narinfos id=28 count=15040lb # [ 96.870440] niks3-server[1042]: 2026/09/20 09:34:01 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5041lb # [ 96.874125] niks3-server[1042]: 2026/09/20 09:34:01 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5042lb # [ 96.878464] niks3-server[1042]: 2026/09/20 09:34:01 INFO Completed upload id=285043lb # [ 96.881167] niks3-server[1042]: 2026/09/20 09:34:01 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5044worker1 # [ 96.825887] nix-grpc-daemon[1283]: time=2026-09-20T09:34:01.457Z level=INFO msg="Upload complete. (351ms)"5045worker1 # [ 96.850508] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56866 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15046worker1 # [ 96.868327] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:01Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05047worker1 # [ 96.872432] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:01Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=15048worker1 # [ 96.876064] nix-daemon[832]: reaped child process 1306, status = succeeded5049worker1 # [ 96.897581] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568665050worker1 # [ 96.915213] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:568665051worker1 # [ 96.932374] nix-grpc-daemon[1283]: time=2026-09-20T09:34:01.564Z level=INFO msg="All 1 paths already cached"5052client # copying 1 paths to 'lb:50051'...5053client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5054worker1 # [ 96.943624] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:568665055worker1 # [ 96.958846] nix-daemon[832]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5056worker1 # [ 97.168408] nix-daemon[832]: accepted connection from pid 1332, user nix-grpc-daemon (trusted)5057worker1 # [ 97.189218] nix-daemon[832]: reaped child process 1335, status = succeeded5058worker1 # [ 97.373952] nix-daemon[832]: accepted connection from pid 1337, user nix-grpc-daemon (trusted)5059worker1 # [ 97.393562] nix-daemon[832]: reaped child process 1340, status = succeeded5060lb # [ 97.451432] niks3-server[1042]: 2026/09/20 09:34:02 INFO Received uploads request method=POST path=/api/pending_closures5061worker1 # [ 97.418249] nix-grpc-daemon[1283]: time=2026-09-20T09:34:02.049Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5062worker1 # [ 97.419795] nix-grpc-daemon[1283]: time=2026-09-20T09:34:02.049Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5063lb # [ 97.485113] niks3-server[1042]: 2026/09/20 09:34:02 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5064worker1 # [ 97.455651] nix-grpc-daemon[1283]: time=2026-09-20T09:34:02.087Z level=INFO msg="Uploading 1 narinfos"5065lb # [ 97.501398] niks3-server[1042]: 2026/09/20 09:34:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5066lb # [ 97.513376] niks3-server[1042]: 2026/09/20 09:34:02 INFO Signed narinfos id=29 count=15067lb # [ 97.519773] niks3-server[1042]: 2026/09/20 09:34:02 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5068lb # [ 97.525552] niks3-server[1042]: 2026/09/20 09:34:02 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5069lb # [ 97.534263] niks3-server[1042]: 2026/09/20 09:34:02 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5070lb # [ 97.541343] niks3-server[1042]: 2026/09/20 09:34:02 INFO Completed upload id=295071worker1 # [ 97.497108] nix-grpc-daemon[1283]: time=2026-09-20T09:34:02.129Z level=INFO msg="Upload complete. (522ms)"5072worker1 # [ 97.506335] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56866 duration_s=0 paths=1 nar_bytes_in=6405073worker1 # [ 97.523808] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568665074worker1 # [ 97.531176] nix-daemon[832]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5075worker1 # [ 97.536849] nix-daemon[832]: reaped child process 1330, status = succeeded5076client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5077client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5078worker1 # [ 97.551658] nix-daemon[832]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5079client # farm-b> LOG-farm-b-on-standby5080worker1 # [ 98.375131] nix-daemon[832]: reaped child process 1344, status = succeeded5081worker1 # [ 98.543034] nix-daemon[832]: accepted connection from pid 1359, user nix-grpc-daemon (trusted)5082worker1 # [ 98.563730] nix-daemon[832]: reaped child process 1362, status = succeeded5083lb # [ 98.621626] niks3-server[1042]: 2026/09/20 09:34:03 INFO Received uploads request method=POST path=/api/pending_closures5084worker1 # [ 98.597381] nix-grpc-daemon[1283]: time=2026-09-20T09:34:03.228Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5085worker1 # [ 98.598897] nix-grpc-daemon[1283]: time=2026-09-20T09:34:03.228Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5086lb # [ 98.676562] niks3-server[1042]: 2026/09/20 09:34:03 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5087lb # [ 98.695768] niks3-server[1042]: 2026/09/20 09:34:03 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5088lb # [ 98.702929] niks3-server[1042]: 2026/09/20 09:34:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5089worker1 # [ 98.664185] nix-grpc-daemon[1283]: time=2026-09-20T09:34:03.295Z level=INFO msg="Uploading 1 narinfos"5090lb # [ 98.710687] niks3-server[1042]: 2026/09/20 09:34:03 INFO Signed narinfos id=30 count=15091lb # [ 98.720407] niks3-server[1042]: 2026/09/20 09:34:03 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5092lb # [ 98.732572] niks3-server[1042]: 2026/09/20 09:34:03 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5093lb # [ 98.737895] niks3-server[1042]: 2026/09/20 09:34:03 INFO Completed upload id=305094worker1 # [ 98.693182] nix-grpc-daemon[1283]: time=2026-09-20T09:34:03.325Z level=INFO msg="Upload complete. (331ms)"5095worker1 # [ 98.709281] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56866 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15096worker1 # [ 98.732313] nix-grpc-daemon[1283]: time=2026-09-20T09:34:03.336Z level=WARN msg="Failed to register uploaded object" key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo error="server returned 404: object is not pending upload\n"5097worker1 # [ 98.738976] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:03Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05098worker1 # [ 98.743031] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:03Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15099worker1 # [ 98.747271] nix-daemon[832]: reaped child process 1342, status = succeeded5100worker1 # [ 98.768382] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568665101worker1 # [ 98.783930] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:568665102worker1 # [ 98.804663] nix-grpc-daemon[1283]: time=2026-09-20T09:34:03.436Z level=INFO msg="All 2 paths already cached"5103client # copying 1 paths to 'lb:50051'...5104client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5105worker1 # [ 98.817025] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:568665106worker1 # [ 98.831077] nix-daemon[832]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5107worker1 # [ 99.034793] nix-daemon[832]: accepted connection from pid 1368, user nix-grpc-daemon (trusted)5108worker1 # [ 99.056228] nix-daemon[832]: reaped child process 1371, status = succeeded5109worker1 # [ 99.232714] nix-daemon[832]: accepted connection from pid 1373, user nix-grpc-daemon (trusted)5110worker1 # [ 99.250685] nix-daemon[832]: reaped child process 1376, status = succeeded5111lb # [ 99.308541] niks3-server[1042]: 2026/09/20 09:34:03 INFO Received uploads request method=POST path=/api/pending_closures5112worker1 # [ 99.277303] nix-grpc-daemon[1283]: time=2026-09-20T09:34:03.908Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5113worker1 # [ 99.278966] nix-grpc-daemon[1283]: time=2026-09-20T09:34:03.909Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5114lb # [ 99.356380] niks3-server[1042]: 2026/09/20 09:34:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5115worker1 # [ 99.319764] nix-grpc-daemon[1283]: time=2026-09-20T09:34:03.951Z level=INFO msg="Uploading 1 narinfos"5116lb # [ 99.367298] niks3-server[1042]: 2026/09/20 09:34:04 INFO Signed narinfos id=31 count=15117lb # [ 99.374507] niks3-server[1042]: 2026/09/20 09:34:04 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5118lb # [ 99.381323] niks3-server[1042]: 2026/09/20 09:34:04 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5119lb # [ 99.389501] niks3-server[1042]: 2026/09/20 09:34:04 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5120lb # [ 99.393891] niks3-server[1042]: 2026/09/20 09:34:04 INFO Completed upload id=315121worker1 # [ 99.349505] nix-grpc-daemon[1283]: time=2026-09-20T09:34:03.981Z level=INFO msg="Upload complete. (501ms)"5122lb # [ 99.396329] niks3-server[1042]: 2026/09/20 09:34:04 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5123worker1 # [ 99.358701] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56866 duration_s=0 paths=1 nar_bytes_in=7685124worker1 # [ 99.372593] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568665125worker1 # [ 99.380536] nix-daemon[832]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5126worker1 # [ 99.385593] nix-daemon[832]: reaped child process 1366, status = succeeded5127client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5128client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5129worker1 # [ 99.400167] nix-daemon[832]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5130client # farm-top> LOG-farm-top-on-standby5131worker1 # [ 100.425755] nix-daemon[832]: reaped child process 1380, status = succeeded5132worker1 # [ 100.589366] nix-daemon[832]: accepted connection from pid 1395, user nix-grpc-daemon (trusted)5133worker1 # [ 100.607812] nix-daemon[832]: reaped child process 1398, status = succeeded5134lb # [ 100.665061] niks3-server[1042]: 2026/09/20 09:34:05 INFO Received uploads request method=POST path=/api/pending_closures5135worker1 # [ 100.633708] nix-grpc-daemon[1283]: time=2026-09-20T09:34:05.263Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5136worker1 # [ 100.635270] nix-grpc-daemon[1283]: time=2026-09-20T09:34:05.263Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5137lb # [ 100.703493] niks3-server[1042]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5138worker1 # [ 100.673232] nix-grpc-daemon[1283]: time=2026-09-20T09:34:05.304Z level=INFO msg="Uploading 1 narinfos"5139lb # [ 100.718302] niks3-server[1042]: 2026/09/20 09:34:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5140lb # [ 100.727056] niks3-server[1042]: 2026/09/20 09:34:05 INFO Signed narinfos id=32 count=15141lb # [ 100.733203] niks3-server[1042]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5142lb # [ 100.739386] niks3-server[1042]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5143lb # [ 100.748191] niks3-server[1042]: 2026/09/20 09:34:05 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5144lb # [ 100.752456] niks3-server[1042]: 2026/09/20 09:34:05 INFO Completed upload id=325145worker1 # [ 100.708171] nix-grpc-daemon[1283]: time=2026-09-20T09:34:05.340Z level=INFO msg="Upload complete. (298ms)"5146lb # [ 100.754793] niks3-server[1042]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5147worker1 # [ 100.720874] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56866 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15148worker1 # [ 100.735817] nix-daemon[832]: reaped child process 1378, status = succeeded5149client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 7.88 seconds)5150client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5151client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.23 seconds)5152worker2 # [ 101.086499] systemd[1]: Listening on Nix worker-protocol over gRPC.5153worker2 # [ 101.095157] systemd[1]: Starting Nix worker-protocol over gRPC...5154worker2 # [ 101.291993] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:05Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5155worker2 # [ 101.294886] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:05Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15156worker2 # [ 101.302444] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:05Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5157worker2 # [ 101.310594] systemd[1]: Started Nix worker-protocol over gRPC.5158lb: must succeed: curl -sf localhost:9901/clusters5159worker2 # [ 101.344186] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:05Z level=info event=scheduler_connected addr=lb:500515160worker1 # [ 101.349591] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:05Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05161lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5162worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5163worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5164lb: must succeed: curl -sf localhost:9901/clusters5165lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)5166lb: must succeed: curl -sf localhost:9901/clusters5167lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5168worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5169worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5170(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.67 seconds)5171subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5172client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5173client # [ 101.835472] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5174client # Running as unit: rs.service; invocation ID: 40a273238f6e4d4387068553421c001a5175client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5176client # [ 102.083484] nix[1172]: don't know how to build these paths:5177client # [ 102.084624] nix[1172]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5178worker1 # [ 102.083878] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:568665179worker1 # [ 102.098457] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:06Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05180worker1 # [ 102.105587] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:06Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15181worker1 # [ 102.144898] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568665182worker1 # [ 102.161116] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:568665183client # [ 102.172684] nix[1172]: copying 1 paths to 'lb:50051'...5184client # [ 102.176876] nix[1172]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5185worker1 # [ 102.178788] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:568665186worker1 # [ 102.193961] nix-daemon[832]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5187worker1 # [ 102.405231] nix-daemon[832]: accepted connection from pid 1413, user nix-grpc-daemon (trusted)5188worker1 # [ 102.424430] nix-daemon[832]: reaped child process 1416, status = succeeded5189worker1 # [ 102.603409] nix-daemon[832]: accepted connection from pid 1418, user nix-grpc-daemon (trusted)5190worker1 # [ 102.623586] nix-daemon[832]: reaped child process 1421, status = succeeded5191lb # [ 102.680789] niks3-server[1042]: 2026/09/20 09:34:07 INFO Received uploads request method=POST path=/api/pending_closures5192worker1 # [ 102.647124] nix-grpc-daemon[1283]: time=2026-09-20T09:34:07.278Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5193worker1 # [ 102.648796] nix-grpc-daemon[1283]: time=2026-09-20T09:34:07.278Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5194lb # [ 102.715266] niks3-server[1042]: 2026/09/20 09:34:07 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5195worker1 # [ 102.683501] nix-grpc-daemon[1283]: time=2026-09-20T09:34:07.315Z level=INFO msg="Uploading 1 narinfos"5196lb # [ 102.731120] niks3-server[1042]: 2026/09/20 09:34:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5197lb # [ 102.740177] niks3-server[1042]: 2026/09/20 09:34:07 INFO Signed narinfos id=33 count=15198lb # [ 102.744382] niks3-server[1042]: 2026/09/20 09:34:07 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5199lb # [ 102.752072] niks3-server[1042]: 2026/09/20 09:34:07 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5200lb # [ 102.756981] niks3-server[1042]: 2026/09/20 09:34:07 INFO Completed upload id=335201worker1 # [ 102.712008] nix-grpc-daemon[1283]: time=2026-09-20T09:34:07.344Z level=INFO msg="Upload complete. (501ms)"5202lb # [ 102.760301] niks3-server[1042]: 2026/09/20 09:34:07 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5203worker1 # [ 102.720159] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56866 duration_s=0 paths=1 nar_bytes_in=4165204worker1 # [ 102.735601] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:568665205worker1 # [ 102.739814] nix-daemon[832]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5206worker1 # [ 102.745437] nix-daemon[832]: reaped child process 1411, status = succeeded5207worker1 # [ 102.754550] nix-daemon[832]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5208client # [ 102.752674] nix[1172]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5209lb: must succeed: curl -sf localhost:9901/clusters5210lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5211lb: must succeed: curl -sf localhost:9901/clusters5212lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5213lb: must succeed: curl -sf localhost:9901/clusters5214lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5215lb: must succeed: curl -sf localhost:9901/clusters5216lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5217worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5218worker2 # [ 104.823327] systemd-journald[274]: Received client request to rotate journal, rotating.5219worker2 # [ 104.846205] systemd-journald[274]: Vacuuming done, freed 0B of archived journals from /var/log/journal/83cd007e1e244591b9869bac6c24c471.5220worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)5221worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5222worker1 # [ 104.905092] systemd[1]: Stopping Nix worker-protocol over gRPC...5223worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5224??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5225 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735226client: must succeed: sleep 5.05227worker1 # [ 104.987738] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:09Z level=info event=draining5228lb # [ 109.803326] envoy[912]: conn peer=[2001:db8:1::1]:36940 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9580 tx=3862 ms=75935229client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5230worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5231worker1 # [ 110.407704] nix-daemon[832]: reaped child process 1425, status = succeeded5232worker1 # [ 110.592902] nix-daemon[832]: accepted connection from pid 1465, user nix-grpc-daemon (trusted)5233worker1 # [ 110.611069] nix-daemon[832]: reaped child process 1468, status = succeeded5234lb # [ 110.669980] niks3-server[1042]: 2026/09/20 09:34:15 INFO Received uploads request method=POST path=/api/pending_closures5235worker1 # [ 110.639471] nix-grpc-daemon[1283]: time=2026-09-20T09:34:15.268Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5236worker1 # [ 110.641368] nix-grpc-daemon[1283]: time=2026-09-20T09:34:15.268Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5237lb # [ 110.715778] niks3-server[1042]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5238lb # [ 110.728891] niks3-server[1042]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5239lb # [ 110.736896] niks3-server[1042]: 2026/09/20 09:34:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5240worker1 # [ 110.698157] nix-grpc-daemon[1283]: time=2026-09-20T09:34:15.329Z level=INFO msg="Uploading 1 narinfos"5241lb # [ 110.745864] niks3-server[1042]: 2026/09/20 09:34:15 INFO Signed narinfos id=34 count=15242lb # [ 110.747984] niks3-server[1042]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5243lb # [ 110.756527] niks3-server[1042]: 2026/09/20 09:34:15 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5244lb # [ 110.763950] niks3-server[1042]: 2026/09/20 09:34:15 INFO Completed upload id=345245worker1 # [ 110.719606] nix-grpc-daemon[1283]: time=2026-09-20T09:34:15.351Z level=INFO msg="Upload complete. (347ms)"5246lb # [ 110.766654] niks3-server[1042]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5247worker1 # [ 110.733211] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56866 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15248worker1 # [ 110.751254] nix-daemon[832]: reaped child process 1423, status = succeeded5249client # [ 110.773144] systemd[1]: rs.service: Deactivated successfully.5250client # [ 110.777529] systemd[1]: rs.service: Consumed 164ms CPU time over 8.941s wall clock time, 39.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5251worker1 # [ 110.990374] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:15Z level=info event=signal_exit5252worker1 # [ 111.016115] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:15Z level=info event=scheduler_yield5253lb # [ 111.064482] niks3-server[1042]: 2026/09/20 09:34:15 INFO lead: released remote=192.168.1.3:468885254worker1 # [ 111.025966] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:15Z level=info event=scheduler_restarting addr=lb:500515255worker2 # [ 111.025554] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:15Z level=info event=scheduler_restarting addr=lb:500515256worker1 # [ 111.031339] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:568525257worker1 # [ 111.035940] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:15Z level=info event=worker_gone addr=192.168.1.4:500515258worker1 # [ 111.039996] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:568525259worker1 # [ 111.046213] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:15Z level=info event=worker_gone addr=192.168.1.3:500515260worker1 # [ 111.227383] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:15Z level=info event=scheduler_connected addr=lb:500515261worker2 # [ 111.225585] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:15Z level=info event=scheduler_connected addr=lb:500515262worker1 # [ 111.233084] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5263worker2 # [ 111.231054] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5264lb # [ 111.360458] niks3-server[1042]: 2026/09/20 09:34:16 INFO lead: acquired remote=192.168.1.4:397065265worker2 # [ 111.318284] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:15Z level=info event=scheduler_take_over5266worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.13 seconds)5267client: waiting for success: ! systemctl is-active rs5268worker1 # [ 111.433868] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:16Z level=info event=scheduler_connected addr=lb:500515269worker2 # [ 111.431832] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:16Z level=info event=scheduler_connected addr=lb:500515270worker2 # [ 111.437225] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5271worker1 # [ 111.439392] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5272client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5273client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5274client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5275client: must fail: journalctl -u rs | grep -q 'reconnecting'5276client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5277lb: must succeed: curl -sf localhost:9901/clusters5278worker2 # [ 111.637798] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:16Z level=info event=scheduler_connected addr=lb:500515279worker1 # [ 111.640125] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:16Z level=info event=scheduler_connected addr=lb:500515280worker2 # [ 111.643098] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5281worker1 # [ 111.645316] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5282lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5283worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5284worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5285worker2 # [ 111.844090] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:16Z level=info event=scheduler_connected addr=lb:500515286worker1 # [ 111.847541] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:16Z level=info event=scheduler_connected addr=lb:500515287worker2 # [ 111.849404] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5288worker1 # [ 111.852443] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5289worker1 # [ 112.022146] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:16Z level=info event=scheduler_restarting5290worker2 # [ 112.052431] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:16Z level=info event=scheduler_connected addr=lb:500515291worker2 # [ 112.056538] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5292worker1 # [ 112.071214] nix-grpc-daemon[1204]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5293worker1 # [ 112.079415] nix-grpc-daemon[1204]: E0000 00:00:1789896856.684720 1247 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5294worker1 # [ 112.090087] nix-grpc-daemon[1204]: E0000 00:00:1789896856.684912 1247 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5295worker1 # [ 112.095967] nix-grpc-daemon[1204]: ts=2026-09-20T09:34:16Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5296worker1 # [ 112.101152] nix-daemon[832]: reaped child process 1274, status = succeeded5297worker2 # [ 112.252882] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:16Z level=info event=scheduler_connected addr=lb:500515298worker2 # [ 112.258139] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5299worker2 # [ 112.459069] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:17Z level=info event=scheduler_connected addr=lb:500515300worker2 # [ 112.464550] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5301worker2 # [ 112.665293] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:17Z level=info event=scheduler_connected addr=lb:500515302worker2 # [ 112.675628] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05303lb: must succeed: curl -sf localhost:9901/clusters5304lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5305worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5306worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5307worker1 # [ 113.555621] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5308worker1 # [ 113.562187] systemd[1]: Stopped Nix worker-protocol over gRPC.5309worker1 # [ 113.567643] systemd[1]: nix-grpc-daemon.service: Consumed 1.850s CPU time over 26.799s wall clock time, 36.6M memory peak, 48.7K incoming IP traffic, 91.8K outgoing IP traffic.5310worker1 # [ 113.585552] systemd[1]: Starting Nix worker-protocol over gRPC...5311worker1 # [ 113.782564] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:18Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5312worker1 # [ 113.785733] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:18Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15313worker1 # [ 113.793196] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:18Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5314worker1 # [ 113.794994] systemd[1]: Started Nix worker-protocol over gRPC.5315worker1 # [ 113.829684] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:18Z level=info event=scheduler_connected addr=lb:500515316worker2 # [ 113.831195] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:18Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05317lb: must succeed: curl -sf localhost:9901/clusters5318lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5319worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5320worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5321(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.31 seconds)5322subtest: scheduler restart mid-build: build finishes, no double build5323client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5324client # [ 114.145009] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5325client # Running as unit: mid.service; invocation ID: d7027e2f833b4ffcb95aba4dcd380f485326client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)5327worker2 # [ 114.392601] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:365245328worker2 # [ 114.408005] nix-daemon[837]: accepted connection from pid 1165, user nix-grpc-daemon (trusted)5329client # [ 114.427626] nix[1208]: don't know how to build these paths:5330client # [ 114.429225] nix[1208]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5331worker2 # [ 114.441255] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:19Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05332worker2 # [ 114.448444] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:19Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15333worker2 # [ 114.486548] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365245334worker2 # [ 114.504642] nix-grpc-daemon[1165]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 1/5)5335worker2 # [ 114.602309] nix-grpc-daemon[1165]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 2/5)5336worker2 # [ 114.612793] nix-grpc-daemon[1165]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 169 ms (attempt 3/5)5337worker2 # [ 114.789510] nix-grpc-daemon[1165]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 211 ms (attempt 4/5)5338worker2 # [ 115.009931] nix-grpc-daemon[1165]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5339worker2 # [ 115.031576] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365245340client # [ 115.048250] nix[1208]: copying 1 paths to 'lb:50051'...5341worker2 # [ 115.047978] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365245342client # [ 115.048580] nix[1208]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5343worker2 # [ 115.065344] nix-daemon[837]: accepted connection from pid 1165, user nix-grpc-daemon (trusted)5344worker2 # [ 115.095135] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:19Z level=info event=niks3_push_started pid=12885345worker2 # [ 115.504005] nix-daemon[837]: accepted connection from pid 1301, user nix-grpc-daemon (trusted)5346worker2 # [ 115.529957] nix-daemon[837]: reaped child process 1308, status = succeeded5347worker2 # [ 115.708910] nix-daemon[837]: accepted connection from pid 1310, user nix-grpc-daemon (trusted)5348worker2 # [ 115.727827] nix-daemon[837]: reaped child process 1313, status = succeeded5349lb # [ 115.787503] niks3-server[1042]: 2026/09/20 09:34:20 INFO Received uploads request method=POST path=/api/pending_closures5350worker2 # [ 115.751887] nix-grpc-daemon[1288]: time=2026-09-20T09:34:20.390Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5351worker2 # [ 115.753766] nix-grpc-daemon[1288]: time=2026-09-20T09:34:20.390Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5352lb # [ 115.820906] niks3-server[1042]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5353lb # [ 115.833986] niks3-server[1042]: 2026/09/20 09:34:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5354worker2 # [ 115.795662] nix-grpc-daemon[1288]: time=2026-09-20T09:34:20.435Z level=INFO msg="Uploading 1 narinfos"5355lb # [ 115.845939] niks3-server[1042]: 2026/09/20 09:34:20 INFO Signed narinfos id=35 count=15356lb # [ 115.853719] niks3-server[1042]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5357lb # [ 115.867672] niks3-server[1042]: 2026/09/20 09:34:20 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5358lb # [ 115.873063] niks3-server[1042]: 2026/09/20 09:34:20 INFO Completed upload id=355359worker2 # [ 115.826474] nix-grpc-daemon[1288]: time=2026-09-20T09:34:20.466Z level=INFO msg="Upload complete. (508ms)"5360lb # [ 115.876051] niks3-server[1042]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5361worker2 # [ 115.836295] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36524 duration_s=0 paths=1 nar_bytes_in=4245362worker2 # [ 115.847044] nix-grpc-daemon[1165]: ts=2026-09-20T09:34:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365245363worker2 # [ 115.853695] nix-daemon[837]: accepted connection from pid 1165, user nix-grpc-daemon (trusted)5364worker2 # [ 115.858805] nix-daemon[837]: reaped child process 1286, status = succeeded5365client # [ 115.870650] nix[1208]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5366worker2 # [ 115.871558] nix-daemon[837]: accepted connection from pid 1165, user nix-grpc-daemon (trusted)5367lb: must succeed: curl -sf localhost:9901/clusters5368lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5369lb: must succeed: curl -sf localhost:9901/clusters5370lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5371worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5372worker2 # [ 118.174578] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1165 (nix-grpc-daemon) on client request.5373worker2 # [ 118.176615] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5374lb # [ 118.238052] niks3-server[1042]: 2026/09/20 09:34:22 INFO lead: released remote=192.168.1.4:397065375worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds)5376client: must succeed: sleep 5.05377client # [ 118.211438] nix[1208]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5378worker1 # [ 118.212519] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5379client # [ 118.218249] nix[1208]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5380worker2 # [ 118.224449] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5381worker2 # [ 118.226082] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5382worker2 # [ 118.227308] systemd[1]: nix-grpc-daemon.service: Consumed 586ms CPU time over 17.127s wall clock time, 34M memory peak, 15K incoming IP traffic, 23.2K outgoing IP traffic.5383worker2 # [ 118.245565] nix-daemon[837]: reaped child process 1315, status = succeeded5384worker2 # [ 118.247360] nix-daemon[837]: reaped child process 1279, status = succeeded5385worker2 # [ 118.256704] nix-daemon[1317]: unexpected Nix daemon error: error: interrupted by the user5386worker2 # [ 118.262378] nix-daemon[837]: reaped child process 1317, status = failed with exit code 15387worker2 # [ 118.336504] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5388worker2 # [ 118.340722] systemd[1]: Starting Nix worker-protocol over gRPC...5389worker1 # [ 118.412734] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:23Z level=info event=scheduler_connected addr=lb:500515390worker2 # [ 118.525610] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5391worker2 # [ 118.527833] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:23Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15392worker2 # [ 118.535549] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5393worker2 # [ 118.543729] systemd[1]: Started Nix worker-protocol over gRPC.5394worker2 # [ 118.546902] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:23Z level=info event=scheduler_take_over5395lb # [ 118.593553] niks3-server[1042]: 2026/09/20 09:34:23 INFO lead: acquired remote=192.168.1.4:491065396worker2 # [ 118.560163] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05397worker2 # [ 118.577721] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:23Z level=info event=scheduler_connected addr=lb:500515398worker2 # [ 118.579549] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:23Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05399worker2 # [ 118.727199] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:23Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05400worker2 # [ 118.733098] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:23Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15401worker1 # [ 118.790414] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426025402worker1 # [ 118.806974] nix-daemon[832]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)5403worker1 # [ 118.832654] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5)5404worker1 # [ 118.862724] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 2/5)5405worker1 # [ 118.935219] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 329 ms (attempt 3/5)5406worker1 # [ 119.273156] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 711 ms (attempt 4/5)5407lb # [ 119.803989] envoy[912]: conn peer=[2001:db8:1::1]:39630 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1349 ms=86645408lb # [ 119.804452] envoy[912]: conn peer=[2001:db8:1::3]:35064 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4878 tx=1537 ms=250385409lb # [ 119.804566] envoy[912]: conn peer=[2001:db8:1::4]:53232 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1566 tx=567 ms=168735410worker1 # [ 119.992331] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5411worker1 # [ 120.011892] nix-grpc-daemon[1475]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5412worker1 # [ 120.041269] nix-daemon[832]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)5413client # [ 120.058300] nix[1208]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5414worker1 # [ 120.063016] nix-daemon[832]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)5415client: (finished: must succeed: sleep 5.0, in 5.07 seconds)5416client: waiting for success: ! systemctl is-active mid5417worker1 # [ 123.694030] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:28Z level=info event=niks3_push_started pid=15765418worker1 # [ 123.727719] nix-daemon[832]: reaped child process 1552, status = succeeded5419worker1 # [ 124.103197] nix-daemon[832]: accepted connection from pid 1589, user nix-grpc-daemon (trusted)5420worker1 # [ 124.122710] nix-daemon[832]: reaped child process 1592, status = succeeded5421lb # [ 124.181977] niks3-server[1042]: 2026/09/20 09:34:28 INFO Received uploads request method=POST path=/api/pending_closures5422worker1 # [ 124.147775] nix-grpc-daemon[1576]: time=2026-09-20T09:34:28.777Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5423worker1 # [ 124.150896] nix-grpc-daemon[1576]: time=2026-09-20T09:34:28.777Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5424lb # [ 124.224435] niks3-server[1042]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5425lb # [ 124.240771] niks3-server[1042]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5426lb # [ 124.247110] niks3-server[1042]: 2026/09/20 09:34:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5427worker1 # [ 124.208088] nix-grpc-daemon[1576]: time=2026-09-20T09:34:28.839Z level=INFO msg="Uploading 1 narinfos"5428lb # [ 124.256454] niks3-server[1042]: 2026/09/20 09:34:28 INFO Signed narinfos id=36 count=15429lb # [ 124.258984] niks3-server[1042]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5430lb # [ 124.268296] niks3-server[1042]: 2026/09/20 09:34:28 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5431worker1 # [ 124.231506] nix-grpc-daemon[1576]: time=2026-09-20T09:34:28.863Z level=INFO msg="Upload complete. (299ms)"5432lb # [ 124.279024] niks3-server[1042]: 2026/09/20 09:34:28 INFO Completed upload id=365433worker1 # [ 124.240302] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42602 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15434worker1 # [ 124.255164] nix-grpc-daemon[1576]: time=2026-09-20T09:34:28.882Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5435worker1 # [ 124.260855] nix-daemon[832]: reaped child process 1550, status = succeeded5436client # [ 124.284826] systemd[1]: mid.service: Deactivated successfully.5437client # [ 124.289965] systemd[1]: mid.service: Consumed 173ms CPU time over 10.143s wall clock time, 37.2M memory peak, 9.6K incoming IP traffic, 10.7K outgoing IP traffic.5438client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5439client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5440client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5441(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.73 seconds)5442subtest: interrupting the client stops the build on the worker5443client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5444client # [ 124.846724] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5445client # Running as unit: intr.service; invocation ID: 3ec18cc08f86421ca283f9528418bafd5446client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5447worker1 # [ 125.074251] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:426025448client # [ 125.081865] nix[1244]: don't know how to build these paths:5449client # [ 125.082839] nix[1244]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5450worker2 # [ 125.093290] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:29Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05451worker2 # [ 125.099490] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:29Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15452worker2 # [ 125.161054] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:469585453worker2 # [ 125.176353] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5454worker2 # [ 125.201172] nix-grpc-daemon[1353]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 1/5)5455worker2 # [ 125.266921] nix-grpc-daemon[1353]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 103 ms (attempt 2/5)5456worker2 # [ 125.370386] nix-grpc-daemon[1353]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 3/5)5457worker2 # [ 125.434238] nix-grpc-daemon[1353]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 132 ms (attempt 4/5)5458worker2 # [ 125.574235] nix-grpc-daemon[1353]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5459worker2 # [ 125.596762] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:469585460client # [ 125.611712] nix[1244]: copying 1 paths to 'lb:50051'...5461client # [ 125.617546] nix[1244]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5462worker2 # [ 125.616721] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:469585463worker2 # [ 125.631972] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5464worker2 # [ 125.661194] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:30Z level=info event=niks3_push_started pid=14255465worker2 # [ 126.048117] nix-daemon[837]: accepted connection from pid 1438, user nix-grpc-daemon (trusted)5466worker2 # [ 126.066110] nix-daemon[837]: reaped child process 1441, status = succeeded5467worker2 # [ 126.254211] nix-daemon[837]: accepted connection from pid 1443, user nix-grpc-daemon (trusted)5468worker2 # [ 126.272204] nix-daemon[837]: reaped child process 1450, status = succeeded5469lb # [ 126.330870] niks3-server[1042]: 2026/09/20 09:34:30 INFO Received uploads request method=POST path=/api/pending_closures5470worker2 # [ 126.303761] nix-grpc-daemon[1425]: time=2026-09-20T09:34:30.942Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5471worker2 # [ 126.305548] nix-grpc-daemon[1425]: time=2026-09-20T09:34:30.942Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5472lb # [ 126.387380] niks3-server[1042]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5473worker2 # [ 126.352327] nix-grpc-daemon[1425]: time=2026-09-20T09:34:30.992Z level=INFO msg="Uploading 1 narinfos"5474lb # [ 126.402822] niks3-server[1042]: 2026/09/20 09:34:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5475lb # [ 126.412918] niks3-server[1042]: 2026/09/20 09:34:31 INFO Signed narinfos id=37 count=15476lb # [ 126.421329] niks3-server[1042]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5477lb # [ 126.425851] niks3-server[1042]: 2026/09/20 09:34:31 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5478lb # [ 126.430614] niks3-server[1042]: 2026/09/20 09:34:31 INFO Completed upload id=375479worker2 # [ 126.383247] nix-grpc-daemon[1425]: time=2026-09-20T09:34:31.023Z level=INFO msg="Upload complete. (504ms)"5480lb # [ 126.433322] niks3-server[1042]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5481worker2 # [ 126.393001] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46958 duration_s=0 paths=1 nar_bytes_in=4245482worker2 # [ 126.409087] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:469585483worker2 # [ 126.416285] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5484worker2 # [ 126.421981] nix-daemon[837]: reaped child process 1423, status = succeeded5485worker2 # [ 126.434538] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5486client # [ 126.435071] nix[1244]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5487client: must succeed: systemctl kill -s INT intr5488client # [ 128.563870] systemd[1]: intr.service: Sent signal SIGINT to main process 1244 (nix) on client request.5489worker2 # [ 128.567746] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:33Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5490client # [ 128.572961] nix[1244]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5491client # [ 128.575709] nix[1244]: error: interrupted by the user5492client: (finished: must succeed: systemctl kill -s INT intr, in 0.07 seconds)5493client # [ 128.614023] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5494client # [ 128.616920] systemd[1]: intr.service: Failed with result 'exit-code'.5495client # [ 128.621108] systemd[1]: intr.service: Consumed 146ms CPU time over 3.772s wall clock time, 39.2M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic.5496worker2 # [ 128.664561] nix-daemon[1454]: unexpected Nix daemon error: error: interrupted by the user5497worker2 # [ 128.671277] nix-daemon[837]: reaped child process 1452, status = succeeded5498worker2 # [ 128.677653] nix-daemon[837]: reaped child process 1454, status = failed with exit code 15499(finished: subtest: interrupting the client stops the build on the worker, in 3.92 seconds)5500subtest: a deploy mid-build drains: the build finishes, the new generation takes over5501client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5502client # [ 128.786370] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5503client # Running as unit: sw.service; invocation ID: e19e5d0abbe54813a775ee1e1c04be015504client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5505worker2 # [ 129.024311] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:469585506client # [ 129.033341] nix[1264]: don't know how to build these paths:5507client # [ 129.034282] nix[1264]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5508worker2 # [ 129.040855] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:33Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05509worker2 # [ 129.046784] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:33Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15510worker1 # [ 129.089022] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426025511worker1 # [ 129.105663] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:426025512client # [ 129.119520] nix[1264]: copying 1 paths to 'lb:50051'...5513worker1 # [ 129.120113] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:426025514client # [ 129.122223] nix[1264]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5515worker1 # [ 129.134748] nix-daemon[832]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)5516worker1 # [ 129.336720] nix-daemon[832]: accepted connection from pid 1620, user nix-grpc-daemon (trusted)5517worker1 # [ 129.356376] nix-daemon[832]: reaped child process 1623, status = succeeded5518worker1 # [ 129.528085] nix-daemon[832]: accepted connection from pid 1625, user nix-grpc-daemon (trusted)5519worker1 # [ 129.546921] nix-daemon[832]: reaped child process 1628, status = succeeded5520lb # [ 129.603867] niks3-server[1042]: 2026/09/20 09:34:34 INFO Received uploads request method=POST path=/api/pending_closures5521worker1 # [ 129.570783] nix-grpc-daemon[1576]: time=2026-09-20T09:34:34.201Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5522worker1 # [ 129.572374] nix-grpc-daemon[1576]: time=2026-09-20T09:34:34.202Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5523lb # [ 129.633919] niks3-server[1042]: 2026/09/20 09:34:34 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5524worker1 # [ 129.613908] nix-grpc-daemon[1576]: time=2026-09-20T09:34:34.245Z level=INFO msg="Uploading 1 narinfos"5525lb # [ 129.649717] niks3-server[1042]: 2026/09/20 09:34:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5526lb # [ 129.666436] niks3-server[1042]: 2026/09/20 09:34:34 INFO Signed narinfos id=38 count=15527lb # [ 129.674131] niks3-server[1042]: 2026/09/20 09:34:34 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5528lb # [ 129.685908] niks3-server[1042]: 2026/09/20 09:34:34 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5529lb # [ 129.692766] niks3-server[1042]: 2026/09/20 09:34:34 INFO Completed upload id=385530worker1 # [ 129.648322] nix-grpc-daemon[1576]: time=2026-09-20T09:34:34.280Z level=INFO msg="Upload complete. (497ms)"5531lb # [ 129.696100] niks3-server[1042]: 2026/09/20 09:34:34 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5532worker1 # [ 129.657459] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42602 duration_s=0 paths=1 nar_bytes_in=4165533worker1 # [ 129.674966] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:426025534worker1 # [ 129.683440] nix-daemon[832]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)5535worker1 # [ 129.689602] nix-daemon[832]: reaped child process 1618, status = succeeded5536client # [ 129.699597] nix[1264]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5537worker1 # [ 129.704806] nix-daemon[832]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)5538lb # [ 129.803636] envoy[912]: conn peer=[2001:db8:1::1]:46564 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3858 tx=1702 ms=98695539lb # [ 129.808677] envoy[912]: conn peer=[2001:db8:1::1]:48380 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=732 ms=35245540worker1: must succeed: systemctl reload nix-grpc-daemon.service5541worker1 # [ 131.492004] systemd[1]: Reloading Nix worker-protocol over gRPC...5542worker1 # [ 131.538074] systemd[1]: Reloaded Nix worker-protocol over gRPC.5543worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.10 seconds)5544worker1: must succeed: pgrep -f 'read -t [9]0 x'5545worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)5546client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25547worker1 # [ 131.807379] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:36Z level=info event=draining5548client # don't know how to build these paths:5549worker2 # [ 131.845215] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:469585550client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5551worker2 # [ 131.852121] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:469585552worker2 # [ 131.878308] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:36Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05553worker2 # [ 131.884974] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:36Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15554worker2 # [ 131.925588] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:469585555worker2 # [ 131.941446] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:469585556client # copying 1 paths to 'lb:50051'...5557worker2 # [ 131.957896] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:469585558client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5559worker2 # [ 131.981830] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5560worker2 # [ 132.187318] nix-daemon[837]: accepted connection from pid 1504, user nix-grpc-daemon (trusted)5561worker2 # [ 132.208695] nix-daemon[837]: reaped child process 1507, status = succeeded5562worker2 # [ 132.390320] nix-daemon[837]: accepted connection from pid 1509, user nix-grpc-daemon (trusted)5563worker2 # [ 132.408425] nix-daemon[837]: reaped child process 1512, status = succeeded5564lb # [ 132.467403] niks3-server[1042]: 2026/09/20 09:34:37 INFO Received uploads request method=POST path=/api/pending_closures5565worker2 # [ 132.431027] nix-grpc-daemon[1425]: time=2026-09-20T09:34:37.070Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5566worker2 # [ 132.432614] nix-grpc-daemon[1425]: time=2026-09-20T09:34:37.070Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5567lb # [ 132.498924] niks3-server[1042]: 2026/09/20 09:34:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5568worker2 # [ 132.462532] nix-grpc-daemon[1425]: time=2026-09-20T09:34:37.102Z level=INFO msg="Uploading 1 narinfos"5569lb # [ 132.512546] niks3-server[1042]: 2026/09/20 09:34:37 INFO Signed narinfos id=39 count=15570lb # [ 132.523505] niks3-server[1042]: 2026/09/20 09:34:37 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5571lb # [ 132.536138] niks3-server[1042]: 2026/09/20 09:34:37 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5572lb # [ 132.549881] niks3-server[1042]: 2026/09/20 09:34:37 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5573worker2 # [ 132.508329] nix-grpc-daemon[1425]: time=2026-09-20T09:34:37.148Z level=INFO msg="Upload complete. (509ms)"5574lb # [ 132.555633] niks3-server[1042]: 2026/09/20 09:34:37 INFO Completed upload id=395575lb # [ 132.558787] niks3-server[1042]: 2026/09/20 09:34:37 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5576worker2 # [ 132.516149] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46958 duration_s=0 paths=1 nar_bytes_in=5285577worker2 # [ 132.532532] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:469585578worker2 # [ 132.539224] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5579worker2 # [ 132.545072] nix-daemon[837]: reaped child process 1502, status = succeeded5580client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5581worker2 # [ 132.558008] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5582client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5583client # farm-a> LOG-farm-a-during-drain5584worker2 # [ 133.402507] nix-daemon[837]: reaped child process 1516, status = succeeded5585worker2 # [ 133.596499] nix-daemon[837]: accepted connection from pid 1531, user nix-grpc-daemon (trusted)5586worker2 # [ 133.617913] nix-daemon[837]: reaped child process 1534, status = succeeded5587lb # [ 133.676808] niks3-server[1042]: 2026/09/20 09:34:38 INFO Received uploads request method=POST path=/api/pending_closures5588worker2 # [ 133.642458] nix-grpc-daemon[1425]: time=2026-09-20T09:34:38.280Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5589worker2 # [ 133.643981] nix-grpc-daemon[1425]: time=2026-09-20T09:34:38.280Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5590lb # [ 133.720065] niks3-server[1042]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5591lb # [ 133.733787] niks3-server[1042]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5592lb # [ 133.746751] niks3-server[1042]: 2026/09/20 09:34:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5593worker2 # [ 133.705828] nix-grpc-daemon[1425]: time=2026-09-20T09:34:38.344Z level=INFO msg="Uploading 1 narinfos"5594lb # [ 133.755868] niks3-server[1042]: 2026/09/20 09:34:38 INFO Signed narinfos id=40 count=15595lb # [ 133.762466] niks3-server[1042]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5596lb # [ 133.771053] niks3-server[1042]: 2026/09/20 09:34:38 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5597lb # [ 133.779628] niks3-server[1042]: 2026/09/20 09:34:38 INFO Completed upload id=405598worker2 # [ 133.732326] nix-grpc-daemon[1425]: time=2026-09-20T09:34:38.372Z level=INFO msg="Upload complete. (364ms)"5599lb # [ 133.787010] niks3-server[1042]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5600worker2 # [ 133.750623] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46958 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15601worker2 # [ 133.770924] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:38Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05602worker2 # [ 133.775416] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:38Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15603worker2 # [ 133.780203] nix-daemon[837]: reaped child process 1514, status = succeeded5604worker2 # [ 133.798468] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:469585605worker2 # [ 133.814582] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:469585606worker2 # [ 133.830083] nix-grpc-daemon[1425]: time=2026-09-20T09:34:38.470Z level=INFO msg="All 1 paths already cached"5607client # copying 1 paths to 'lb:50051'...5608worker2 # [ 133.840616] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:469585609client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5610worker2 # [ 133.860337] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5611worker2 # [ 134.075320] nix-daemon[837]: accepted connection from pid 1540, user nix-grpc-daemon (trusted)5612worker2 # [ 134.094180] nix-daemon[837]: reaped child process 1543, status = succeeded5613worker2 # [ 134.277476] nix-daemon[837]: accepted connection from pid 1545, user nix-grpc-daemon (trusted)5614worker2 # [ 134.299606] nix-daemon[837]: reaped child process 1548, status = succeeded5615lb # [ 134.356924] niks3-server[1042]: 2026/09/20 09:34:38 INFO Received uploads request method=POST path=/api/pending_closures5616worker2 # [ 134.321357] nix-grpc-daemon[1425]: time=2026-09-20T09:34:38.961Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5617worker2 # [ 134.323646] nix-grpc-daemon[1425]: time=2026-09-20T09:34:38.963Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5618lb # [ 134.390389] niks3-server[1042]: 2026/09/20 09:34:39 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5619worker2 # [ 134.358731] nix-grpc-daemon[1425]: time=2026-09-20T09:34:38.998Z level=INFO msg="Uploading 1 narinfos"5620lb # [ 134.409861] niks3-server[1042]: 2026/09/20 09:34:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5621lb # [ 134.419943] niks3-server[1042]: 2026/09/20 09:34:39 INFO Signed narinfos id=41 count=15622lb # [ 134.424895] niks3-server[1042]: 2026/09/20 09:34:39 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5623lb # [ 134.437690] niks3-server[1042]: 2026/09/20 09:34:39 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5624worker2 # [ 134.395345] nix-grpc-daemon[1425]: time=2026-09-20T09:34:39.035Z level=INFO msg="Upload complete. (513ms)"5625lb # [ 134.442765] niks3-server[1042]: 2026/09/20 09:34:39 INFO Completed upload id=415626lb # [ 134.445786] niks3-server[1042]: 2026/09/20 09:34:39 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5627worker2 # [ 134.403059] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46958 duration_s=0 paths=1 nar_bytes_in=6405628worker2 # [ 134.416227] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:469585629worker2 # [ 134.424795] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5630worker2 # [ 134.430334] nix-daemon[837]: reaped child process 1538, status = succeeded5631client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5632client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5633worker2 # [ 134.442619] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5634client # farm-b> LOG-farm-b-during-drain5635worker2 # [ 136.095733] nix-daemon[837]: reaped child process 1552, status = succeeded5636worker2 # [ 136.280688] nix-daemon[837]: accepted connection from pid 1567, user nix-grpc-daemon (trusted)5637worker2 # [ 136.297931] nix-daemon[837]: reaped child process 1570, status = succeeded5638lb # [ 136.358218] niks3-server[1042]: 2026/09/20 09:34:40 INFO Received uploads request method=POST path=/api/pending_closures5639worker2 # [ 136.321819] nix-grpc-daemon[1425]: time=2026-09-20T09:34:40.961Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5640worker2 # [ 136.323368] nix-grpc-daemon[1425]: time=2026-09-20T09:34:40.961Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5641lb # [ 136.393903] niks3-server[1042]: 2026/09/20 09:34:41 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5642lb # [ 136.406969] niks3-server[1042]: 2026/09/20 09:34:41 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5643lb # [ 136.415952] niks3-server[1042]: 2026/09/20 09:34:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5644worker2 # [ 136.374442] nix-grpc-daemon[1425]: time=2026-09-20T09:34:41.014Z level=INFO msg="Uploading 1 narinfos"5645lb # [ 136.423183] niks3-server[1042]: 2026/09/20 09:34:41 INFO Signed narinfos id=42 count=15646lb # [ 136.427850] niks3-server[1042]: 2026/09/20 09:34:41 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5647lb # [ 136.434542] niks3-server[1042]: 2026/09/20 09:34:41 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5648lb # [ 136.440162] niks3-server[1042]: 2026/09/20 09:34:41 INFO Completed upload id=425649worker2 # [ 136.393630] nix-grpc-daemon[1425]: time=2026-09-20T09:34:41.034Z level=INFO msg="Upload complete. (334ms)"5650lb # [ 136.442447] niks3-server[1042]: 2026/09/20 09:34:41 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5651worker2 # [ 136.413067] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46958 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15652worker2 # [ 136.424333] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:41Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05653worker2 # [ 136.427798] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:41Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15654worker2 # [ 136.434024] nix-daemon[837]: reaped child process 1550, status = succeeded5655worker2 # [ 136.459746] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:469585656worker2 # [ 136.475000] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:469585657worker2 # [ 136.489252] nix-grpc-daemon[1425]: time=2026-09-20T09:34:41.129Z level=INFO msg="All 2 paths already cached"5658client # copying 1 paths to 'lb:50051'...5659worker2 # [ 136.499703] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:469585660client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5661worker2 # [ 136.522389] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5662worker2 # [ 136.732706] nix-daemon[837]: accepted connection from pid 1576, user nix-grpc-daemon (trusted)5663worker2 # [ 136.752984] nix-daemon[837]: reaped child process 1579, status = succeeded5664worker2 # [ 136.927345] nix-daemon[837]: accepted connection from pid 1581, user nix-grpc-daemon (trusted)5665worker2 # [ 136.947028] nix-daemon[837]: reaped child process 1584, status = succeeded5666lb # [ 137.009021] niks3-server[1042]: 2026/09/20 09:34:41 INFO Received uploads request method=POST path=/api/pending_closures5667worker2 # [ 136.972223] nix-grpc-daemon[1425]: time=2026-09-20T09:34:41.612Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5668worker2 # [ 136.974134] nix-grpc-daemon[1425]: time=2026-09-20T09:34:41.614Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5669lb # [ 137.043829] niks3-server[1042]: 2026/09/20 09:34:41 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5670worker2 # [ 137.010207] nix-grpc-daemon[1425]: time=2026-09-20T09:34:41.650Z level=INFO msg="Uploading 1 narinfos"5671lb # [ 137.056810] niks3-server[1042]: 2026/09/20 09:34:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5672lb # [ 137.067510] niks3-server[1042]: 2026/09/20 09:34:41 INFO Signed narinfos id=43 count=15673lb # [ 137.073294] niks3-server[1042]: 2026/09/20 09:34:41 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5674worker2 # [ 137.035152] nix-grpc-daemon[1425]: time=2026-09-20T09:34:41.675Z level=INFO msg="Upload complete. (494ms)"5675lb # [ 137.082671] niks3-server[1042]: 2026/09/20 09:34:41 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5676lb # [ 137.087643] niks3-server[1042]: 2026/09/20 09:34:41 INFO Completed upload id=435677lb # [ 137.090821] niks3-server[1042]: 2026/09/20 09:34:41 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5678worker2 # [ 137.044840] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46958 duration_s=0 paths=1 nar_bytes_in=7685679worker2 # [ 137.054462] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:469585680worker2 # [ 137.060836] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5681worker2 # [ 137.065515] nix-daemon[837]: reaped child process 1574, status = succeeded5682client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5683worker2 # [ 137.078082] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5684client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5685worker2 # [ 138.699446] nix-daemon[837]: reaped child process 1588, status = succeeded5686client # farm-top> LOG-farm-top-during-drain5687worker2 # [ 138.860086] nix-daemon[837]: accepted connection from pid 1603, user nix-grpc-daemon (trusted)5688worker2 # [ 138.879764] nix-daemon[837]: reaped child process 1606, status = succeeded5689lb # [ 138.939147] niks3-server[1042]: 2026/09/20 09:34:43 INFO Received uploads request method=POST path=/api/pending_closures5690worker2 # [ 138.904400] nix-grpc-daemon[1425]: time=2026-09-20T09:34:43.543Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5691worker2 # [ 138.905862] nix-grpc-daemon[1425]: time=2026-09-20T09:34:43.543Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5692lb # [ 138.980420] niks3-server[1042]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5693worker2 # [ 138.947374] nix-grpc-daemon[1425]: time=2026-09-20T09:34:43.587Z level=INFO msg="Uploading 1 narinfos"5694lb # [ 138.997091] niks3-server[1042]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5695lb # [ 139.005300] niks3-server[1042]: 2026/09/20 09:34:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5696lb # [ 139.014593] niks3-server[1042]: 2026/09/20 09:34:43 INFO Signed narinfos id=44 count=15697lb # [ 139.017262] niks3-server[1042]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5698lb # [ 139.020237] niks3-server[1042]: 2026/09/20 09:34:43 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5699worker2 # [ 138.970270] nix-grpc-daemon[1425]: time=2026-09-20T09:34:43.610Z level=INFO msg="Upload complete. (281ms)"5700lb # [ 139.024529] niks3-server[1042]: 2026/09/20 09:34:43 INFO Completed upload id=445701lb # [ 139.026705] niks3-server[1042]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5702worker2 # [ 138.981073] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46958 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15703worker2 # [ 138.993828] nix-daemon[837]: reaped child process 1586, status = succeeded5704client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 7.44 seconds)5705client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5706client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds)5707worker1: must succeed: pkill -f 'read -t [9]0 x'5708worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5709client: waiting for success: ! systemctl is-active sw5710worker1 # [ 139.555705] nix-daemon[832]: reaped child process 1632, status = succeeded5711worker1 # [ 139.744734] nix-daemon[832]: accepted connection from pid 1672, user nix-grpc-daemon (trusted)5712worker1 # [ 139.762945] nix-daemon[832]: reaped child process 1675, status = succeeded5713lb # [ 139.804492] envoy[912]: conn peer=[2001:db8:1::1]:59164 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9638 tx=3873 ms=71555714lb # [ 139.819904] niks3-server[1042]: 2026/09/20 09:34:44 INFO Received uploads request method=POST path=/api/pending_closures5715worker1 # [ 139.784420] nix-grpc-daemon[1576]: time=2026-09-20T09:34:44.415Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5716worker1 # [ 139.785961] nix-grpc-daemon[1576]: time=2026-09-20T09:34:44.415Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5717lb # [ 139.857333] niks3-server[1042]: 2026/09/20 09:34:44 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5718lb # [ 139.868816] niks3-server[1042]: 2026/09/20 09:34:44 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5719lb # [ 139.876838] niks3-server[1042]: 2026/09/20 09:34:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5720worker1 # [ 139.838055] nix-grpc-daemon[1576]: time=2026-09-20T09:34:44.468Z level=INFO msg="Uploading 1 narinfos"5721lb # [ 139.887475] niks3-server[1042]: 2026/09/20 09:34:44 INFO Signed narinfos id=45 count=15722lb # [ 139.893589] niks3-server[1042]: 2026/09/20 09:34:44 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5723lb # [ 139.901148] niks3-server[1042]: 2026/09/20 09:34:44 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5724lb # [ 139.907679] niks3-server[1042]: 2026/09/20 09:34:44 INFO Completed upload id=455725worker1 # [ 139.863321] nix-grpc-daemon[1576]: time=2026-09-20T09:34:44.495Z level=INFO msg="Upload complete. (340ms)"5726lb # [ 139.910807] niks3-server[1042]: 2026/09/20 09:34:44 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5727worker1 # [ 139.877167] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42602 duration_s=10 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15728worker1 # [ 139.893426] nix-daemon[832]: reaped child process 1630, status = succeeded5729client # [ 139.918385] systemd[1]: sw.service: Deactivated successfully.5730client # [ 139.923795] systemd[1]: sw.service: Consumed 158ms CPU time over 11.135s wall clock time, 37M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic.5731client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5732client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5733client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5734worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5735worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.07 seconds)5736lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5737lb: must succeed: curl -sf localhost:9901/clusters5738lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5739worker1 # [ 140.811401] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:45Z level=info event=signal_exit5740lb: must succeed: curl -sf localhost:9901/clusters5741lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5742worker2 # [ 142.036545] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:46Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:365285743worker1 # [ 142.041542] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:46Z level=info event=scheduler_restarting5744worker1 # [ 142.063689] nix-grpc-daemon[1475]: ts=2026-09-20T09:34:46Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5745worker1 # [ 142.088480] nix-daemon[832]: reaped child process 1544, status = succeeded5746worker1 # [ 142.620951] nix-grpc-daemon[1475]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5747worker1 # [ 142.625676] nix-grpc-daemon[1475]: E0000 00:00:1789896887.252714 1518 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5748worker1 # [ 142.637945] nix-grpc-daemon[1475]: E0000 00:00:1789896887.269774 1518 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5749worker2 # [ 142.041711] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:46Z level=info event=worker_gone addr=192.168.1.3:500515750lb: must succeed: curl -sf localhost:9901/clusters5751lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5752lb: must succeed: curl -sf localhost:9901/clusters5753worker1 # [ 143.847827] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5754worker1 # [ 143.854488] systemd[1]: nix-grpc-daemon.service: Consumed 894ms CPU time over 30.266s wall clock time, 33M memory peak, 20.7K incoming IP traffic, 26.8K outgoing IP traffic.5755lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5756worker1 # [ 144.844886] systemd[1]: Starting Nix worker-protocol over gRPC...5757lb: must succeed: curl -sf localhost:9901/clusters5758lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5759worker1 # [ 145.060439] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5760worker1 # [ 145.062882] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15761worker1 # [ 145.070996] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5762worker1 # [ 145.091705] systemd[1]: Started Nix worker-protocol over gRPC.5763worker1 # [ 145.115093] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:49Z level=info event=scheduler_connected addr=lb:500515764worker2 # [ 145.116247] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:49Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05765lb: must succeed: curl -sf localhost:9901/clusters5766lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5767lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 5.49 seconds)5768lb: must succeed: curl -sf localhost:9901/clusters5769lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5770worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5771worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5772(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 17.49 seconds)5773subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5774client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15775worker1 # [ 146.465688] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:416125776worker1 # [ 146.478677] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)5777worker2 # [ 146.498448] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:469585778worker2 # [ 146.545631] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:51Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05779worker2 # [ 146.552332] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:51Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15780worker2 # [ 146.558218] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:51Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05781worker2 # [ 146.563468] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:51Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05782worker1 # [ 146.595744] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416125783worker1 # [ 146.613358] nix-grpc-daemon[1687]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 1/5)5784worker1 # [ 146.668981] nix-grpc-daemon[1687]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 121 ms (attempt 2/5)5785worker1 # [ 146.797583] nix-grpc-daemon[1687]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 3/5)5786worker1 # [ 146.852820] nix-grpc-daemon[1687]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 4/5)5787worker1 # [ 146.915701] nix-grpc-daemon[1687]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5788worker1 # [ 146.936308] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416125789worker1 # [ 146.952138] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:416125790worker1 # [ 146.967380] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)5791worker1 # [ 146.996760] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:51Z level=info event=niks3_push_started pid=17435792worker1 # [ 147.394485] nix-daemon[832]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)5793worker1 # [ 147.411764] nix-daemon[832]: reaped child process 1759, status = succeeded5794worker1 # [ 147.587801] nix-daemon[832]: accepted connection from pid 1761, user nix-grpc-daemon (trusted)5795worker1 # [ 147.605204] nix-daemon[832]: reaped child process 1764, status = succeeded5796lb # [ 147.663388] niks3-server[1042]: 2026/09/20 09:34:52 INFO Received uploads request method=POST path=/api/pending_closures5797worker1 # [ 147.630121] nix-grpc-daemon[1743]: time=2026-09-20T09:34:52.260Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5798worker1 # [ 147.631656] nix-grpc-daemon[1743]: time=2026-09-20T09:34:52.260Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5799lb # [ 147.698944] niks3-server[1042]: 2026/09/20 09:34:52 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5800worker1 # [ 147.667858] nix-grpc-daemon[1743]: time=2026-09-20T09:34:52.299Z level=INFO msg="Uploading 1 narinfos"5801lb # [ 147.712354] niks3-server[1042]: 2026/09/20 09:34:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5802lb # [ 147.721768] niks3-server[1042]: 2026/09/20 09:34:52 INFO Signed narinfos id=46 count=15803lb # [ 147.731208] niks3-server[1042]: 2026/09/20 09:34:52 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5804lb # [ 147.740089] niks3-server[1042]: 2026/09/20 09:34:52 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5805worker1 # [ 147.703846] nix-grpc-daemon[1743]: time=2026-09-20T09:34:52.335Z level=INFO msg="Upload complete. (482ms)"5806lb # [ 147.749519] niks3-server[1042]: 2026/09/20 09:34:52 INFO Completed upload id=465807lb # [ 147.753128] niks3-server[1042]: 2026/09/20 09:34:52 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5808worker1 # [ 147.712896] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=0 paths=1 nar_bytes_in=5125809worker1 # [ 147.727202] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416125810worker1 # [ 147.733854] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)5811worker1 # [ 147.738739] nix-daemon[832]: reaped child process 1741, status = succeeded5812worker1 # [ 147.752520] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)5813worker1 # [ 149.196417] nix-daemon[832]: reaped child process 1768, status = succeeded5814worker1 # [ 149.381841] nix-daemon[832]: accepted connection from pid 1783, user nix-grpc-daemon (trusted)5815worker1 # [ 149.399354] nix-daemon[832]: reaped child process 1786, status = succeeded5816lb # [ 149.458099] niks3-server[1042]: 2026/09/20 09:34:54 INFO Received uploads request method=POST path=/api/pending_closures5817worker1 # [ 149.424165] nix-grpc-daemon[1743]: time=2026-09-20T09:34:54.053Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5818worker1 # [ 149.425765] nix-grpc-daemon[1743]: time=2026-09-20T09:34:54.053Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5819lb # [ 149.497986] niks3-server[1042]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5820lb # [ 149.512587] niks3-server[1042]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5821lb # [ 149.524738] niks3-server[1042]: 2026/09/20 09:34:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5822lb # [ 149.530890] niks3-server[1042]: 2026/09/20 09:34:54 INFO Signed narinfos id=47 count=15823worker1 # [ 149.486426] nix-grpc-daemon[1743]: time=2026-09-20T09:34:54.117Z level=INFO msg="Uploading 1 narinfos"5824lb # [ 149.540415] niks3-server[1042]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5825lb # [ 149.548363] niks3-server[1042]: 2026/09/20 09:34:54 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5826lb # [ 149.556065] niks3-server[1042]: 2026/09/20 09:34:54 INFO Completed upload id=475827worker1 # [ 149.510114] nix-grpc-daemon[1743]: time=2026-09-20T09:34:54.142Z level=INFO msg="Upload complete. (346ms)"5828lb # [ 149.558131] niks3-server[1042]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5829worker2 # [ 149.517457] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:54Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15830worker1 # [ 149.521195] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=15831worker2 # [ 149.530669] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:54Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05832worker1 # [ 149.541671] nix-daemon[832]: reaped child process 1766, status = succeeded5833worker1 # [ 149.572244] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416125834worker1 # [ 149.587160] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416125835worker1 # [ 149.601290] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:416125836worker1 # [ 149.615201] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)5837lb # [ 149.802317] envoy[912]: conn peer=[2001:db8:1::1]:48396 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=1350 ms=108615838lb # [ 149.807417] envoy[912]: conn peer=[2001:db8:1::3]:55842 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=986 tx=448 ms=282165839worker1 # [ 149.821471] nix-daemon[832]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5840worker1 # [ 149.839873] nix-daemon[832]: reaped child process 1793, status = succeeded5841worker1 # [ 150.015724] nix-daemon[832]: accepted connection from pid 1795, user nix-grpc-daemon (trusted)5842worker1 # [ 150.034574] nix-daemon[832]: reaped child process 1798, status = succeeded5843lb # [ 150.090196] niks3-server[1042]: 2026/09/20 09:34:54 INFO Received uploads request method=POST path=/api/pending_closures5844worker1 # [ 150.054376] nix-grpc-daemon[1743]: time=2026-09-20T09:34:54.685Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5845worker1 # [ 150.055906] nix-grpc-daemon[1743]: time=2026-09-20T09:34:54.686Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5846lb # [ 150.116172] niks3-server[1042]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5847lb # [ 150.138414] niks3-server[1042]: 2026/09/20 09:34:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5848lb # [ 150.150941] niks3-server[1042]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5849worker1 # [ 150.114982] nix-grpc-daemon[1743]: time=2026-09-20T09:34:54.746Z level=INFO msg="Uploading 1 narinfos"5850lb # [ 150.159275] niks3-server[1042]: 2026/09/20 09:34:54 INFO Signed narinfos id=48 count=15851lb # [ 150.173674] niks3-server[1042]: 2026/09/20 09:34:54 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5852worker1 # [ 150.135530] nix-grpc-daemon[1743]: time=2026-09-20T09:34:54.767Z level=INFO msg="Upload complete. (505ms)"5853lb # [ 150.182352] niks3-server[1042]: 2026/09/20 09:34:54 INFO Completed upload id=485854lb # [ 150.186395] niks3-server[1042]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5855worker1 # [ 150.144424] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=0 paths=1 nar_bytes_in=5125856worker1 # [ 150.160355] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416125857worker1 # [ 150.166746] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)5858worker1 # [ 150.172791] nix-daemon[832]: reaped child process 1788, status = succeeded5859worker1 # [ 150.185054] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)5860worker1 # [ 151.033741] nix-daemon[832]: reaped child process 1802, status = succeeded5861worker1 # [ 151.209840] nix-daemon[832]: accepted connection from pid 1817, user nix-grpc-daemon (trusted)5862worker1 # [ 151.227237] nix-daemon[832]: reaped child process 1820, status = succeeded5863lb # [ 151.285948] niks3-server[1042]: 2026/09/20 09:34:55 INFO Received uploads request method=POST path=/api/pending_closures5864worker1 # [ 151.251061] nix-grpc-daemon[1743]: time=2026-09-20T09:34:55.881Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5865worker1 # [ 151.253125] nix-grpc-daemon[1743]: time=2026-09-20T09:34:55.882Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5866lb # [ 151.316674] niks3-server[1042]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5867lb # [ 151.332577] niks3-server[1042]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5868lb # [ 151.345040] niks3-server[1042]: 2026/09/20 09:34:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5869worker1 # [ 151.307273] nix-grpc-daemon[1743]: time=2026-09-20T09:34:55.938Z level=INFO msg="Uploading 1 narinfos"5870lb # [ 151.357017] niks3-server[1042]: 2026/09/20 09:34:55 INFO Signed narinfos id=49 count=15871lb # [ 151.364164] niks3-server[1042]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5872lb # [ 151.374510] niks3-server[1042]: 2026/09/20 09:34:56 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5873lb # [ 151.380425] niks3-server[1042]: 2026/09/20 09:34:56 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5874lb # [ 151.393786] niks3-server[1042]: 2026/09/20 09:34:56 INFO Completed upload id=495875worker1 # [ 151.349496] nix-grpc-daemon[1743]: time=2026-09-20T09:34:55.981Z level=INFO msg="Upload complete. (351ms)"5876worker2 # [ 151.355523] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:55Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15877worker1 # [ 151.362306] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=15878worker2 # [ 151.369424] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:56Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05879worker1 # [ 151.381021] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416125880worker1 # [ 151.392508] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416125881worker1 # [ 151.398516] nix-daemon[832]: reaped child process 1800, status = succeeded5882worker1 # [ 151.406177] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:416125883worker1 # [ 151.417399] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)5884worker1 # [ 151.605611] nix-daemon[832]: accepted connection from pid 1824, user nix-grpc-daemon (trusted)5885worker1 # [ 151.624009] nix-daemon[832]: reaped child process 1827, status = succeeded5886worker1 # [ 151.796474] nix-daemon[832]: accepted connection from pid 1829, user nix-grpc-daemon (trusted)5887worker1 # [ 151.815565] nix-daemon[832]: reaped child process 1832, status = succeeded5888lb # [ 151.871345] niks3-server[1042]: 2026/09/20 09:34:56 INFO Received uploads request method=POST path=/api/pending_closures5889worker1 # [ 151.839103] nix-grpc-daemon[1743]: time=2026-09-20T09:34:56.470Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5890worker1 # [ 151.840753] nix-grpc-daemon[1743]: time=2026-09-20T09:34:56.470Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5891lb # [ 151.905896] niks3-server[1042]: 2026/09/20 09:34:56 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5892worker1 # [ 151.874072] nix-grpc-daemon[1743]: time=2026-09-20T09:34:56.505Z level=INFO msg="Uploading 1 narinfos"5893lb # [ 151.923693] niks3-server[1042]: 2026/09/20 09:34:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5894lb # [ 151.933366] niks3-server[1042]: 2026/09/20 09:34:56 INFO Signed narinfos id=50 count=15895lb # [ 151.937069] niks3-server[1042]: 2026/09/20 09:34:56 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5896lb # [ 151.945880] niks3-server[1042]: 2026/09/20 09:34:56 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5897lb # [ 151.949952] niks3-server[1042]: 2026/09/20 09:34:56 INFO Completed upload id=505898worker1 # [ 151.905234] nix-grpc-daemon[1743]: time=2026-09-20T09:34:56.537Z level=INFO msg="Upload complete. (474ms)"5899lb # [ 151.951987] niks3-server[1042]: 2026/09/20 09:34:56 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5900worker1 # [ 151.912118] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=0 paths=1 nar_bytes_in=5125901worker1 # [ 151.927303] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416125902worker1 # [ 151.934236] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)5903worker1 # [ 151.939152] nix-daemon[832]: reaped child process 1822, status = succeeded5904worker1 # [ 151.950465] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)5905worker1 # [ 153.380362] nix-daemon[832]: reaped child process 1836, status = succeeded5906worker1 # [ 153.542296] nix-daemon[832]: accepted connection from pid 1851, user nix-grpc-daemon (trusted)5907worker1 # [ 153.559954] nix-daemon[832]: reaped child process 1854, status = succeeded5908lb # [ 153.616791] niks3-server[1042]: 2026/09/20 09:34:58 INFO Received uploads request method=POST path=/api/pending_closures5909worker1 # [ 153.583024] nix-grpc-daemon[1743]: time=2026-09-20T09:34:58.213Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5910worker1 # [ 153.584615] nix-grpc-daemon[1743]: time=2026-09-20T09:34:58.213Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5911lb # [ 153.648430] niks3-server[1042]: 2026/09/20 09:34:58 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5912lb # [ 153.661976] niks3-server[1042]: 2026/09/20 09:34:58 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5913worker1 # [ 153.631122] nix-grpc-daemon[1743]: time=2026-09-20T09:34:58.262Z level=INFO msg="Uploading 1 narinfos"5914lb # [ 153.675347] niks3-server[1042]: 2026/09/20 09:34:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5915lb # [ 153.684751] niks3-server[1042]: 2026/09/20 09:34:58 INFO Signed narinfos id=51 count=15916lb # [ 153.687335] niks3-server[1042]: 2026/09/20 09:34:58 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5917lb # [ 153.697128] niks3-server[1042]: 2026/09/20 09:34:58 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5918lb # [ 153.704209] niks3-server[1042]: 2026/09/20 09:34:58 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5919lb # [ 153.709902] niks3-server[1042]: 2026/09/20 09:34:58 INFO Completed upload id=515920worker1 # [ 153.665480] nix-grpc-daemon[1743]: time=2026-09-20T09:34:58.297Z level=INFO msg="Upload complete. (301ms)"5921worker2 # [ 153.671025] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:58Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15922worker1 # [ 153.677028] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=15923worker2 # [ 153.685050] nix-grpc-daemon[1353]: ts=2026-09-20T09:34:58Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05924worker1 # [ 153.696447] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416125925worker1 # [ 153.703544] nix-daemon[832]: reaped child process 1834, status = succeeded5926worker1 # [ 153.708153] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416125927worker1 # [ 153.716712] nix-grpc-daemon[1743]: time=2026-09-20T09:34:58.348Z level=INFO msg="All 1 paths already cached"5928worker1 # [ 153.724638] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:416125929worker1 # [ 153.737711] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)5930worker1 # [ 153.925205] nix-daemon[832]: accepted connection from pid 1858, user nix-grpc-daemon (trusted)5931worker1 # [ 153.942967] nix-daemon[832]: reaped child process 1861, status = succeeded5932worker1 # [ 154.117621] nix-daemon[832]: accepted connection from pid 1863, user nix-grpc-daemon (trusted)5933worker1 # [ 154.134867] nix-daemon[832]: reaped child process 1866, status = succeeded5934lb # [ 154.191773] niks3-server[1042]: 2026/09/20 09:34:58 INFO Received uploads request method=POST path=/api/pending_closures5935worker1 # [ 154.155753] nix-grpc-daemon[1743]: time=2026-09-20T09:34:58.787Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5936worker1 # [ 154.157459] nix-grpc-daemon[1743]: time=2026-09-20T09:34:58.787Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5937lb # [ 154.220225] niks3-server[1042]: 2026/09/20 09:34:58 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5938lb # [ 154.230839] niks3-server[1042]: 2026/09/20 09:34:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5939worker1 # [ 154.193842] nix-grpc-daemon[1743]: time=2026-09-20T09:34:58.825Z level=INFO msg="Uploading 1 narinfos"5940lb # [ 154.238383] niks3-server[1042]: 2026/09/20 09:34:58 INFO Signed narinfos id=52 count=15941lb # [ 154.245051] niks3-server[1042]: 2026/09/20 09:34:58 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5942lb # [ 154.258401] niks3-server[1042]: 2026/09/20 09:34:58 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5943worker1 # [ 154.221535] nix-grpc-daemon[1743]: time=2026-09-20T09:34:58.853Z level=INFO msg="Upload complete. (471ms)"5944lb # [ 154.266289] niks3-server[1042]: 2026/09/20 09:34:58 INFO Completed upload id=525945lb # [ 154.268903] niks3-server[1042]: 2026/09/20 09:34:58 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5946worker1 # [ 154.228230] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=0 paths=1 nar_bytes_in=6245947worker1 # [ 154.241418] nix-grpc-daemon[1687]: ts=2026-09-20T09:34:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416125948worker1 # [ 154.248966] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)5949worker1 # [ 154.253938] nix-daemon[832]: reaped child process 1856, status = succeeded5950worker1 # [ 154.267808] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)5951worker1 # [ 155.704464] nix-daemon[832]: reaped child process 1870, status = succeeded5952worker1 # [ 155.878327] nix-daemon[832]: accepted connection from pid 1885, user nix-grpc-daemon (trusted)5953worker1 # [ 155.897331] nix-daemon[832]: reaped child process 1888, status = succeeded5954lb # [ 155.953867] niks3-server[1042]: 2026/09/20 09:35:00 INFO Received uploads request method=POST path=/api/pending_closures5955worker1 # [ 155.924488] nix-grpc-daemon[1743]: time=2026-09-20T09:35:00.555Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5956worker1 # [ 155.926304] nix-grpc-daemon[1743]: time=2026-09-20T09:35:00.555Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5957lb # [ 155.998029] niks3-server[1042]: 2026/09/20 09:35:00 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5958lb # [ 156.009269] niks3-server[1042]: 2026/09/20 09:35:00 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5959lb # [ 156.018909] niks3-server[1042]: 2026/09/20 09:35:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5960worker1 # [ 155.979574] nix-grpc-daemon[1743]: time=2026-09-20T09:35:00.611Z level=INFO msg="Uploading 1 narinfos"5961lb # [ 156.028412] niks3-server[1042]: 2026/09/20 09:35:00 INFO Signed narinfos id=53 count=15962lb # [ 156.030591] niks3-server[1042]: 2026/09/20 09:35:00 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5963lb # [ 156.039410] niks3-server[1042]: 2026/09/20 09:35:00 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5964lb # [ 156.044612] niks3-server[1042]: 2026/09/20 09:35:00 INFO Completed upload id=535965worker1 # [ 155.999775] nix-grpc-daemon[1743]: time=2026-09-20T09:35:00.631Z level=INFO msg="Upload complete. (321ms)"5966lb # [ 156.046826] niks3-server[1042]: 2026/09/20 09:35:00 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5967worker2 # [ 156.006297] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:00Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15968worker1 # [ 156.013186] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=15969worker2 # [ 156.019439] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:00Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05970worker1 # [ 156.031500] nix-daemon[832]: reaped child process 1868, status = succeeded5971worker1 # [ 156.064169] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416125972worker1 # [ 156.079716] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416125973worker1 # [ 156.094733] nix-grpc-daemon[1743]: time=2026-09-20T09:35:00.726Z level=INFO msg="All 1 paths already cached"5974worker1 # [ 156.103805] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:416125975worker1 # [ 156.117947] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)5976worker1 # [ 156.324400] nix-daemon[832]: accepted connection from pid 1892, user nix-grpc-daemon (trusted)5977worker1 # [ 156.343712] nix-daemon[832]: reaped child process 1895, status = succeeded5978worker1 # [ 156.516162] nix-daemon[832]: accepted connection from pid 1897, user nix-grpc-daemon (trusted)5979worker1 # [ 156.531924] nix-daemon[832]: reaped child process 1900, status = succeeded5980lb # [ 156.592373] niks3-server[1042]: 2026/09/20 09:35:01 INFO Received uploads request method=POST path=/api/pending_closures5981worker1 # [ 156.557271] nix-grpc-daemon[1743]: time=2026-09-20T09:35:01.189Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5982worker1 # [ 156.558746] nix-grpc-daemon[1743]: time=2026-09-20T09:35:01.189Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5983lb # [ 156.619173] niks3-server[1042]: 2026/09/20 09:35:01 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5984worker1 # [ 156.587840] nix-grpc-daemon[1743]: time=2026-09-20T09:35:01.219Z level=INFO msg="Uploading 1 narinfos"5985lb # [ 156.634587] niks3-server[1042]: 2026/09/20 09:35:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5986lb # [ 156.644261] niks3-server[1042]: 2026/09/20 09:35:01 INFO Signed narinfos id=54 count=15987lb # [ 156.651760] niks3-server[1042]: 2026/09/20 09:35:01 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5988worker1 # [ 156.617530] nix-grpc-daemon[1743]: time=2026-09-20T09:35:01.249Z level=INFO msg="Upload complete. (480ms)"5989lb # [ 156.662688] niks3-server[1042]: 2026/09/20 09:35:01 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5990lb # [ 156.667408] niks3-server[1042]: 2026/09/20 09:35:01 INFO Completed upload id=545991worker1 # [ 156.624200] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=0 paths=1 nar_bytes_in=6245992lb # [ 156.671468] niks3-server[1042]: 2026/09/20 09:35:01 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5993worker1 # [ 156.638046] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416125994worker1 # [ 156.643771] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)5995worker1 # [ 156.648715] nix-daemon[832]: reaped child process 1890, status = succeeded5996worker1 # [ 156.661107] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)5997worker1 # [ 157.704948] nix-daemon[832]: reaped child process 1904, status = succeeded5998worker1 # [ 157.886731] nix-daemon[832]: accepted connection from pid 1919, user nix-grpc-daemon (trusted)5999worker1 # [ 157.904751] nix-daemon[832]: reaped child process 1922, status = succeeded6000lb # [ 157.961682] niks3-server[1042]: 2026/09/20 09:35:02 INFO Received uploads request method=POST path=/api/pending_closures6001worker1 # [ 157.932421] nix-grpc-daemon[1743]: time=2026-09-20T09:35:02.561Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6002worker1 # [ 157.933976] nix-grpc-daemon[1743]: time=2026-09-20T09:35:02.561Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"6003lb # [ 158.002398] niks3-server[1042]: 2026/09/20 09:35:02 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst6004worker1 # [ 157.973402] nix-grpc-daemon[1743]: time=2026-09-20T09:35:02.605Z level=INFO msg="Uploading 1 narinfos"6005lb # [ 158.017851] niks3-server[1042]: 2026/09/20 09:35:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6006lb # [ 158.027826] niks3-server[1042]: 2026/09/20 09:35:02 INFO Signed narinfos id=55 count=16007lb # [ 158.033415] niks3-server[1042]: 2026/09/20 09:35:02 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv6008lb # [ 158.044738] niks3-server[1042]: 2026/09/20 09:35:02 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls6009lb # [ 158.047986] niks3-server[1042]: 2026/09/20 09:35:02 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6010lb # [ 158.055073] niks3-server[1042]: 2026/09/20 09:35:02 INFO Completed upload id=556011worker1 # [ 158.009998] nix-grpc-daemon[1743]: time=2026-09-20T09:35:02.641Z level=INFO msg="Upload complete. (338ms)"6012lb # [ 158.057593] niks3-server[1042]: 2026/09/20 09:35:02 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo6013worker2 # [ 158.017303] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:02Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=16014worker2 # [ 158.031943] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:02Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=06015worker1 # [ 158.021060] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=16016worker1 # [ 158.040174] nix-daemon[832]: reaped child process 1902, status = succeeded6017worker1 # [ 158.071610] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416126018worker1 # [ 158.087142] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416126019worker1 # [ 158.102225] nix-grpc-daemon[1743]: time=2026-09-20T09:35:02.734Z level=INFO msg="All 1 paths already cached"6020worker1 # [ 158.110891] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:416126021worker1 # [ 158.124800] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6022worker1 # [ 158.324126] nix-daemon[832]: accepted connection from pid 1926, user nix-grpc-daemon (trusted)6023worker1 # [ 158.342121] nix-daemon[832]: reaped child process 1929, status = succeeded6024worker1 # [ 158.516851] nix-daemon[832]: accepted connection from pid 1931, user nix-grpc-daemon (trusted)6025worker1 # [ 158.533568] nix-daemon[832]: reaped child process 1934, status = succeeded6026lb # [ 158.590870] niks3-server[1042]: 2026/09/20 09:35:03 INFO Received uploads request method=POST path=/api/pending_closures6027worker1 # [ 158.556630] nix-grpc-daemon[1743]: time=2026-09-20T09:35:03.188Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6028worker1 # [ 158.558126] nix-grpc-daemon[1743]: time=2026-09-20T09:35:03.188Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6029lb # [ 158.619159] niks3-server[1042]: 2026/09/20 09:35:03 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6030lb # [ 158.631556] niks3-server[1042]: 2026/09/20 09:35:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6031worker1 # [ 158.592952] nix-grpc-daemon[1743]: time=2026-09-20T09:35:03.224Z level=INFO msg="Uploading 1 narinfos"6032lb # [ 158.644248] niks3-server[1042]: 2026/09/20 09:35:03 INFO Signed narinfos id=56 count=16033lb # [ 158.651340] niks3-server[1042]: 2026/09/20 09:35:03 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6034lb # [ 158.660152] niks3-server[1042]: 2026/09/20 09:35:03 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6035lb # [ 158.671645] niks3-server[1042]: 2026/09/20 09:35:03 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6036lb # [ 158.676404] niks3-server[1042]: 2026/09/20 09:35:03 INFO Completed upload id=566037worker1 # [ 158.630751] nix-grpc-daemon[1743]: time=2026-09-20T09:35:03.262Z level=INFO msg="Upload complete. (487ms)"6038worker1 # [ 158.638976] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=0 paths=1 nar_bytes_in=6246039worker1 # [ 158.654154] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416126040worker1 # [ 158.660368] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6041worker1 # [ 158.665518] nix-daemon[832]: reaped child process 1924, status = succeeded6042worker1 # [ 158.679578] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6043worker1 # [ 159.900554] nix-daemon[832]: reaped child process 1938, status = succeeded6044worker1 # [ 160.060825] nix-daemon[832]: accepted connection from pid 1953, user nix-grpc-daemon (trusted)6045worker1 # [ 160.080225] nix-daemon[832]: reaped child process 1956, status = succeeded6046lb # [ 160.137079] niks3-server[1042]: 2026/09/20 09:35:04 INFO Received uploads request method=POST path=/api/pending_closures6047worker1 # [ 160.104319] nix-grpc-daemon[1743]: time=2026-09-20T09:35:04.733Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6048worker1 # [ 160.105806] nix-grpc-daemon[1743]: time=2026-09-20T09:35:04.733Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6049lb # [ 160.181433] niks3-server[1042]: 2026/09/20 09:35:04 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6050lb # [ 160.191899] niks3-server[1042]: 2026/09/20 09:35:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6051worker1 # [ 160.154483] nix-grpc-daemon[1743]: time=2026-09-20T09:35:04.786Z level=INFO msg="Uploading 1 narinfos"6052lb # [ 160.203061] niks3-server[1042]: 2026/09/20 09:35:04 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6053lb # [ 160.211937] niks3-server[1042]: 2026/09/20 09:35:04 INFO Signed narinfos id=57 count=16054lb # [ 160.218717] niks3-server[1042]: 2026/09/20 09:35:04 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6055worker1 # [ 160.177639] nix-grpc-daemon[1743]: time=2026-09-20T09:35:04.809Z level=INFO msg="Upload complete. (287ms)"6056lb # [ 160.222676] niks3-server[1042]: 2026/09/20 09:35:04 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6057lb # [ 160.227162] niks3-server[1042]: 2026/09/20 09:35:04 INFO Completed upload id=576058lb # [ 160.229571] niks3-server[1042]: 2026/09/20 09:35:04 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6059worker2 # [ 160.182133] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:04Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16060worker1 # [ 160.188872] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=16061worker2 # [ 160.195874] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:04Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06062worker1 # [ 160.202770] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416126063worker1 # [ 160.208234] nix-daemon[832]: reaped child process 1936, status = succeeded6064worker1 # [ 160.216134] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416126065worker1 # [ 160.228704] nix-grpc-daemon[1743]: time=2026-09-20T09:35:04.860Z level=INFO msg="All 2 paths already cached"6066worker1 # [ 160.235289] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:416126067worker1 # [ 160.245446] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6068worker1 # [ 160.433970] nix-daemon[832]: accepted connection from pid 1960, user nix-grpc-daemon (trusted)6069worker1 # [ 160.451734] nix-daemon[832]: reaped child process 1963, status = succeeded6070worker1 # [ 160.622332] nix-daemon[832]: accepted connection from pid 1965, user nix-grpc-daemon (trusted)6071worker1 # [ 160.639292] nix-daemon[832]: reaped child process 1968, status = succeeded6072lb # [ 160.695445] niks3-server[1042]: 2026/09/20 09:35:05 INFO Received uploads request method=POST path=/api/pending_closures6073worker1 # [ 160.661007] nix-grpc-daemon[1743]: time=2026-09-20T09:35:05.292Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6074worker1 # [ 160.662504] nix-grpc-daemon[1743]: time=2026-09-20T09:35:05.292Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6075lb # [ 160.726551] niks3-server[1042]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6076worker1 # [ 160.691238] nix-grpc-daemon[1743]: time=2026-09-20T09:35:05.323Z level=INFO msg="Uploading 1 narinfos"6077lb # [ 160.740800] niks3-server[1042]: 2026/09/20 09:35:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6078lb # [ 160.752850] niks3-server[1042]: 2026/09/20 09:35:05 INFO Signed narinfos id=58 count=16079lb # [ 160.762570] niks3-server[1042]: 2026/09/20 09:35:05 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6080worker1 # [ 160.723485] nix-grpc-daemon[1743]: time=2026-09-20T09:35:05.355Z level=INFO msg="Upload complete. (465ms)"6081lb # [ 160.768669] niks3-server[1042]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6082lb # [ 160.774709] niks3-server[1042]: 2026/09/20 09:35:05 INFO Completed upload id=586083worker1 # [ 160.729951] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=0 paths=1 nar_bytes_in=7526084lb # [ 160.778727] niks3-server[1042]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6085worker1 # [ 160.742947] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416126086worker1 # [ 160.749061] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6087worker1 # [ 160.754152] nix-daemon[832]: reaped child process 1958, status = succeeded6088worker1 # [ 160.767142] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6089worker1 # [ 162.410260] nix-daemon[832]: reaped child process 1972, status = succeeded6090worker1 # [ 162.595402] nix-daemon[832]: accepted connection from pid 1987, user nix-grpc-daemon (trusted)6091worker1 # [ 162.612638] nix-daemon[832]: reaped child process 1990, status = succeeded6092lb # [ 162.673821] niks3-server[1042]: 2026/09/20 09:35:07 INFO Received uploads request method=POST path=/api/pending_closures6093worker1 # [ 162.640476] nix-grpc-daemon[1743]: time=2026-09-20T09:35:07.270Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6094worker1 # [ 162.645754] nix-grpc-daemon[1743]: time=2026-09-20T09:35:07.270Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6095lb # [ 162.714541] niks3-server[1042]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6096lb # [ 162.728284] niks3-server[1042]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6097lb # [ 162.739263] niks3-server[1042]: 2026/09/20 09:35:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6098worker1 # [ 162.702153] nix-grpc-daemon[1743]: time=2026-09-20T09:35:07.333Z level=INFO msg="Uploading 1 narinfos"6099lb # [ 162.748879] niks3-server[1042]: 2026/09/20 09:35:07 INFO Signed narinfos id=59 count=16100lb # [ 162.751568] niks3-server[1042]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6101lb # [ 162.762922] niks3-server[1042]: 2026/09/20 09:35:07 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6102lb # [ 162.767932] niks3-server[1042]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6103lb # [ 162.771878] niks3-server[1042]: 2026/09/20 09:35:07 INFO Completed upload id=596104worker1 # [ 162.727523] nix-grpc-daemon[1743]: time=2026-09-20T09:35:07.359Z level=INFO msg="Upload complete. (347ms)"6105worker2 # [ 162.733261] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:07Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16106worker1 # [ 162.741129] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=16107worker1 # [ 162.758874] nix-daemon[832]: reaped child process 1970, status = succeeded6108worker1 # [ 162.780380] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416126109worker1 # [ 162.795440] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416126110worker1 # [ 162.810943] nix-grpc-daemon[1743]: time=2026-09-20T09:35:07.442Z level=INFO msg="All 2 paths already cached"6111worker1 # [ 162.820117] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:416126112worker1 # [ 162.833588] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6113worker1 # [ 163.032004] nix-daemon[832]: accepted connection from pid 1994, user nix-grpc-daemon (trusted)6114worker1 # [ 163.049571] nix-daemon[832]: reaped child process 1997, status = succeeded6115worker1 # [ 163.227027] nix-daemon[832]: accepted connection from pid 1999, user nix-grpc-daemon (trusted)6116worker1 # [ 163.244680] nix-daemon[832]: reaped child process 2002, status = succeeded6117lb # [ 163.300839] niks3-server[1042]: 2026/09/20 09:35:07 INFO Received uploads request method=POST path=/api/pending_closures6118worker1 # [ 163.265319] nix-grpc-daemon[1743]: time=2026-09-20T09:35:07.897Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6119worker1 # [ 163.266855] nix-grpc-daemon[1743]: time=2026-09-20T09:35:07.897Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6120lb # [ 163.326841] niks3-server[1042]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6121lb # [ 163.341151] niks3-server[1042]: 2026/09/20 09:35:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6122worker1 # [ 163.302694] nix-grpc-daemon[1743]: time=2026-09-20T09:35:07.934Z level=INFO msg="Uploading 1 narinfos"6123lb # [ 163.353411] niks3-server[1042]: 2026/09/20 09:35:07 INFO Signed narinfos id=60 count=16124lb # [ 163.359093] niks3-server[1042]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6125lb # [ 163.367838] niks3-server[1042]: 2026/09/20 09:35:08 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6126lb # [ 163.372878] niks3-server[1042]: 2026/09/20 09:35:08 INFO Completed upload id=606127worker1 # [ 163.328049] nix-grpc-daemon[1743]: time=2026-09-20T09:35:07.960Z level=INFO msg="Upload complete. (478ms)"6128lb # [ 163.375911] niks3-server[1042]: 2026/09/20 09:35:08 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6129worker1 # [ 163.336140] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=0 paths=1 nar_bytes_in=7526130worker1 # [ 163.348767] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416126131worker1 # [ 163.354997] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6132worker1 # [ 163.359768] nix-daemon[832]: reaped child process 1992, status = succeeded6133worker1 # [ 163.372886] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6134worker1 # [ 164.415982] nix-daemon[832]: reaped child process 2006, status = succeeded6135worker1 # [ 164.581709] nix-daemon[832]: accepted connection from pid 2021, user nix-grpc-daemon (trusted)6136worker1 # [ 164.599817] nix-daemon[832]: reaped child process 2024, status = succeeded6137lb # [ 164.661811] niks3-server[1042]: 2026/09/20 09:35:09 INFO Received uploads request method=POST path=/api/pending_closures6138worker1 # [ 164.628433] nix-grpc-daemon[1743]: time=2026-09-20T09:35:09.258Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6139worker1 # [ 164.630077] nix-grpc-daemon[1743]: time=2026-09-20T09:35:09.258Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6140lb # [ 164.698241] niks3-server[1042]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6141lb # [ 164.713679] niks3-server[1042]: 2026/09/20 09:35:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6142worker1 # [ 164.674732] nix-grpc-daemon[1743]: time=2026-09-20T09:35:09.306Z level=INFO msg="Uploading 1 narinfos"6143lb # [ 164.725125] niks3-server[1042]: 2026/09/20 09:35:09 INFO Signed narinfos id=61 count=16144lb # [ 164.727423] niks3-server[1042]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6145lb # [ 164.734383] niks3-server[1042]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6146lb # [ 164.744096] niks3-server[1042]: 2026/09/20 09:35:09 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6147worker1 # [ 164.699467] nix-grpc-daemon[1743]: time=2026-09-20T09:35:09.331Z level=INFO msg="Upload complete. (316ms)"6148lb # [ 164.747885] niks3-server[1042]: 2026/09/20 09:35:09 INFO Completed upload id=616149lb # [ 164.751459] niks3-server[1042]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6150worker2 # [ 164.706781] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:09Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16151worker1 # [ 164.713052] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=16152worker1 # [ 164.728709] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416126153worker1 # [ 164.734850] nix-daemon[832]: reaped child process 2004, status = succeeded6154worker1 # [ 164.743358] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416126155worker1 # [ 164.756758] nix-grpc-daemon[1743]: time=2026-09-20T09:35:09.388Z level=INFO msg="All 2 paths already cached"6156worker1 # [ 164.765045] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:416126157worker1 # [ 164.776908] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6158worker1 # [ 164.970187] nix-daemon[832]: accepted connection from pid 2028, user nix-grpc-daemon (trusted)6159worker1 # [ 164.987823] nix-daemon[832]: reaped child process 2031, status = succeeded6160worker1 # [ 165.160114] nix-daemon[832]: accepted connection from pid 2033, user nix-grpc-daemon (trusted)6161worker1 # [ 165.178413] nix-daemon[832]: reaped child process 2036, status = succeeded6162lb # [ 165.234178] niks3-server[1042]: 2026/09/20 09:35:09 INFO Received uploads request method=POST path=/api/pending_closures6163worker1 # [ 165.198739] nix-grpc-daemon[1743]: time=2026-09-20T09:35:09.830Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6164worker1 # [ 165.200332] nix-grpc-daemon[1743]: time=2026-09-20T09:35:09.830Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6165lb # [ 165.261542] niks3-server[1042]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6166lb # [ 165.273605] niks3-server[1042]: 2026/09/20 09:35:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6167worker1 # [ 165.235644] nix-grpc-daemon[1743]: time=2026-09-20T09:35:09.867Z level=INFO msg="Uploading 1 narinfos"6168lb # [ 165.283075] niks3-server[1042]: 2026/09/20 09:35:09 INFO Signed narinfos id=62 count=16169lb # [ 165.290649] niks3-server[1042]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6170lb # [ 165.300202] niks3-server[1042]: 2026/09/20 09:35:09 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6171lb # [ 165.306156] niks3-server[1042]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6172lb # [ 165.311643] niks3-server[1042]: 2026/09/20 09:35:09 INFO Completed upload id=626173worker1 # [ 165.267244] nix-grpc-daemon[1743]: time=2026-09-20T09:35:09.899Z level=INFO msg="Upload complete. (476ms)"6174worker1 # [ 165.275788] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=0 paths=1 nar_bytes_in=7526175worker1 # [ 165.290316] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416126176worker1 # [ 165.296386] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6177worker1 # [ 165.300984] nix-daemon[832]: reaped child process 2026, status = succeeded6178worker1 # [ 165.314616] nix-daemon[832]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6179worker1 # [ 166.753190] nix-daemon[832]: reaped child process 2040, status = succeeded6180worker1 # [ 166.927128] nix-daemon[832]: accepted connection from pid 2055, user nix-grpc-daemon (trusted)6181worker1 # [ 166.945017] nix-daemon[832]: reaped child process 2058, status = succeeded6182lb # [ 167.002208] niks3-server[1042]: 2026/09/20 09:35:11 INFO Received uploads request method=POST path=/api/pending_closures6183worker1 # [ 166.967591] nix-grpc-daemon[1743]: time=2026-09-20T09:35:11.598Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6184worker1 # [ 166.971948] nix-grpc-daemon[1743]: time=2026-09-20T09:35:11.598Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6185lb # [ 167.040471] niks3-server[1042]: 2026/09/20 09:35:11 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6186worker1 # [ 167.010418] nix-grpc-daemon[1743]: time=2026-09-20T09:35:11.642Z level=INFO msg="Uploading 1 narinfos"6187lb # [ 167.054864] niks3-server[1042]: 2026/09/20 09:35:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6188lb # [ 167.063161] niks3-server[1042]: 2026/09/20 09:35:11 INFO Signed narinfos id=63 count=16189lb # [ 167.070320] niks3-server[1042]: 2026/09/20 09:35:11 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6190lb # [ 167.078680] niks3-server[1042]: 2026/09/20 09:35:11 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6191lb # [ 167.086033] niks3-server[1042]: 2026/09/20 09:35:11 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6192lb # [ 167.091698] niks3-server[1042]: 2026/09/20 09:35:11 INFO Completed upload id=636193worker1 # [ 167.046399] nix-grpc-daemon[1743]: time=2026-09-20T09:35:11.678Z level=INFO msg="Upload complete. (321ms)"6194lb # [ 167.094793] niks3-server[1042]: 2026/09/20 09:35:11 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6195worker1 # [ 167.057166] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41612 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16196worker1 # [ 167.076660] nix-daemon[832]: reaped child process 2038, status = succeeded6197client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 20.92 seconds)6198worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6199worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.09 seconds)6200client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16201worker1 # [ 167.460850] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:416126202worker1 # [ 167.469300] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416126203worker2 # [ 167.489259] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:12Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06204lb # [ 169.814095] envoy[912]: conn peer=[2001:db8:1::1]:32780 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27187 tx=10729 ms=206176205client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.32 seconds)6206(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 51.33 seconds)6207subtest: low disk drains a worker and builds go to the other6208worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6209worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.12 seconds)6210worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6211worker1 # [ 199.114239] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:43Z level=info event=unhealthy reason=min_free6212lb # [ 199.811416] envoy[912]: conn peer=[2001:db8:1::1]:57586 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=300596213worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.13 seconds)6214client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26215client # don't know how to build these paths:6216client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6217worker1 # [ 200.033805] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:416126218worker2 # [ 200.038282] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:469586219worker2 # [ 200.068152] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:44Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06220worker2 # [ 200.074380] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:44Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16221worker2 # [ 200.123535] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:469586222worker2 # [ 200.138966] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:469586223client # copying 1 paths to 'lb:50051'...6224worker2 # [ 200.154615] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:469586225client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6226worker2 # [ 200.172843] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6227worker2 # [ 200.380934] nix-daemon[837]: accepted connection from pid 1633, user nix-grpc-daemon (trusted)6228worker2 # [ 200.401278] nix-daemon[837]: reaped child process 1636, status = succeeded6229worker2 # [ 200.577680] nix-daemon[837]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6230worker2 # [ 200.595101] nix-daemon[837]: reaped child process 1641, status = succeeded6231lb # [ 200.653362] niks3-server[1042]: 2026/09/20 09:35:45 INFO Received uploads request method=POST path=/api/pending_closures6232worker2 # [ 200.619437] nix-grpc-daemon[1425]: time=2026-09-20T09:35:45.259Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6233worker2 # [ 200.621670] nix-grpc-daemon[1425]: time=2026-09-20T09:35:45.261Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6234lb # [ 200.692742] niks3-server[1042]: 2026/09/20 09:35:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6235worker2 # [ 200.655674] nix-grpc-daemon[1425]: time=2026-09-20T09:35:45.295Z level=INFO msg="Uploading 1 narinfos"6236lb # [ 200.708464] niks3-server[1042]: 2026/09/20 09:35:45 INFO Signed narinfos id=64 count=16237lb # [ 200.711740] niks3-server[1042]: 2026/09/20 09:35:45 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6238worker2 # [ 200.683579] nix-grpc-daemon[1425]: time=2026-09-20T09:35:45.324Z level=INFO msg="Upload complete. (493ms)"6239lb # [ 200.725337] niks3-server[1042]: 2026/09/20 09:35:45 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6240lb # [ 200.735793] niks3-server[1042]: 2026/09/20 09:35:45 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6241lb # [ 200.740600] niks3-server[1042]: 2026/09/20 09:35:45 INFO Completed upload id=646242worker2 # [ 200.691406] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46958 duration_s=0 paths=1 nar_bytes_in=5126243lb # [ 200.742753] niks3-server[1042]: 2026/09/20 09:35:45 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6244worker2 # [ 200.707083] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:469586245worker2 # [ 200.714523] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6246worker2 # [ 200.719408] nix-daemon[837]: reaped child process 1631, status = succeeded6247client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6248worker2 # [ 200.730868] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6249client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6250client # farm-a> LOG-farm-a-drain6251worker2 # [ 201.779940] nix-daemon[837]: reaped child process 1645, status = succeeded6252worker2 # [ 201.957705] nix-daemon[837]: accepted connection from pid 1660, user nix-grpc-daemon (trusted)6253worker2 # [ 201.974866] nix-daemon[837]: reaped child process 1663, status = succeeded6254lb # [ 202.038350] niks3-server[1042]: 2026/09/20 09:35:46 INFO Received uploads request method=POST path=/api/pending_closures6255worker2 # [ 202.004382] nix-grpc-daemon[1425]: time=2026-09-20T09:35:46.642Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6256worker2 # [ 202.005852] nix-grpc-daemon[1425]: time=2026-09-20T09:35:46.643Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6257lb # [ 202.090161] niks3-server[1042]: 2026/09/20 09:35:46 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6258lb # [ 202.101046] niks3-server[1042]: 2026/09/20 09:35:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6259worker2 # [ 202.058583] nix-grpc-daemon[1425]: time=2026-09-20T09:35:46.698Z level=INFO msg="Uploading 1 narinfos"6260lb # [ 202.106388] niks3-server[1042]: 2026/09/20 09:35:46 INFO Signed narinfos id=65 count=16261lb # [ 202.112234] niks3-server[1042]: 2026/09/20 09:35:46 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6262lb # [ 202.122589] niks3-server[1042]: 2026/09/20 09:35:46 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6263lb # [ 202.128136] niks3-server[1042]: 2026/09/20 09:35:46 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6264lb # [ 202.136445] niks3-server[1042]: 2026/09/20 09:35:46 INFO Completed upload id=656265worker2 # [ 202.092153] nix-grpc-daemon[1425]: time=2026-09-20T09:35:46.732Z level=INFO msg="Upload complete. (348ms)"6266lb # [ 202.141672] niks3-server[1042]: 2026/09/20 09:35:46 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6267worker2 # [ 202.112917] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46958 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16268worker2 # [ 202.124282] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:46Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06269worker2 # [ 202.130548] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:46Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16270worker2 # [ 202.135048] nix-daemon[837]: reaped child process 1643, status = succeeded6271worker2 # [ 202.155778] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:469586272worker2 # [ 202.169684] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:469586273worker2 # [ 202.183451] nix-grpc-daemon[1425]: time=2026-09-20T09:35:46.823Z level=INFO msg="All 1 paths already cached"6274client # copying 1 paths to 'lb:50051'...6275worker2 # [ 202.194137] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:469586276client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6277worker2 # [ 202.208307] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6278worker2 # [ 202.412131] nix-daemon[837]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)6279worker2 # [ 202.429247] nix-daemon[837]: reaped child process 1672, status = succeeded6280worker2 # [ 202.602993] nix-daemon[837]: accepted connection from pid 1674, user nix-grpc-daemon (trusted)6281worker2 # [ 202.619179] nix-daemon[837]: reaped child process 1677, status = succeeded6282lb # [ 202.676678] niks3-server[1042]: 2026/09/20 09:35:47 INFO Received uploads request method=POST path=/api/pending_closures6283worker2 # [ 202.639081] nix-grpc-daemon[1425]: time=2026-09-20T09:35:47.279Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6284worker2 # [ 202.641109] nix-grpc-daemon[1425]: time=2026-09-20T09:35:47.281Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6285lb # [ 202.703702] niks3-server[1042]: 2026/09/20 09:35:47 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6286lb # [ 202.718354] niks3-server[1042]: 2026/09/20 09:35:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6287worker2 # [ 202.679623] nix-grpc-daemon[1425]: time=2026-09-20T09:35:47.319Z level=INFO msg="Uploading 1 narinfos"6288lb # [ 202.729368] niks3-server[1042]: 2026/09/20 09:35:47 INFO Signed narinfos id=66 count=16289lb # [ 202.735668] niks3-server[1042]: 2026/09/20 09:35:47 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6290lb # [ 202.744492] niks3-server[1042]: 2026/09/20 09:35:47 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6291lb # [ 202.750443] niks3-server[1042]: 2026/09/20 09:35:47 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6292lb # [ 202.756451] niks3-server[1042]: 2026/09/20 09:35:47 INFO Completed upload id=666293worker2 # [ 202.709994] nix-grpc-daemon[1425]: time=2026-09-20T09:35:47.350Z level=INFO msg="Upload complete. (482ms)"6294worker2 # [ 202.717980] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46958 duration_s=0 paths=1 nar_bytes_in=6326295worker2 # [ 202.732210] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:469586296worker2 # [ 202.738436] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6297worker2 # [ 202.742992] nix-daemon[837]: reaped child process 1667, status = succeeded6298client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6299client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6300worker2 # [ 202.754097] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6301client # farm-b> LOG-farm-b-drain6302worker2 # [ 204.002949] nix-daemon[837]: reaped child process 1681, status = succeeded6303worker2 # [ 204.187852] nix-daemon[837]: accepted connection from pid 1696, user nix-grpc-daemon (trusted)6304worker2 # [ 204.208166] nix-daemon[837]: reaped child process 1699, status = succeeded6305lb # [ 204.270686] niks3-server[1042]: 2026/09/20 09:35:48 INFO Received uploads request method=POST path=/api/pending_closures6306worker2 # [ 204.236406] nix-grpc-daemon[1425]: time=2026-09-20T09:35:48.874Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6307worker2 # [ 204.237916] nix-grpc-daemon[1425]: time=2026-09-20T09:35:48.874Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6308lb # [ 204.306177] niks3-server[1042]: 2026/09/20 09:35:48 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6309lb # [ 204.319954] niks3-server[1042]: 2026/09/20 09:35:48 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6310lb # [ 204.336209] niks3-server[1042]: 2026/09/20 09:35:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6311worker2 # [ 204.295044] nix-grpc-daemon[1425]: time=2026-09-20T09:35:48.935Z level=INFO msg="Uploading 1 narinfos"6312lb # [ 204.346838] niks3-server[1042]: 2026/09/20 09:35:48 INFO Signed narinfos id=67 count=16313lb # [ 204.352690] niks3-server[1042]: 2026/09/20 09:35:48 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6314lb # [ 204.358566] niks3-server[1042]: 2026/09/20 09:35:48 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6315lb # [ 204.365343] niks3-server[1042]: 2026/09/20 09:35:49 INFO Completed upload id=676316worker2 # [ 204.317949] nix-grpc-daemon[1425]: time=2026-09-20T09:35:48.958Z level=INFO msg="Upload complete. (350ms)"6317lb # [ 204.367945] niks3-server[1042]: 2026/09/20 09:35:49 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6318worker2 # [ 204.335748] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46958 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16319worker2 # [ 204.352407] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:48Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06320worker2 # [ 204.356468] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:48Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16321worker2 # [ 204.360515] nix-daemon[837]: reaped child process 1679, status = succeeded6322worker2 # [ 204.381582] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:469586323worker2 # [ 204.397195] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:469586324worker2 # [ 204.412288] nix-grpc-daemon[1425]: time=2026-09-20T09:35:49.052Z level=INFO msg="All 2 paths already cached"6325client # copying 1 paths to 'lb:50051'...6326client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6327worker2 # [ 204.423100] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:469586328worker2 # [ 204.437638] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6329worker2 # [ 204.648624] nix-daemon[837]: accepted connection from pid 1705, user nix-grpc-daemon (trusted)6330worker2 # [ 204.666565] nix-daemon[837]: reaped child process 1708, status = succeeded6331worker2 # [ 204.839761] nix-daemon[837]: accepted connection from pid 1710, user nix-grpc-daemon (trusted)6332worker2 # [ 204.856489] nix-daemon[837]: reaped child process 1713, status = succeeded6333lb # [ 204.915017] niks3-server[1042]: 2026/09/20 09:35:49 INFO Received uploads request method=POST path=/api/pending_closures6334worker2 # [ 204.878164] nix-grpc-daemon[1425]: time=2026-09-20T09:35:49.518Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6335worker2 # [ 204.879658] nix-grpc-daemon[1425]: time=2026-09-20T09:35:49.518Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6336lb # [ 204.951367] niks3-server[1042]: 2026/09/20 09:35:49 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6337worker2 # [ 204.914520] nix-grpc-daemon[1425]: time=2026-09-20T09:35:49.554Z level=INFO msg="Uploading 1 narinfos"6338lb # [ 204.966567] niks3-server[1042]: 2026/09/20 09:35:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6339lb # [ 204.975062] niks3-server[1042]: 2026/09/20 09:35:49 INFO Signed narinfos id=68 count=16340lb # [ 204.978675] niks3-server[1042]: 2026/09/20 09:35:49 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6341lb # [ 204.985585] niks3-server[1042]: 2026/09/20 09:35:49 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6342worker2 # [ 204.942687] nix-grpc-daemon[1425]: time=2026-09-20T09:35:49.583Z level=INFO msg="Upload complete. (486ms)"6343lb # [ 204.989805] niks3-server[1042]: 2026/09/20 09:35:49 INFO Completed upload id=686344lb # [ 204.992582] niks3-server[1042]: 2026/09/20 09:35:49 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6345worker2 # [ 204.952224] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46958 duration_s=0 paths=1 nar_bytes_in=7606346worker2 # [ 204.961703] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:469586347worker2 # [ 204.968823] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6348worker2 # [ 204.973734] nix-daemon[837]: reaped child process 1703, status = succeeded6349client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6350worker2 # [ 204.986625] nix-daemon[837]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6351client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6352client # farm-top> LOG-farm-top-drain6353worker2 # [ 206.029293] nix-daemon[837]: reaped child process 1717, status = succeeded6354worker2 # [ 206.203826] nix-daemon[837]: accepted connection from pid 1732, user nix-grpc-daemon (trusted)6355worker2 # [ 206.223719] nix-daemon[837]: reaped child process 1735, status = succeeded6356lb # [ 206.283321] niks3-server[1042]: 2026/09/20 09:35:50 INFO Received uploads request method=POST path=/api/pending_closures6357worker2 # [ 206.246504] nix-grpc-daemon[1425]: time=2026-09-20T09:35:50.886Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6358worker2 # [ 206.249180] nix-grpc-daemon[1425]: time=2026-09-20T09:35:50.888Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6359lb # [ 206.316512] niks3-server[1042]: 2026/09/20 09:35:50 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6360worker2 # [ 206.287901] nix-grpc-daemon[1425]: time=2026-09-20T09:35:50.928Z level=INFO msg="Uploading 1 narinfos"6361lb # [ 206.334859] niks3-server[1042]: 2026/09/20 09:35:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6362lb # [ 206.344977] niks3-server[1042]: 2026/09/20 09:35:50 INFO Signed narinfos id=69 count=16363lb # [ 206.351630] niks3-server[1042]: 2026/09/20 09:35:50 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6364lb # [ 206.357367] niks3-server[1042]: 2026/09/20 09:35:50 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6365lb # [ 206.363517] niks3-server[1042]: 2026/09/20 09:35:51 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6366lb # [ 206.368863] niks3-server[1042]: 2026/09/20 09:35:51 INFO Completed upload id=696367lb # [ 206.371172] niks3-server[1042]: 2026/09/20 09:35:51 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6368worker2 # [ 206.322281] nix-grpc-daemon[1425]: time=2026-09-20T09:35:50.962Z level=INFO msg="Upload complete. (325ms)"6369worker2 # [ 206.333349] nix-grpc-daemon[1353]: ts=2026-09-20T09:35:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46958 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16370worker2 # [ 206.350026] nix-daemon[837]: reaped child process 1715, status = succeeded6371client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.64 seconds)6372client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6373client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds)6374worker1: must succeed: rm /nix/.rw-store/fill6375worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.18 seconds)6376worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6377worker1 # [ 207.125461] nix-grpc-daemon[1687]: ts=2026-09-20T09:35:51Z level=info event=healthy reason=min_free6378worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.16 seconds)6379(finished: subtest: low disk drains a worker and builds go to the other, in 10.56 seconds)6380(finished: run the VM test script, in 209.00 seconds)6381test script finished in 209.34s6382cleanup6383kill QemuMachine (pid 50)6384client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6385kill QemuMachine (pid 49)6386lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6387kill QemuMachine (pid 51)6388worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6389kill QemuMachine (pid 52)6390worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6391(finished: cleanup, in 1.02 seconds)6392additionally exposed symbols:6393 client, lb, worker1, worker2,6394 vlan1,6395 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh