nixbot

builds

succeeded vm-test-run-nix-grpc-farm checks.aarch64-linux.farm · build #280 · raw

1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13client # Formatting '/build/vm-state-client/tmp.v4kMyfsohP', fmt=raw size=107374182414client # mke2fs 1.47.4 (6-Mar-2025)15client: QEMU running (pid 49)16client # Discarding device blocks: 0/262144 done17worker2 # Disk image does not exist, creating the virtualisation disk image...18worker1 # Disk image does not exist, creating the virtualisation disk image...19lb: QEMU running (pid 50)20worker1: QEMU running (pid 52)21worker2 # Formatting '/build/vm-state-worker2/tmp.ZSdbg2vcgm', fmt=raw size=107374182422worker1 # Formatting '/build/vm-state-worker1/tmp.73izEfYZoI', fmt=raw size=107374182423lb # Disk image does not exist, creating the virtualisation disk image...24worker2 # mke2fs 1.47.4 (6-Mar-2025)25worker1 # mke2fs 1.47.4 (6-Mar-2025)26lb # Formatting '/build/vm-state-lb/tmp.jvhlzNK0NL', fmt=raw size=107374182427worker2 # Discarding device blocks: 0/262144 done28worker1 # Discarding device blocks: 0/262144 done29lb # mke2fs 1.47.4 (6-Mar-2025)30worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes31worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes32lb # Discarding device blocks: 0/262144 done33worker2 # Filesystem UUID: 98a4235e-afaf-4a21-9a87-9e1d3d90e79634worker1 # Filesystem UUID: 994cdaf9-6843-495b-a529-514756fb73ac35lb # Creating filesystem with 262144 4k blocks and 65536 inodes36worker2 # Superblock backups stored on blocks:37worker1 # Superblock backups stored on blocks:38lb # Filesystem UUID: 56d7eb97-0933-48bd-9d73-ae2c3288cc1239worker2 # 32768, 98304, 163840, 22937640worker1 # 32768, 98304, 163840, 22937641lb # Superblock backups stored on blocks:42worker2 # 43worker1 # 44lb # 32768, 98304, 163840, 22937645worker2 # Allocating group tables: 0/8 done46worker1 # Allocating group tables: 0/8 done47lb # 48worker2 # Writing inode tables: 0/8 done49worker1 # Writing inode tables: 0/8 done50lb # Allocating group tables: 0/8 done51worker2 # Creating journal (8192 blocks): done52worker1 # Creating journal (8192 blocks): done53lb # Writing inode tables: 0/8 done54worker2 # Writing superblocks and filesystem accounting information: 0/8 done55worker1 # Writing superblocks and filesystem accounting information: 0/8 done56lb # Creating journal (8192 blocks): done57worker2 # 58worker1 # 59lb # Writing superblocks and filesystem accounting information: 0/8 done60worker2 # Virtualisation disk image created.61worker1 # Virtualisation disk image created.62lb # 63worker2: QEMU running (pid 51)64lb # Virtualisation disk image created.65client # Creating filesystem with 262144 4k blocks and 65536 inodes66client # Filesystem UUID: 37009b6a-fbe0-40d2-a15e-de82b874ec4667(finished: start all VMs, in 0.44 seconds)68client # Superblock backups stored on blocks:69client: waiting for unit network-addresses-eth1.service70client # 32768, 98304, 163840, 22937671client: waiting for the VM to finish booting72client # 73client # Allocating group tables: 0/8 done74client # Writing inode tables: 0/8 done75client # Creating journal (8192 blocks): done76client # Writing superblocks and filesystem accounting information: 0/8 done77client # 78client # Virtualisation disk image created.79client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681client # [ 0.000000] KASLR enabled82client # [ 0.000000] random: crng init done83client # [ 0.000000] Machine model: linux,dummy-virt84client # [ 0.000000] efi: UEFI not found.85client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88client # [ 0.000000] Zone ranges:89client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90client # [ 0.000000] DMA32 empty91client # [ 0.000000] Normal empty92client # [ 0.000000] Device empty93client # [ 0.000000] Movable zone start for each node94client # [ 0.000000] Early memory node ranges95client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098client # [ 0.000000] psci: probing for conduit method from DT.99client # [ 0.000000] psci: PSCIv1.3 detected in firmware.100client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101client # [ 0.000000] psci: Trusted OS migration not required102client # [ 0.000000] psci: SMC Calling Convention v1.1103client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105client # [ 0.000000] Detected PIPT I-cache on CPU0106client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107client # [ 0.000000] CPU features: detected: GICv3 CPU interface108client # [ 0.000000] CPU features: detected: Spectre-v4109client # [ 0.000000] CPU features: detected: Spectre-BHB110client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112client # [ 0.000000] alternatives: applying boot alternatives113worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]114worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]115client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test/init regInfo=/nix/store/fyblb9a3ys5cssd508s2s53prxsdfvcl-closure-info/registration console=ttyAMA0,115200n8 console=tty0116worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026117worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026118worker2 # [ 0.000000] KASLR enabled119worker1 # [ 0.000000] KASLR enabled120worker2 # [ 0.000000] random: crng init done121client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/fyblb9a3ys5cssd508s2s53prxsdfvcl-closure-info/registration", will be passed to user space.122worker1 # [ 0.000000] random: crng init done123worker2 # [ 0.000000] Machine model: linux,dummy-virt124worker1 # [ 0.000000] Machine model: linux,dummy-virt125worker2 # [ 0.000000] efi: UEFI not found.126client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes127worker1 # [ 0.000000] efi: UEFI not found.128worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT129client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)130worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT131worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]132worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]133client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)134worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]135worker2 # [ 0.000000] Zone ranges:136worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]137client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB138worker1 # [ 0.000000] Zone ranges:139client # [ 0.000000] software IO TLB: area num 1.140worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]141worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]142worker2 # [ 0.000000] DMA32 empty143lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]144worker1 # [ 0.000000] DMA32 empty145client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB146worker2 # [ 0.000000] Normal empty147worker1 # [ 0.000000] Normal empty148worker2 # [ 0.000000] Device empty149worker1 # [ 0.000000] Device empty150worker2 # [ 0.000000] Movable zone start for each node151client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)152worker1 # [ 0.000000] Movable zone start for each node153worker2 # [ 0.000000] Early memory node ranges154lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026155client # [ 0.000000] Fallback order for Node 0: 0156worker1 # [ 0.000000] Early memory node ranges157lb # [ 0.000000] KASLR enabled158worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]159lb # [ 0.000000] random: crng init done160client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216161worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]162client # [ 0.000000] Policy zone: DMA163lb # [ 0.000000] Machine model: linux,dummy-virt164worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]165lb # [ 0.000000] efi: UEFI not found.166worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]167client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off168worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000169worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000170lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT171worker2 # [ 0.000000] psci: probing for conduit method from DT.172client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1173worker1 # [ 0.000000] psci: probing for conduit method from DT.174worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.175client # [ 0.000000] allocated 3145728 bytes of page_ext176lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]177worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.178worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs179client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages180lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]181worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs182lb # [ 0.000000] Zone ranges:183worker2 # [ 0.000000] psci: Trusted OS migration not required184client # [ 0.000000] ftrace: allocated 294 pages with 4 groups185worker1 # [ 0.000000] psci: Trusted OS migration not required186worker2 # [ 0.000000] psci: SMC Calling Convention v1.1187client # [ 0.000000] rcu: Hierarchical RCU implementation.188lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]189worker1 # [ 0.000000] psci: SMC Calling Convention v1.1190lb # [ 0.000000] DMA32 empty191client # [ 0.000000] rcu: RCU event tracing is enabled.192lb # [ 0.000000] Normal empty193worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)194lb # [ 0.000000] Device empty195worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)196client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.197worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296198lb # [ 0.000000] Movable zone start for each node199client # [ 0.000000] Trampoline variant of Tasks RCU enabled.200worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296201worker2 # [ 0.000000] Detected PIPT I-cache on CPU0202lb # [ 0.000000] Early memory node ranges203worker1 # [ 0.000000] Detected PIPT I-cache on CPU0204client # [ 0.000000] Rude variant of Tasks RCU enabled.205lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]206worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)207client # [ 0.000000] Tracing variant of Tasks RCU enabled.208worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)209lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]210worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface211client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.212worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface213worker2 # [ 0.000000] CPU features: detected: Spectre-v4214lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000215worker1 # [ 0.000000] CPU features: detected: Spectre-v4216worker2 # [ 0.000000] CPU features: detected: Spectre-BHB217client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1218lb # [ 0.000000] psci: probing for conduit method from DT.219worker1 # [ 0.000000] CPU features: detected: Spectre-BHB220lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.221worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38222client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.223worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38224lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs225worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23226worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23227lb # [ 0.000000] psci: Trusted OS migration not required228worker2 # [ 0.000000] alternatives: applying boot alternatives229client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.230lb # [ 0.000000] psci: SMC Calling Convention v1.1231worker1 # [ 0.000000] alternatives: applying boot alternatives232client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.233lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)234client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0235lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296236client # [ 0.000000] GICv3: 256 SPIs implemented237client # [ 0.000000] GICv3: 0 Extended SPIs implemented238lb # [ 0.000000] Detected PIPT I-cache on CPU0239client # [ 0.000000] Root IRQ handler: gic_handle_irq240worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jbmz6j4lv6g7mbr4lfjirkfpl1ip7l3n-nixos-system-worker2-test/init regInfo=/nix/store/f22848wr761m7mhl13dj0mscxryf1720-closure-info/registration console=ttyAMA0,115200n8 console=tty0241lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)242client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI243worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/26z9h8v6khkq1di9bb6h1yw8hdp2av88-nixos-system-worker1-test/init regInfo=/nix/store/amyj3rgkzzcd5a9995vqyvs20ykgifx0-closure-info/registration console=ttyAMA0,115200n8 console=tty0244lb # [ 0.000000] CPU features: detected: GICv3 CPU interface245client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0246lb # [ 0.000000] CPU features: detected: Spectre-v4247worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/f22848wr761m7mhl13dj0mscxryf1720-closure-info/registration", will be passed to user space.248client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000249lb # [ 0.000000] CPU features: detected: Spectre-BHB250worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/amyj3rgkzzcd5a9995vqyvs20ykgifx0-closure-info/registration", will be passed to user space.251client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]252lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38253worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes254client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)255lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23256worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes257worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)258lb # [ 0.000000] alternatives: applying boot alternatives259client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)260worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)261worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)262client # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000263worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)264worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB265client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000266worker2 # [ 0.000000] software IO TLB: area num 1.267worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB268worker1 # [ 0.000000] software IO TLB: area num 1.269client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.270worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB271worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB272worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)273lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1y76sp58sczakc84qnb2p7nq6lq4cpg2-nixos-system-lb-test/init regInfo=/nix/store/yf668d8xpf1l4919kivs4ak64gjacscd-closure-info/registration console=ttyAMA0,115200n8 console=tty0274client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns275worker2 # [ 0.000000] Fallback order for Node 0: 0276worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)277client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).278worker1 # [ 0.000000] Fallback order for Node 0: 0279worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216280worker2 # [ 0.000000] Policy zone: DMA281lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/yf668d8xpf1l4919kivs4ak64gjacscd-closure-info/registration", will be passed to user space.282worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216283worker1 # [ 0.000000] Policy zone: DMA284client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns285worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off286lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes287worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off288worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1289client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns290lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)291client # [ 0.000039] arm-pv: using stolen time PV292worker2 # [ 0.000000] allocated 3145728 bytes of page_ext293worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1294worker1 # [ 0.000000] allocated 3145728 bytes of page_ext295worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages296lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)297worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages298client # [ 0.000749] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)299worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups300client # [ 0.000924] Console: colour dummy device 80x25301worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups302worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.303lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB304worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.305lb # [ 0.000000] software IO TLB: area num 1.306worker2 # [ 0.000000] rcu: RCU event tracing is enabled.307client # [ 0.000931] printk: legacy console [tty0] enabled308worker1 # [ 0.000000] rcu: RCU event tracing is enabled.309worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.310lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB311client # [ 0.001121] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)312worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.313worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.314client # [ 0.001128] pid_max: default: 32768 minimum: 301315lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)316worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.317worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.318lb # [ 0.000000] Fallback order for Node 0: 0319worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.320client # [ 0.001223] LSM: initializing lsm=capability,landlock,yama,bpf,ima321worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.322client # [ 0.001398] landlock: Up and running.323worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.324lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216325worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.326client # [ 0.001401] Yama: becoming mindful.327lb # [ 0.000000] Policy zone: DMA328client # [ 0.002137] LSM support for eBPF active329worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.330worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1331lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off332worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1333client # [ 0.002312] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)334worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.335lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1336client # [ 0.002344] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)337worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.338lb # [ 0.000000] allocated 3145728 bytes of page_ext339worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.340lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages341client # [ 0.003484] cacheinfo: Unable to detect cache hierarchy for CPU 0342worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.343client # [ 0.004236] rcu: Hierarchical SRCU implementation.344lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups345worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.346client # [ 0.004240] rcu: Max phase no-delay instances is 1000.347lb # [ 0.000000] rcu: Hierarchical RCU implementation.348worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.349worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0350client # [ 0.005420] fsl-mc MSI: its@8080000 domain created351lb # [ 0.000000] rcu: RCU event tracing is enabled.352worker2 # [ 0.000000] GICv3: 256 SPIs implemented353worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0354client # [ 0.005511] EFI services will not be available.355worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented356worker1 # [ 0.000000] GICv3: 256 SPIs implemented357lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.358client # [ 0.005617] smp: Bringing up secondary CPUs ...359worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq360worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented361lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.362client # [ 0.005625] smp: Brought up 1 node, 1 CPU363worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq364worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI365lb # [ 0.000000] Rude variant of Tasks RCU enabled.366client # [ 0.005628] SMP: Total of 1 processors activated.367worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0368worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI369client # [ 0.005634] CPU: All CPU(s) started at EL1370lb # [ 0.000000] Tracing variant of Tasks RCU enabled.371worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0372worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000373client # [ 0.005645] CPU features: detected: Branch Target Identification374lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.375worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]376worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000377client # [ 0.005650] CPU features: detected: ARMv8.4 Translation Table Level378worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]379lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1380worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)381client # [ 0.005653] CPU features: detected: Instruction cache invalidation not required for I/D coherence382worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)383lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.384worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)385client # [ 0.005657] CPU features: detected: Data cache clean to the PoU not required for I/D coherence386worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)387lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.388worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000389client # [ 0.005661] CPU features: detected: Common not Private translations390worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000391client # [ 0.005664] CPU features: detected: CRC32 instructions392worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000393lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.394worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000395worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.396lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0397client # [ 0.005667] CPU features: detected: Data cache clean to Point of Deep Persistence398lb # [ 0.000000] GICv3: 256 SPIs implemented399worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.400client # [ 0.005670] CPU features: detected: Data cache clean to Point of Persistence401lb # [ 0.000000] GICv3: 0 Extended SPIs implemented402worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns403lb # [ 0.000000] Root IRQ handler: gic_handle_irq404worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns405worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).406client # [ 0.005674] CPU features: detected: Data independent timing control (DIT)407client # [ 0.005677] CPU features: detected: E0PD408lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI409worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).410lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0411client # [ 0.005680] CPU features: detected: Enhanced Counter Virtualization412worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns413lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000414client # [ 0.005682] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)415worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns416worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns417lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]418worker2 # [ 0.000030] arm-pv: using stolen time PV419client # [ 0.005686] CPU features: detected: Enhanced Virtualization Traps420worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns421worker1 # [ 0.000030] arm-pv: using stolen time PV422client # [ 0.005689] CPU features: detected: Fine Grained Traps423lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)424worker2 # [ 0.000446] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)425worker2 # [ 0.000608] Console: colour dummy device 80x25426client # [ 0.005693] CPU features: detected: Generic authentication (architected QARMA5 algorithm)427worker1 # [ 0.000457] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)428lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)429worker1 # [ 0.000637] Console: colour dummy device 80x25430client # [ 0.005699] CPU features: detected: RCpc load-acquire (LDAPR)431worker2 # [ 0.000615] printk: legacy console [tty0] enabled432lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000433worker1 # [ 0.000645] printk: legacy console [tty0] enabled434client # [ 0.005702] CPU features: detected: LSE atomic instructions435worker2 # [ 0.000836] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)436lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000437client # [ 0.005705] CPU features: detected: Privileged Access Never438worker2 # [ 0.000843] pid_max: default: 32768 minimum: 301439worker1 # [ 0.000845] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)440client # [ 0.005707] CPU features: detected: PMUv3441lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.442worker1 # [ 0.000852] pid_max: default: 32768 minimum: 301443worker2 # [ 0.000911] LSM: initializing lsm=capability,landlock,yama,bpf,ima444client # [ 0.005710] CPU features: detected: RAS Extension Support445worker2 # [ 0.001061] landlock: Up and running.446worker1 # [ 0.000937] LSM: initializing lsm=capability,landlock,yama,bpf,ima447worker2 # [ 0.001064] Yama: becoming mindful.448lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns449worker1 # [ 0.001060] landlock: Up and running.450worker2 # [ 0.001558] LSM support for eBPF active451client # [ 0.005713] CPU features: detected: RASv1p1 Extension Support452worker1 # [ 0.001063] Yama: becoming mindful.453lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).454worker1 # [ 0.001562] LSM support for eBPF active455worker2 # [ 0.001689] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)456client # [ 0.005715] CPU features: detected: Random Number Generator457worker1 # [ 0.001709] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)458lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns459client # [ 0.005718] CPU features: detected: Speculation barrier (SB)460worker2 # [ 0.001721] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)461client # [ 0.005721] CPU features: detected: Stage-2 Force Write-Back462worker1 # [ 0.001741] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)463worker2 # [ 0.002840] cacheinfo: Unable to detect cache hierarchy for CPU 0464lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns465lb # [ 0.000027] arm-pv: using stolen time PV466client # [ 0.005724] CPU features: detected: TLB range maintenance instructions467worker2 # [ 0.003540] rcu: Hierarchical SRCU implementation.468worker1 # [ 0.002822] cacheinfo: Unable to detect cache hierarchy for CPU 0469worker2 # [ 0.003544] rcu: Max phase no-delay instances is 1000.470worker1 # [ 0.003518] rcu: Hierarchical SRCU implementation.471client # [ 0.005728] CPU features: detected: Speculative Store Bypassing Safe (SSBS)472lb # [ 0.000401] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)473worker2 # [ 0.004734] fsl-mc MSI: its@8080000 domain created474worker1 # [ 0.003522] rcu: Max phase no-delay instances is 1000.475client # [ 0.005770] alternatives: applying system-wide alternatives476worker2 # [ 0.004837] EFI services will not be available.477lb # [ 0.000555] Console: colour dummy device 80x25478worker1 # [ 0.004706] fsl-mc MSI: its@8080000 domain created479lb # [ 0.000562] printk: legacy console [tty0] enabled480client # [ 0.008857] CPU features: detected: BBM Level 2 without TLB conflict abort481worker1 # [ 0.004797] EFI services will not be available.482worker2 # [ 0.004903] smp: Bringing up secondary CPUs ...483worker2 # [ 0.004911] smp: Brought up 1 node, 1 CPU484worker1 # [ 0.004860] smp: Bringing up secondary CPUs ...485worker2 # [ 0.004914] SMP: Total of 1 processors activated.486worker1 # [ 0.004868] smp: Brought up 1 node, 1 CPU487lb # [ 0.000748] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)488worker2 # [ 0.004919] CPU: All CPU(s) started at EL1489client # [ 0.009030] Memory: 1406568K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)490worker1 # [ 0.004871] SMP: Total of 1 processors activated.491lb # [ 0.000755] pid_max: default: 32768 minimum: 301492worker2 # [ 0.004930] CPU features: detected: Branch Target Identification493client # [ 0.009421] devtmpfs: initialized494worker1 # [ 0.004876] CPU: All CPU(s) started at EL1495lb # [ 0.000852] LSM: initializing lsm=capability,landlock,yama,bpf,ima496worker1 # [ 0.004898] CPU features: detected: Branch Target Identification497worker2 # [ 0.004935] CPU features: detected: ARMv8.4 Translation Table Level498client # [ 0.011300] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)499lb # [ 0.000997] landlock: Up and running.500lb # [ 0.001000] Yama: becoming mindful.501worker1 # [ 0.004904] CPU features: detected: ARMv8.4 Translation Table Level502worker2 # [ 0.004939] CPU features: detected: Instruction cache invalidation not required for I/D coherence503lb # [ 0.001470] LSM support for eBPF active504client # [ 0.011322] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).505worker1 # [ 0.004907] CPU features: detected: Instruction cache invalidation not required for I/D coherence506client # [ 0.011505] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL507worker2 # [ 0.004942] CPU features: detected: Data cache clean to the PoU not required for I/D coherence508lb # [ 0.001587] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)509client # [ 0.011509] 0 pages in range for non-PLT usage510worker2 # [ 0.004946] CPU features: detected: Common not Private translations511lb # [ 0.001619] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)512worker1 # [ 0.004911] CPU features: detected: Data cache clean to the PoU not required for I/D coherence513client # [ 0.011510] 508288 pages in range for PLT usage514worker2 # [ 0.004949] CPU features: detected: CRC32 instructions515client # [ 0.011624] pinctrl core: initialized pinctrl subsystem516lb # [ 0.002738] cacheinfo: Unable to detect cache hierarchy for CPU 0517worker1 # [ 0.004914] CPU features: detected: Common not Private translations518client # [ 0.012387] DMI not present or invalid.519lb # [ 0.003517] rcu: Hierarchical SRCU implementation.520worker1 # [ 0.004918] CPU features: detected: CRC32 instructions521worker2 # [ 0.004952] CPU features: detected: Data cache clean to Point of Deep Persistence522client # [ 0.016103] NET: Registered PF_NETLINK/PF_ROUTE protocol family523lb # [ 0.003523] rcu: Max phase no-delay instances is 1000.524worker1 # [ 0.004920] CPU features: detected: Data cache clean to Point of Deep Persistence525worker2 # [ 0.004956] CPU features: detected: Data cache clean to Point of Persistence526lb # [ 0.004685] fsl-mc MSI: its@8080000 domain created527client # [ 0.018561] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations528worker2 # [ 0.004959] CPU features: detected: Data independent timing control (DIT)529worker1 # [ 0.004924] CPU features: detected: Data cache clean to Point of Persistence530lb # [ 0.004783] EFI services will not be available.531worker2 # [ 0.004962] CPU features: detected: E0PD532lb # [ 0.004852] smp: Bringing up secondary CPUs ...533client # [ 0.018762] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations534worker1 # [ 0.004927] CPU features: detected: Data independent timing control (DIT)535lb # [ 0.004860] smp: Brought up 1 node, 1 CPU536worker2 # [ 0.004964] CPU features: detected: Enhanced Counter Virtualization537worker1 # [ 0.004930] CPU features: detected: E0PD538client # [ 0.018966] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations539lb # [ 0.004864] SMP: Total of 1 processors activated.540worker2 # [ 0.004967] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)541lb # [ 0.004869] CPU: All CPU(s) started at EL1542client # [ 0.018989] audit: initializing netlink subsys (disabled)543worker1 # [ 0.004933] CPU features: detected: Enhanced Counter Virtualization544worker2 # [ 0.004971] CPU features: detected: Enhanced Virtualization Traps545lb # [ 0.004881] CPU features: detected: Branch Target Identification546client # [ 0.019609] thermal_sys: Registered thermal governor 'fair_share'547worker1 # [ 0.004936] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)548worker2 # [ 0.004974] CPU features: detected: Fine Grained Traps549client # [ 0.019611] thermal_sys: Registered thermal governor 'bang_bang'550lb # [ 0.004886] CPU features: detected: ARMv8.4 Translation Table Level551worker1 # [ 0.004939] CPU features: detected: Enhanced Virtualization Traps552worker1 # [ 0.004942] CPU features: detected: Fine Grained Traps553worker2 # [ 0.004977] CPU features: detected: Generic authentication (architected QARMA5 algorithm)554client # [ 0.019615] thermal_sys: Registered thermal governor 'step_wise'555lb # [ 0.004889] CPU features: detected: Instruction cache invalidation not required for I/D coherence556worker2 # [ 0.004982] CPU features: detected: RCpc load-acquire (LDAPR)557client # [ 0.019620] thermal_sys: Registered thermal governor 'user_space'558worker1 # [ 0.004946] CPU features: detected: Generic authentication (architected QARMA5 algorithm)559worker2 # [ 0.004985] CPU features: detected: LSE atomic instructions560lb # [ 0.004892] CPU features: detected: Data cache clean to the PoU not required for I/D coherence561client # [ 0.019623] thermal_sys: Registered thermal governor 'power_allocator'562worker1 # [ 0.004951] CPU features: detected: RCpc load-acquire (LDAPR)563worker2 # [ 0.004988] CPU features: detected: Privileged Access Never564lb # [ 0.004896] CPU features: detected: Common not Private translations565worker1 # [ 0.004954] CPU features: detected: LSE atomic instructions566client # [ 0.019656] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1567worker2 # [ 0.004991] CPU features: detected: PMUv3568lb # [ 0.004899] CPU features: detected: CRC32 instructions569worker1 # [ 0.004957] CPU features: detected: Privileged Access Never570client # [ 0.019664] cpuidle: using governor ladder571worker2 # [ 0.004993] CPU features: detected: RAS Extension Support572worker1 # [ 0.004960] CPU features: detected: PMUv3573client # [ 0.019670] cpuidle: using governor menu574lb # [ 0.004902] CPU features: detected: Data cache clean to Point of Deep Persistence575worker2 # [ 0.004996] CPU features: detected: RASv1p1 Extension Support576worker1 # [ 0.004962] CPU features: detected: RAS Extension Support577client # [ 0.019864] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.578worker2 # [ 0.004999] CPU features: detected: Random Number Generator579lb # [ 0.004906] CPU features: detected: Data cache clean to Point of Persistence580worker1 # [ 0.004965] CPU features: detected: RASv1p1 Extension Support581client # [ 0.019880] ASID allocator initialised with 65536 entries582lb # [ 0.004909] CPU features: detected: Data independent timing control (DIT)583worker1 # [ 0.004968] CPU features: detected: Random Number Generator584client # [ 0.021141] Serial: AMBA PL011 UART driver585worker2 # [ 0.005001] CPU features: detected: Speculation barrier (SB)586lb # [ 0.004912] CPU features: detected: E0PD587worker2 # [ 0.005004] CPU features: detected: Stage-2 Force Write-Back588worker1 # [ 0.004971] CPU features: detected: Speculation barrier (SB)589client # [ 0.026396] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1590lb # [ 0.004914] CPU features: detected: Enhanced Counter Virtualization591worker2 # [ 0.005007] CPU features: detected: TLB range maintenance instructions592client # [ 0.026552] printk: console [ttyAMA0] enabled593worker1 # [ 0.004973] CPU features: detected: Stage-2 Force Write-Back594lb # [ 0.004917] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)595worker2 # [ 0.005011] CPU features: detected: Speculative Store Bypassing Safe (SSBS)596worker1 # [ 0.004976] CPU features: detected: TLB range maintenance instructions597lb # [ 0.004920] CPU features: detected: Enhanced Virtualization Traps598worker2 # [ 0.005048] alternatives: applying system-wide alternatives599worker1 # [ 0.004981] CPU features: detected: Speculative Store Bypassing Safe (SSBS)600lb # [ 0.004923] CPU features: detected: Fine Grained Traps601worker2 # [ 0.007960] CPU features: detected: BBM Level 2 without TLB conflict abort602worker1 # [ 0.005018] alternatives: applying system-wide alternatives603lb # [ 0.004927] CPU features: detected: Generic authentication (architected QARMA5 algorithm)604worker1 # [ 0.007932] CPU features: detected: BBM Level 2 without TLB conflict abort605lb # [ 0.004932] CPU features: detected: RCpc load-acquire (LDAPR)606worker2 # [ 0.008144] Memory: 1406520K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)607worker2 # [ 0.008532] devtmpfs: initialized608lb # [ 0.004935] CPU features: detected: LSE atomic instructions609worker1 # [ 0.008171] Memory: 1406536K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)610lb # [ 0.004938] CPU features: detected: Privileged Access Never611worker2 # [ 0.010375] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)612worker1 # [ 0.008551] devtmpfs: initialized613lb # [ 0.004940] CPU features: detected: PMUv3614worker1 # [ 0.010431] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)615worker2 # [ 0.010398] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).616worker2 # [ 0.010578] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL617lb # [ 0.004943] CPU features: detected: RAS Extension Support618worker1 # [ 0.010452] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).619lb # [ 0.004946] CPU features: detected: RASv1p1 Extension Support620worker1 # [ 0.010625] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL621lb # [ 0.004948] CPU features: detected: Random Number Generator622lb # [ 0.004951] CPU features: detected: Speculation barrier (SB)623client # [ 0.149112] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages624lb # [ 0.004954] CPU features: detected: Stage-2 Force Write-Back625client # [ 0.149132] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page626lb # [ 0.004957] CPU features: detected: TLB range maintenance instructions627client # [ 0.149137] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages628lb # [ 0.004962] CPU features: detected: Speculative Store Bypassing Safe (SSBS)629client # [ 0.149142] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page630lb # [ 0.004999] alternatives: applying system-wide alternatives631client # [ 0.149146] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages632lb # [ 0.007931] CPU features: detected: BBM Level 2 without TLB conflict abort633client # [ 0.149151] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page634client # [ 0.149155] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages635lb # [ 0.008128] Memory: 1406568K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)636client # [ 0.149160] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page637lb # [ 0.008543] devtmpfs: initialized638worker2 # [ 0.010583] 0 pages in range for non-PLT usage639worker2 # [ 0.010584] 508288 pages in range for PLT usage640lb # [ 0.010553] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)641worker1 # [ 0.010629] 0 pages in range for non-PLT usage642worker2 # [ 0.010697] pinctrl core: initialized pinctrl subsystem643worker1 # [ 0.010630] 508288 pages in range for PLT usage644worker2 # [ 0.011433] DMI not present or invalid.645lb # [ 0.010577] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).646client # [ 0.156852] fbcon: Taking over console647worker1 # [ 0.010721] pinctrl core: initialized pinctrl subsystem648worker2 # [ 0.014791] NET: Registered PF_NETLINK/PF_ROUTE protocol family649client # [ 0.156866] ACPI: Interpreter disabled.650lb # [ 0.010769] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL651worker1 # [ 0.011543] DMI not present or invalid.652worker2 # [ 0.016955] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations653lb # [ 0.010774] 0 pages in range for non-PLT usage654worker1 # [ 0.014952] NET: Registered PF_NETLINK/PF_ROUTE protocol family655client # [ 0.158733] iommu: Default domain type: Translated656lb # [ 0.010775] 508288 pages in range for PLT usage657worker2 # [ 0.017140] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations658worker1 # [ 0.017173] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations659client # [ 0.158742] iommu: DMA domain TLB invalidation policy: strict mode660lb # [ 0.010880] pinctrl core: initialized pinctrl subsystem661lb # [ 0.011771] DMI not present or invalid.662worker2 # [ 0.017337] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations663client # [ 0.160393] SCSI subsystem initialized664worker1 # [ 0.017366] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations665lb # [ 0.014880] NET: Registered PF_NETLINK/PF_ROUTE protocol family666worker2 # [ 0.017359] audit: initializing netlink subsys (disabled)667worker1 # [ 0.017566] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations668worker2 # [ 0.017889] thermal_sys: Registered thermal governor 'fair_share'669lb # [ 0.017222] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations670worker1 # [ 0.017587] audit: initializing netlink subsys (disabled)671worker2 # [ 0.017891] thermal_sys: Registered thermal governor 'bang_bang'672lb # [ 0.017403] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations673worker1 # [ 0.018168] thermal_sys: Registered thermal governor 'fair_share'674worker2 # [ 0.017894] thermal_sys: Registered thermal governor 'step_wise'675worker1 # [ 0.018170] thermal_sys: Registered thermal governor 'bang_bang'676lb # [ 0.017601] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations677worker2 # [ 0.017899] thermal_sys: Registered thermal governor 'user_space'678worker1 # [ 0.018174] thermal_sys: Registered thermal governor 'step_wise'679lb # [ 0.017624] audit: initializing netlink subsys (disabled)680worker2 # [ 0.017902] thermal_sys: Registered thermal governor 'power_allocator'681worker1 # [ 0.018178] thermal_sys: Registered thermal governor 'user_space'682lb # [ 0.018267] thermal_sys: Registered thermal governor 'fair_share'683worker2 # [ 0.017926] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1684worker1 # [ 0.018181] thermal_sys: Registered thermal governor 'power_allocator'685lb # [ 0.018269] thermal_sys: Registered thermal governor 'bang_bang'686worker2 # [ 0.017934] cpuidle: using governor ladder687worker2 # [ 0.017940] cpuidle: using governor menu688lb # [ 0.018273] thermal_sys: Registered thermal governor 'step_wise'689client # [ 0.165696] usbcore: registered new interface driver usbfs690worker1 # [ 0.018207] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1691client # [ 0.165733] usbcore: registered new interface driver hub692worker1 # [ 0.018215] cpuidle: using governor ladder693worker2 # [ 0.018125] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.694lb # [ 0.018278] thermal_sys: Registered thermal governor 'user_space'695worker1 # [ 0.018221] cpuidle: using governor menu696client # [ 0.165753] usbcore: registered new device driver usb697worker2 # [ 0.018141] ASID allocator initialised with 65536 entries698lb # [ 0.018281] thermal_sys: Registered thermal governor 'power_allocator'699worker2 # [ 0.019385] Serial: AMBA PL011 UART driver700worker1 # [ 0.018421] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.701client # [ 0.166046] pps_core: LinuxPPS API ver. 1 registered702lb # [ 0.018305] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1703worker1 # [ 0.018436] ASID allocator initialised with 65536 entries704worker2 # [ 0.024551] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1705client # [ 0.166052] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>706lb # [ 0.018315] cpuidle: using governor ladder707worker1 # [ 0.019643] Serial: AMBA PL011 UART driver708worker2 # [ 0.024669] printk: console [ttyAMA0] enabled709lb # [ 0.018321] cpuidle: using governor menu710client # [ 0.166063] PTP clock support registered711client # [ 0.166110] EDAC MC: Ver: 3.0.0712worker1 # [ 0.024894] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1713lb # [ 0.018517] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.714worker1 # [ 0.025045] printk: console [ttyAMA0] enabled715client # [ 0.170615] scmi_core: SCMI protocol bus registered716worker2 # [ 0.144051] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages717lb # [ 0.018532] ASID allocator initialised with 65536 entries718lb # [ 0.019809] Serial: AMBA PL011 UART driver719worker2 # [ 0.144069] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page720client # [ 0.171587] FPGA manager framework721worker1 # [ 0.145361] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages722client # [ 0.172516] vgaarb: loaded723worker2 # [ 0.144075] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages724lb # [ 0.025651] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1725worker1 # [ 0.145379] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page726worker2 # [ 0.144079] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page727lb # [ 0.025836] printk: console [ttyAMA0] enabled728client # [ 0.173146] clocksource: Switched to clocksource arch_sys_counter729worker1 # [ 0.145385] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages730worker2 # [ 0.144084] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages731worker1 # [ 0.145389] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page732worker2 # [ 0.144088] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page733worker1 # [ 0.145394] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages734worker2 # [ 0.144092] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages735worker1 # [ 0.145398] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page736worker2 # [ 0.144097] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page737worker1 # [ 0.145402] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages738client # [ 0.176924] VFS: Disk quotas dquot_6.6.0739worker1 # [ 0.145406] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page740client # [ 0.176961] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)741worker2 # [ 0.151434] fbcon: Taking over console742worker2 # [ 0.151447] ACPI: Interpreter disabled.743worker2 # [ 0.153299] iommu: Default domain type: Translated744worker1 # [ 0.152967] fbcon: Taking over console745worker2 # [ 0.153309] iommu: DMA domain TLB invalidation policy: strict mode746worker1 # [ 0.152982] ACPI: Interpreter disabled.747client # [ 0.180756] netfs: FS-Cache loaded748client # [ 0.180860] pnp: PnP ACPI: disabled749worker1 # [ 0.154837] iommu: Default domain type: Translated750worker2 # [ 0.155012] SCSI subsystem initialized751worker1 # [ 0.154847] iommu: DMA domain TLB invalidation policy: strict mode752lb # [ 0.149353] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages753lb # [ 0.149378] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page754worker1 # [ 0.156600] SCSI subsystem initialized755lb # [ 0.149384] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages756lb # [ 0.149388] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page757client # [ 0.184831] NET: Registered PF_INET protocol family758lb # [ 0.149392] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages759lb # [ 0.149397] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page760client # [ 0.185095] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)761lb # [ 0.149401] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages762lb # [ 0.149406] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page763worker2 # [ 0.162438] usbcore: registered new interface driver usbfs764lb # [ 0.156888] fbcon: Taking over console765worker2 # [ 0.162471] usbcore: registered new interface driver hub766lb # [ 0.156905] ACPI: Interpreter disabled.767worker2 # [ 0.162489] usbcore: registered new device driver usb768worker1 # [ 0.164024] usbcore: registered new interface driver usbfs769lb # [ 0.158890] iommu: Default domain type: Translated770worker2 # [ 0.162789] pps_core: LinuxPPS API ver. 1 registered771worker1 # [ 0.164056] usbcore: registered new interface driver hub772lb # [ 0.158906] iommu: DMA domain TLB invalidation policy: strict mode773worker1 # [ 0.164075] usbcore: registered new device driver usb774worker2 # [ 0.162795] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>775lb # [ 0.160570] SCSI subsystem initialized776worker1 # [ 0.164355] pps_core: LinuxPPS API ver. 1 registered777worker2 # [ 0.162805] PTP clock support registered778worker2 # [ 0.162854] EDAC MC: Ver: 3.0.0779worker1 # [ 0.164361] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>780worker2 # [ 0.167463] scmi_core: SCMI protocol bus registered781worker1 # [ 0.164371] PTP clock support registered782worker1 # [ 0.164418] EDAC MC: Ver: 3.0.0783worker2 # [ 0.168421] FPGA manager framework784worker2 # [ 0.169450] vgaarb: loaded785worker1 # [ 0.169177] scmi_core: SCMI protocol bus registered786worker1 # [ 0.170162] FPGA manager framework787worker1 # [ 0.171114] vgaarb: loaded788worker2 # [ 0.170103] clocksource: Switched to clocksource arch_sys_counter789worker2 # [ 0.170702] VFS: Disk quotas dquot_6.6.0790lb # [ 0.165737] usbcore: registered new interface driver usbfs791worker2 # [ 0.170731] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)792worker1 # [ 0.171771] clocksource: Switched to clocksource arch_sys_counter793lb # [ 0.165778] usbcore: registered new interface driver hub794worker1 # [ 0.172359] VFS: Disk quotas dquot_6.6.0795worker2 # [ 0.173103] netfs: FS-Cache loaded796lb # [ 0.165798] usbcore: registered new device driver usb797worker2 # [ 0.173215] pnp: PnP ACPI: disabled798worker1 # [ 0.172385] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)799lb # [ 0.166076] pps_core: LinuxPPS API ver. 1 registered800worker1 # [ 0.174728] netfs: FS-Cache loaded801worker1 # [ 0.174842] pnp: PnP ACPI: disabled802lb # [ 0.166082] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>803lb # [ 0.166093] PTP clock support registered804lb # [ 0.166144] EDAC MC: Ver: 3.0.0805lb # [ 0.170771] scmi_core: SCMI protocol bus registered806lb # [ 0.171773] FPGA manager framework807lb # [ 0.172728] vgaarb: loaded808lb # [ 0.173360] clocksource: Switched to clocksource arch_sys_counter809worker2 # [ 0.179066] NET: Registered PF_INET protocol family810worker2 # [ 0.179337] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)811worker1 # [ 0.180756] NET: Registered PF_INET protocol family812lb # [ 0.178201] VFS: Disk quotas dquot_6.6.0813worker1 # [ 0.181035] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)814lb # [ 0.178239] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)815lb # [ 0.181977] netfs: FS-Cache loaded816lb # [ 0.182111] pnp: PnP ACPI: disabled817client # [ 0.214875] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)818lb # [ 0.186070] NET: Registered PF_INET protocol family819lb # [ 0.186329] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)820client # [ 0.214923] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)821client # [ 0.214954] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)822client # [ 0.215034] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)823client # [ 0.215177] TCP: Hash tables configured (established 16384 bind 16384)824client # [ 0.215274] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)825client # [ 0.215311] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)826client # [ 0.215346] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)827client # [ 0.215439] NET: Registered PF_UNIX/PF_LOCAL protocol family828client # [ 0.215463] NET: Registered PF_XDP protocol family829client # [ 0.215482] PCI: CLS 0 bytes, default 64830client # [ 0.215720] Trying to unpack rootfs image as initramfs...831client # [ 0.231019] kvm [1]: HYP mode not available832worker2 # [ 0.208702] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833worker2 # [ 0.208746] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834worker1 # [ 0.210343] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)835worker2 # [ 0.208785] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)836worker1 # [ 0.210392] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)837worker2 # [ 0.208860] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)838worker1 # [ 0.210424] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)839worker2 # [ 0.209004] TCP: Hash tables configured (established 16384 bind 16384)840worker1 # [ 0.210495] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)841worker2 # [ 0.209086] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)842worker1 # [ 0.210641] TCP: Hash tables configured (established 16384 bind 16384)843worker2 # [ 0.209122] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)844worker2 # [ 0.209158] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)845worker1 # [ 0.210722] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)846worker2 # [ 0.209252] NET: Registered PF_UNIX/PF_LOCAL protocol family847worker1 # [ 0.210759] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)848worker2 # [ 0.209296] NET: Registered PF_XDP protocol family849worker1 # [ 0.210794] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)850worker2 # [ 0.209314] PCI: CLS 0 bytes, default 64851worker1 # [ 0.210909] NET: Registered PF_UNIX/PF_LOCAL protocol family852worker2 # [ 0.209556] Trying to unpack rootfs image as initramfs...853lb # [ 0.215477] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)854worker1 # [ 0.210936] NET: Registered PF_XDP protocol family855worker1 # [ 0.210956] PCI: CLS 0 bytes, default 64856lb # [ 0.215533] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)857worker1 # [ 0.211212] Trying to unpack rootfs image as initramfs...858lb # [ 0.215573] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)859lb # [ 0.215648] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)860lb # [ 0.215792] TCP: Hash tables configured (established 16384 bind 16384)861lb # [ 0.215898] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)862lb # [ 0.215939] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)863lb # [ 0.215978] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)864worker2 # [ 0.228013] kvm [1]: HYP mode not available865lb # [ 0.216099] NET: Registered PF_UNIX/PF_LOCAL protocol family866lb # [ 0.216128] NET: Registered PF_XDP protocol family867worker1 # [ 0.229855] kvm [1]: HYP mode not available868lb # [ 0.216153] PCI: CLS 0 bytes, default 64869lb # [ 0.216432] Trying to unpack rootfs image as initramfs...870lb # [ 0.231451] kvm [1]: HYP mode not available871client # [ 0.325703] Initialise system trusted keyrings872client # [ 0.326468] workingset: timestamp_bits=42 max_order=19 bucket_order=0873client # [ 0.327782] squashfs: version 4.0 (2009/01/31) Phillip Lougher874client # [ 0.328558] 9p: Installing v9fs 9p2000 file system support875worker2 # [ 0.315363] Initialise system trusted keyrings876worker2 # [ 0.322157] workingset: timestamp_bits=42 max_order=19 bucket_order=0877worker2 # [ 0.323592] squashfs: version 4.0 (2009/01/31) Phillip Lougher878worker1 # [ 0.324349] Initialise system trusted keyrings879worker1 # [ 0.325127] workingset: timestamp_bits=42 max_order=19 bucket_order=0880worker2 # [ 0.324376] 9p: Installing v9fs 9p2000 file system support881client # [ 0.352523] Key type asymmetric registered882worker1 # [ 0.326423] squashfs: version 4.0 (2009/01/31) Phillip Lougher883client # [ 0.352551] Asymmetric key parser 'x509' registered884client # [ 0.352628] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)885worker1 # [ 0.327175] 9p: Installing v9fs 9p2000 file system support886lb # [ 0.327149] Initialise system trusted keyrings887lb # [ 0.327932] workingset: timestamp_bits=42 max_order=19 bucket_order=0888lb # [ 0.329223] squashfs: version 4.0 (2009/01/31) Phillip Lougher889client # [ 0.361214] io scheduler mq-deadline registered890client # [ 0.361238] io scheduler kyber registered891client # [ 0.366439] pl061_gpio 9030000.pl061: PL061 GPIO chip registered892client # [ 0.367753] ledtrig-cpu: registered to indicate activity on CPUs893lb # [ 0.330084] 9p: Installing v9fs 9p2000 file system support894client # [ 0.368170] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:895client # [ 0.368187] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000896worker2 # [ 0.344963] Key type asymmetric registered897worker2 # [ 0.344986] Asymmetric key parser 'x509' registered898client # [ 0.368199] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000899worker2 # [ 0.345060] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)900client # [ 0.368207] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000901client # [ 0.368228] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits902client # [ 0.368249] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]903client # [ 0.368322] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00904client # [ 0.368332] pci_bus 0000:00: root bus resource [bus 00-ff]905client # [ 0.368338] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]906client # [ 0.368343] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]907client # [ 0.368348] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]908client # [ 0.368440] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint909worker2 # [ 0.354159] io scheduler mq-deadline registered910worker2 # [ 0.354178] io scheduler kyber registered911client # [ 0.368867] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint912worker1 # [ 0.355876] Key type asymmetric registered913client # [ 0.369050] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]914lb # [ 0.349979] Key type asymmetric registered915worker1 # [ 0.355904] Asymmetric key parser 'x509' registered916client # [ 0.369067] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]917lb # [ 0.350006] Asymmetric key parser 'x509' registered918worker1 # [ 0.355974] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)919client # [ 0.369097] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]920lb # [ 0.350084] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)921worker1 # [ 0.358107] io scheduler mq-deadline registered922client # [ 0.369114] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]923worker1 # [ 0.358118] io scheduler kyber registered924worker2 # [ 0.359289] pl061_gpio 9030000.pl061: PL061 GPIO chip registered925worker2 # [ 0.360586] ledtrig-cpu: registered to indicate activity on CPUs926worker2 # [ 0.360975] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:927lb # [ 0.357425] io scheduler mq-deadline registered928lb # [ 0.357447] io scheduler kyber registered929worker2 # [ 0.360992] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000930worker2 # [ 0.361006] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000931worker2 # [ 0.361014] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000932worker2 # [ 0.361034] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits933worker1 # [ 0.367902] pl061_gpio 9030000.pl061: PL061 GPIO chip registered934worker2 # [ 0.361058] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]935worker2 # [ 0.361135] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00936worker2 # [ 0.361144] pci_bus 0000:00: root bus resource [bus 00-ff]937worker2 # [ 0.361150] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]938client # [ 0.389671] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint939worker2 # [ 0.361156] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]940client # [ 0.389877] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]941worker1 # [ 0.369294] ledtrig-cpu: registered to indicate activity on CPUs942client # [ 0.389895] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]943worker2 # [ 0.361161] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]944worker1 # [ 0.369696] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:945client # [ 0.389925] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]946worker2 # [ 0.361220] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint947worker1 # [ 0.369715] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000948client # [ 0.390400] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint949worker2 # [ 0.361653] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint950worker1 # [ 0.369727] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000951client # [ 0.390586] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]952worker2 # [ 0.361838] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]953client # [ 0.390602] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]954worker2 # [ 0.361854] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]955worker1 # [ 0.369735] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000956lb # [ 0.369536] pl061_gpio 9030000.pl061: PL061 GPIO chip registered957client # [ 0.390632] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]958worker2 # [ 0.361883] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]959worker1 # [ 0.369757] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits960worker2 # [ 0.361900] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]961client # [ 0.391085] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint962worker1 # [ 0.369780] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]963client # [ 0.391279] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]964client # [ 0.391296] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]965worker1 # [ 0.369860] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00966lb # [ 0.370996] ledtrig-cpu: registered to indicate activity on CPUs967worker1 # [ 0.369870] pci_bus 0000:00: root bus resource [bus 00-ff]968client # [ 0.391328] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]969worker1 # [ 0.369876] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]970lb # [ 0.371423] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:971client # [ 0.391786] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint972worker1 # [ 0.369881] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]973client # [ 0.391970] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]974lb # [ 0.371442] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000975worker1 # [ 0.369886] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]976client # [ 0.391987] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]977lb # [ 0.371461] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000978client # [ 0.392016] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]979worker1 # [ 0.369944] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint980lb # [ 0.371471] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000981client # [ 0.392467] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint982worker1 # [ 0.370385] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint983client # [ 0.392649] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]984worker1 # [ 0.370573] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]985lb # [ 0.371500] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits986client # [ 0.392664] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]987worker1 # [ 0.370590] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]988lb # [ 0.371529] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]989worker1 # [ 0.370620] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]990client # [ 0.392694] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]991lb # [ 0.371610] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00992worker2 # [ 0.382431] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint993worker1 # [ 0.370636] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]994client # [ 0.393164] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint995lb # [ 0.371621] pci_bus 0000:00: root bus resource [bus 00-ff]996worker2 # [ 0.382635] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]997worker1 # [ 0.371096] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint998client # [ 0.393348] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]999lb # [ 0.371627] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1000worker2 # [ 0.382652] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1001worker1 # [ 0.371281] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1002client # [ 0.393364] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1003lb # [ 0.371632] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1004worker2 # [ 0.382682] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1005worker1 # [ 0.371298] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1006client # [ 0.393393] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1007lb # [ 0.371637] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1008worker2 # [ 0.383160] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1009worker1 # [ 0.371327] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1010client # [ 0.393410] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1011worker2 # [ 0.383347] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1012lb # [ 0.371697] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1013worker2 # [ 0.383362] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1014client # [ 0.393899] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1015lb # [ 0.372158] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1016client # [ 0.394086] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1017worker2 # [ 0.383392] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1018worker1 # [ 0.390505] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1019lb # [ 0.372351] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1020client # [ 0.394116] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1021worker2 # [ 0.383847] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1022worker1 # [ 0.390695] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1023lb # [ 0.372369] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1024worker2 # [ 0.384030] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1025worker1 # [ 0.390710] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1026client # [ 0.394578] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1027lb # [ 0.372402] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1028worker2 # [ 0.384046] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1029client # [ 0.394765] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1030worker1 # [ 0.390740] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1031lb # [ 0.372420] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1032worker2 # [ 0.384078] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1033client # [ 0.394795] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1034worker1 # [ 0.391207] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1035lb # [ 0.372913] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1036worker2 # [ 0.384548] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1037worker1 # [ 0.391392] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1038client # [ 0.395185] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1039lb # [ 0.373105] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1040worker2 # [ 0.384733] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1041worker1 # [ 0.391407] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1042client # [ 0.395374] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1043lb # [ 0.373122] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1044worker2 # [ 0.384749] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1045worker1 # [ 0.391439] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1046lb # [ 0.373153] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1047client # [ 0.395620] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1048worker2 # [ 0.384786] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1049client # [ 0.395907] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1050worker2 # [ 0.385268] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1051client # [ 0.395924] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1052worker2 # [ 0.385452] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1053lb # [ 0.392363] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1054client # [ 0.395953] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1055worker2 # [ 0.385468] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1056lb # [ 0.392554] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1057client # [ 0.396420] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1058worker2 # [ 0.385498] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1059lb # [ 0.392572] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1060client # [ 0.396602] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1061worker2 # [ 0.385946] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1062lb # [ 0.392603] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1063client # [ 0.396619] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1064lb # [ 0.393067] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1065client # [ 0.396650] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1066lb # [ 0.393253] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1067lb # [ 0.393271] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1068lb # [ 0.393306] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1069worker2 # [ 0.406164] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1070worker2 # [ 0.406187] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1071worker2 # [ 0.406216] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1072worker1 # [ 0.403962] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1073worker2 # [ 0.406233] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1074worker1 # [ 0.404156] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1075worker2 # [ 0.406704] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1076worker1 # [ 0.404173] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1077worker2 # [ 0.406895] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1078worker1 # [ 0.404203] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1079client # [ 0.437282] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1080worker2 # [ 0.406925] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1081worker1 # [ 0.404662] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1082client # [ 0.437304] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1083worker2 # [ 0.407375] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1084worker1 # [ 0.404845] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1085worker2 # [ 0.407559] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1086client # [ 0.437310] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1087worker1 # [ 0.404861] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1088worker2 # [ 0.407590] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1089worker1 # [ 0.404897] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1090client # [ 0.437360] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1091worker2 # [ 0.407988] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1092worker1 # [ 0.405383] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1093client # [ 0.437410] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1094worker2 # [ 0.408169] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1095worker1 # [ 0.405568] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1096lb # [ 0.405897] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1097client # [ 0.437458] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1098worker1 # [ 0.405584] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1099lb # [ 0.406123] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1100worker2 # [ 0.408411] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1101client # [ 0.437505] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1102worker1 # [ 0.405613] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1103lb # [ 0.406143] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1104worker2 # [ 0.408675] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1105worker1 # [ 0.405628] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1106worker2 # [ 0.408692] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1107client # [ 0.437553] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1108lb # [ 0.406177] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1109worker2 # [ 0.408721] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1110worker1 # [ 0.406073] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1111lb # [ 0.406690] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1112client # [ 0.437603] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1113worker1 # [ 0.406258] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1114worker2 # [ 0.409183] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1115lb # [ 0.406879] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1116client # [ 0.437650] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1117worker1 # [ 0.406288] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1118worker2 # [ 0.409365] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1119lb # [ 0.406895] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1120worker2 # [ 0.409381] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1121client # [ 0.437698] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1122lb # [ 0.406940] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1123worker1 # [ 0.406738] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1124worker2 # [ 0.409410] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1125client # [ 0.437747] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1126worker1 # [ 0.406927] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1127lb # [ 0.407406] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1128worker2 # [ 0.410000] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1129worker1 # [ 0.406956] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1130lb # [ 0.407596] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1131client # [ 0.437849] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1132worker2 # [ 0.410011] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1133lb # [ 0.407613] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1134client # [ 0.437897] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1135worker1 # [ 0.407344] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1136lb # [ 0.407644] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1137worker2 # [ 0.410017] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1138worker1 # [ 0.407525] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1139client # [ 0.437919] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1140lb # [ 0.407661] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1141worker2 # [ 0.410062] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1142client # [ 0.437941] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1143worker1 # [ 0.407785] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1144lb # [ 0.408145] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1145worker1 # [ 0.408049] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1146client # [ 0.437963] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1147worker1 # [ 0.408067] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1148lb # [ 0.408338] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1149client # [ 0.437988] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1150lb # [ 0.408370] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1151worker1 # [ 0.408097] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1152client # [ 0.438010] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1153worker1 # [ 0.408569] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1154lb # [ 0.408834] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1155client # [ 0.438032] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1156worker1 # [ 0.408752] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1157lb # [ 0.409027] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1158client # [ 0.438054] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1159worker1 # [ 0.408768] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1160lb # [ 0.409059] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1161client # [ 0.438076] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1162worker1 # [ 0.408804] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1163lb # [ 0.409484] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1164client # [ 0.438099] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1165worker1 # [ 0.409369] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1166lb # [ 0.409673] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1167client # [ 0.438122] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1168worker1 # [ 0.409381] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1169client # [ 0.438145] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1170lb # [ 0.409930] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1171worker1 # [ 0.409387] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1172lb # [ 0.410212] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1173client # [ 0.438167] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1174client # [ 0.438188] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1175lb # [ 0.410232] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1176worker1 # [ 0.409431] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1177worker2 # [ 0.434118] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1178client # [ 0.438210] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1179lb # [ 0.410263] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1180worker1 # [ 0.409478] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1181client # [ 0.438232] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1182worker2 # [ 0.434178] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1183lb # [ 0.410745] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1184worker1 # [ 0.409524] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1185client # [ 0.438254] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1186lb # [ 0.410941] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1187worker2 # [ 0.434227] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1188client # [ 0.438275] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1189worker1 # [ 0.409569] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1190lb # [ 0.410959] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1191worker2 # [ 0.434275] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1192client # [ 0.438297] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1193worker1 # [ 0.409616] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1194lb # [ 0.410990] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1195worker2 # [ 0.434325] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1196client # [ 0.438320] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1197lb # [ 0.411600] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1198worker1 # [ 0.409661] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1199client # [ 0.438348] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1200worker2 # [ 0.434373] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1201lb # [ 0.411614] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1202client # [ 0.438377] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1203worker1 # [ 0.409708] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1204worker2 # [ 0.434421] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1205client # [ 0.438387] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1206lb # [ 0.411620] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1207worker1 # [ 0.409754] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1208worker2 # [ 0.434477] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1209client # [ 0.438392] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1210lb # [ 0.411666] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1211worker1 # [ 0.409801] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1212worker2 # [ 0.434573] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1213client # [ 0.439576] pci 0000:00:0a.0: enabling device (0000 -> 0002)1214lb # [ 0.411715] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1215worker1 # [ 0.409875] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1216worker2 # [ 0.434621] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1217lb # [ 0.411764] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1218worker1 # [ 0.409920] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1219worker2 # [ 0.434648] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1220worker1 # [ 0.409941] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1221lb # [ 0.411813] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1222worker2 # [ 0.434670] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1223worker1 # [ 0.409962] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1224lb # [ 0.411862] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1225worker2 # [ 0.434693] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1226worker1 # [ 0.409984] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1227worker2 # [ 0.434718] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1228lb # [ 0.411911] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1229worker1 # [ 0.410009] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1230worker2 # [ 0.434739] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1231lb # [ 0.411959] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1232worker1 # [ 0.410030] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1233worker2 # [ 0.434761] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1234worker1 # [ 0.410053] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1235lb # [ 0.412008] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1236worker2 # [ 0.434784] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1237worker1 # [ 0.410075] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1238lb # [ 0.412056] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1239worker2 # [ 0.434806] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1240worker1 # [ 0.410097] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1241lb # [ 0.412134] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1242worker2 # [ 0.434828] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1243worker1 # [ 0.410118] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1244lb # [ 0.412182] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1245worker2 # [ 0.434851] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1246worker1 # [ 0.410141] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1247worker2 # [ 0.434874] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1248lb # [ 0.412205] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1249worker1 # [ 0.410163] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1250worker2 # [ 0.434895] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1251lb # [ 0.412229] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1252worker1 # [ 0.410185] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1253worker2 # [ 0.434916] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1254lb # [ 0.412252] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1255worker1 # [ 0.410206] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1256worker2 # [ 0.434937] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1257lb # [ 0.412279] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1258worker1 # [ 0.410227] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1259worker2 # [ 0.434958] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1260lb # [ 0.412303] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1261worker1 # [ 0.410247] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1262worker2 # [ 0.434980] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1263lb # [ 0.412328] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1264worker1 # [ 0.410269] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1265worker2 # [ 0.435002] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1266lb # [ 0.412352] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1267worker2 # [ 0.435024] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1268worker1 # [ 0.410291] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1269lb # [ 0.412376] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1270worker2 # [ 0.435046] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1271worker1 # [ 0.410313] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1272worker2 # [ 0.435068] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1273lb # [ 0.412400] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1274worker1 # [ 0.410335] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1275worker2 # [ 0.435096] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1276worker1 # [ 0.410357] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1277lb # [ 0.412423] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1278worker2 # [ 0.435105] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1279worker1 # [ 0.410383] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1280lb # [ 0.412447] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1281worker2 # [ 0.435110] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1282worker1 # [ 0.410392] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1283lb # [ 0.412471] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1284worker2 # [ 0.436287] pci 0000:00:0a.0: enabling device (0000 -> 0002)1285worker1 # [ 0.410397] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1286lb # [ 0.412494] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1287worker1 # [ 0.411563] pci 0000:00:0a.0: enabling device (0000 -> 0002)1288lb # [ 0.412517] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1289lb # [ 0.412540] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1290lb # [ 0.412563] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1291lb # [ 0.412586] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1292lb # [ 0.412609] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1293lb # [ 0.412633] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1294lb # [ 0.412657] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1295lb # [ 0.412686] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1296client # [ 0.495955] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1297lb # [ 0.412697] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1298lb # [ 0.412702] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1299worker1 # [ 0.471902] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 58929 usecs1300client # [ 0.502200] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1301client # [ 0.504222] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1302lb # [ 0.473983] pci 0000:00:0a.0: enabling device (0000 -> 0002)1303worker2 # [ 0.483611] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1304worker2 # [ 0.485734] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1305client # [ 0.514553] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1306client # [ 0.516764] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1307worker1 # [ 0.492177] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1308worker1 # [ 0.494401] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1309worker2 # [ 0.496847] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1310client # [ 0.527875] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1311lb # [ 0.495681] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1312client # [ 0.530873] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1313worker1 # [ 0.504391] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1314client # [ 0.532925] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1315worker1 # [ 0.506505] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1316lb # [ 0.505591] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1317lb # [ 0.509228] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1318worker2 # [ 0.510704] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1319worker2 # [ 0.512576] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1320client # [ 0.542996] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1321worker2 # [ 0.514713] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1322client # [ 0.544862] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1323worker2 # [ 0.516822] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1324worker1 # [ 0.516313] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1325worker1 # [ 0.519147] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1326worker1 # [ 0.521215] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1327worker1 # [ 0.523351] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1328lb # [ 0.518699] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1329worker2 # [ 0.527165] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1330client # [ 0.556154] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1331worker2 # [ 0.529341] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1332worker1 # [ 0.533527] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1333worker1 # [ 0.535323] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1334worker2 # [ 0.540443] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1335lb # [ 0.529950] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1336lb # [ 0.532022] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1337client # [ 0.570141] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1338lb # [ 0.534173] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1339worker2 # [ 0.543608] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1340client # [ 0.572912] msm_serial: driver initialized1341lb # [ 0.536559] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1342client # [ 0.573070] SuperH (H)SCI(F) driver initialized1343client # [ 0.573126] STM32 USART driver initialized1344worker1 # [ 0.546860] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1345lb # [ 0.547374] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1346lb # [ 0.549331] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1347worker2 # [ 0.556611] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1348worker1 # [ 0.561058] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1349worker2 # [ 0.559055] msm_serial: driver initialized1350worker2 # [ 0.559199] SuperH (H)SCI(F) driver initialized1351worker2 # [ 0.559253] STM32 USART driver initialized1352worker1 # [ 0.563658] msm_serial: driver initialized1353lb # [ 0.559429] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1354worker1 # [ 0.564372] SuperH (H)SCI(F) driver initialized1355worker1 # [ 0.564429] STM32 USART driver initialized1356client # [ 0.604225] loop: module loaded1357client # [ 0.604434] virtio_blk virtio5: 1/0/0 default/read/poll queues1358client # [ 0.606399] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1359lb # [ 0.574801] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1360lb # [ 0.577787] msm_serial: driver initialized1361lb # [ 0.577952] SuperH (H)SCI(F) driver initialized1362lb # [ 0.578012] STM32 USART driver initialized1363worker2 # [ 0.590710] loop: module loaded1364worker2 # [ 0.590875] virtio_blk virtio5: 1/0/0 default/read/poll queues1365worker2 # [ 0.591594] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1366client # [ 0.617780] megasas: 07.734.00.00-rc11367worker1 # [ 0.598400] loop: module loaded1368client # [ 0.618544] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1369worker1 # [ 0.598583] virtio_blk virtio5: 1/0/0 default/read/poll queues1370client # [ 0.620715] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001371worker1 # [ 0.599359] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1372client # [ 0.620743] Intel/Sharp Extended Query Table at 0x00311373client # [ 0.622365] Using buffer write method1374client # [ 0.622438] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1375client # [ 0.624190] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001376client # [ 0.624223] Intel/Sharp Extended Query Table at 0x00311377worker1 # [ 0.604371] megasas: 07.734.00.00-rc11378worker1 # [ 0.605128] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1379worker1 # [ 0.607316] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001380worker2 # [ 0.602798] megasas: 07.734.00.00-rc11381worker1 # [ 0.607336] Intel/Sharp Extended Query Table at 0x00311382worker2 # [ 0.603498] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1383worker2 # [ 0.605751] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001384worker2 # [ 0.605807] Intel/Sharp Extended Query Table at 0x00311385worker2 # [ 0.607318] Using buffer write method1386worker2 # [ 0.607380] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1387worker2 # [ 0.609048] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001388client # [ 0.642804] Using buffer write method1389client # [ 0.642838] Concatenating MTD devices:1390worker2 # [ 0.609076] Intel/Sharp Extended Query Table at 0x00311391client # [ 0.642842] (0): "0.flash"1392client # [ 0.642846] (1): "0.flash"1393client # [ 0.642850] into device "0.flash"1394lb # [ 0.612236] loop: module loaded1395worker1 # [ 0.616853] Using buffer write method1396lb # [ 0.612431] virtio_blk virtio5: 1/0/0 default/read/poll queues1397worker1 # [ 0.616928] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1398lb # [ 0.613159] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1399worker1 # [ 0.619671] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001400worker1 # [ 0.619695] Intel/Sharp Extended Query Table at 0x00311401lb # [ 0.617989] megasas: 07.734.00.00-rc11402worker2 # [ 0.626655] Using buffer write method1403worker2 # [ 0.626689] Concatenating MTD devices:1404worker2 # [ 0.626694] (0): "0.flash"1405lb # [ 0.618758] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1406worker2 # [ 0.626697] (1): "0.flash"1407worker2 # [ 0.626701] into device "0.flash"1408lb # [ 0.621175] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001409lb # [ 0.621197] Intel/Sharp Extended Query Table at 0x00311410worker1 # [ 0.632958] Using buffer write method1411worker1 # [ 0.632994] Concatenating MTD devices:1412worker1 # [ 0.632999] (0): "0.flash"1413worker1 # [ 0.633003] (1): "0.flash"1414worker1 # [ 0.633007] into device "0.flash"1415lb # [ 0.630346] Using buffer write method1416lb # [ 0.630429] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1417lb # [ 0.632815] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001418lb # [ 0.632847] Intel/Sharp Extended Query Table at 0x00311419lb # [ 0.642293] Using buffer write method1420lb # [ 0.642321] Concatenating MTD devices:1421lb # [ 0.642325] (0): "0.flash"1422lb # [ 0.642330] (1): "0.flash"1423lb # [ 0.642333] into device "0.flash"1424client # [ 0.876973] Freeing initrd memory: 26160K1425client # [ 0.883127] tun: Universal TUN/TAP device driver, 1.61426client # [ 0.886951] thunder_xcv, ver 1.01427client # [ 0.886998] thunder_bgx, ver 1.01428client # [ 0.887022] nicpf, ver 1.01429worker2 # [ 0.862965] Freeing initrd memory: 26148K1430client # [ 0.887613] e1000: Intel(R) PRO/1000 Network Driver1431client # [ 0.887621] e1000: Copyright (c) 1999-2006 Intel Corporation.1432worker1 # [ 0.865950] Freeing initrd memory: 26148K1433client # [ 0.887646] e1000e: Intel(R) PRO/1000 Network Driver1434client # [ 0.887655] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1435client # [ 0.887685] igb: Intel(R) Gigabit Ethernet Network Driver1436client # [ 0.887691] igb: Copyright (c) 2007-2014 Intel Corporation.1437client # [ 0.887714] igbvf: Intel(R) Gigabit Virtual Function Network Driver1438worker2 # [ 0.869183] tun: Universal TUN/TAP device driver, 1.61439client # [ 0.887720] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1440client # [ 0.887864] sky2: driver version 1.301441client # [ 0.889841] ehci-pci 0000:00:0a.0: EHCI Host Controller1442client # [ 0.889895] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11443worker1 # [ 0.872074] tun: Universal TUN/TAP device driver, 1.61444client # [ 0.890115] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001445worker2 # [ 0.872895] thunder_xcv, ver 1.01446worker2 # [ 0.872939] thunder_bgx, ver 1.01447worker2 # [ 0.872961] nicpf, ver 1.01448client # [ 0.900173] usbcore: registered new interface driver usb-storage1449worker2 # [ 0.873521] e1000: Intel(R) PRO/1000 Network Driver1450worker1 # [ 0.875760] thunder_xcv, ver 1.01451client # [ 0.900230] usbcore: registered new interface driver usbserial_generic1452worker2 # [ 0.873528] e1000: Copyright (c) 1999-2006 Intel Corporation.1453client # [ 0.900245] usbserial: USB Serial support registered for generic1454worker2 # [ 0.873551] e1000e: Intel(R) PRO/1000 Network Driver1455client # [ 0.900864] hv_vmbus: registering driver hyperv_keyboard1456worker2 # [ 0.873560] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1457client # [ 0.904112] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001458worker2 # [ 0.873587] igb: Intel(R) Gigabit Ethernet Network Driver1459client # [ 0.905194] hub 1-0:1.0: USB hub found1460worker2 # [ 0.873593] igb: Copyright (c) 2007-2014 Intel Corporation.1461client # [ 0.905699] hub 1-0:1.0: 6 ports detected1462worker2 # [ 0.873616] igbvf: Intel(R) Gigabit Virtual Function Network Driver1463worker2 # [ 0.873622] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1464worker1 # [ 0.876264] thunder_bgx, ver 1.01465worker2 # [ 0.873761] sky2: driver version 1.301466worker1 # [ 0.876297] nicpf, ver 1.01467worker1 # [ 0.876858] e1000: Intel(R) PRO/1000 Network Driver1468client # [ 0.907164] rtc-pl031 9010000.pl031: registered as rtc01469worker1 # [ 0.876865] e1000: Copyright (c) 1999-2006 Intel Corporation.1470worker1 # [ 0.876899] e1000e: Intel(R) PRO/1000 Network Driver1471client # [ 0.907192] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:40 UTC (1789896760)1472client # [ 0.907536] i2c_dev: i2c /dev entries driver1473worker1 # [ 0.876908] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1474worker1 # [ 0.876941] igb: Intel(R) Gigabit Ethernet Network Driver1475worker1 # [ 0.876947] igb: Copyright (c) 2007-2014 Intel Corporation.1476worker2 # [ 0.882732] usbcore: registered new interface driver usb-storage1477worker1 # [ 0.876970] igbvf: Intel(R) Gigabit Virtual Function Network Driver1478worker2 # [ 0.882813] usbcore: registered new interface driver usbserial_generic1479worker1 # [ 0.876976] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1480worker2 # [ 0.882828] usbserial: USB Serial support registered for generic1481client # [ 0.912711] sdhci: Secure Digital Host Controller Interface driver1482worker1 # [ 0.877111] sky2: driver version 1.301483client # [ 0.912724] sdhci: Copyright(c) Pierre Ossman1484worker2 # [ 0.883441] hv_vmbus: registering driver hyperv_keyboard1485worker1 # [ 0.878693] usbcore: registered new interface driver usb-storage1486client # [ 0.913004] Synopsys Designware Multimedia Card Interface Driver1487worker2 # [ 0.884743] ehci-pci 0000:00:0a.0: EHCI Host Controller1488worker1 # [ 0.878795] usbcore: registered new interface driver usbserial_generic1489worker2 # [ 0.884777] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11490worker1 # [ 0.878811] usbserial: USB Serial support registered for generic1491worker2 # [ 0.885070] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001492worker1 # [ 0.879398] hv_vmbus: registering driver hyperv_keyboard1493worker1 # [ 0.880537] ehci-pci 0000:00:0a.0: EHCI Host Controller1494client # [ 0.915416] sdhci-pltfm: SDHCI platform and OF driver helper1495worker1 # [ 0.880563] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11496worker2 # [ 0.890571] rtc-pl031 9010000.pl031: registered as rtc01497worker1 # [ 0.880766] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001498client # [ 0.917986] hid: raw HID events driver (C) Jiri Kosina1499worker2 # [ 0.890600] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:40 UTC (1789896760)1500worker2 # [ 0.890947] i2c_dev: i2c /dev entries driver1501worker1 # [ 0.892324] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001502client # [ 0.918245] usbcore: registered new interface driver usbhid1503worker1 # [ 0.892648] hub 1-0:1.0: USB hub found1504client # [ 0.918255] usbhid: USB HID core driver1505worker1 # [ 0.892663] hub 1-0:1.0: 6 ports detected1506worker1 # [ 0.895760] rtc-pl031 9010000.pl031: registered as rtc01507client # [ 0.921209] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1508worker1 # [ 0.896454] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:40 UTC (1789896760)1509client # [ 0.922795] drop_monitor: Initializing network drop monitor service1510worker2 # [ 0.895965] sdhci: Secure Digital Host Controller Interface driver1511worker1 # [ 0.896816] i2c_dev: i2c /dev entries driver1512client # [ 0.922943] NET: Registered PF_INET6 protocol family1513worker2 # [ 0.895975] sdhci: Copyright(c) Pierre Ossman1514worker2 # [ 0.896244] Synopsys Designware Multimedia Card Interface Driver1515client # [ 0.925982] Segment Routing with IPv61516client # [ 0.925999] In-situ OAM (IOAM) with IPv61517worker2 # [ 0.896621] sdhci-pltfm: SDHCI platform and OF driver helper1518client # [ 0.926043] NET: Registered PF_PACKET protocol family1519worker2 # [ 0.900811] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001520worker2 # [ 0.901875] hub 1-0:1.0: USB hub found1521worker2 # [ 0.901907] hub 1-0:1.0: 6 ports detected1522client # [ 0.927712] 9pnet: Installing 9P2000 support1523worker1 # [ 0.901071] sdhci: Secure Digital Host Controller Interface driver1524worker1 # [ 0.901080] sdhci: Copyright(c) Pierre Ossman1525worker2 # [ 0.903504] hid: raw HID events driver (C) Jiri Kosina1526worker1 # [ 0.901343] Synopsys Designware Multimedia Card Interface Driver1527worker2 # [ 0.903752] usbcore: registered new interface driver usbhid1528worker1 # [ 0.901717] sdhci-pltfm: SDHCI platform and OF driver helper1529worker2 # [ 0.903759] usbhid: USB HID core driver1530worker1 # [ 0.903419] hid: raw HID events driver (C) Jiri Kosina1531client # [ 0.930595] Key type dns_resolver registered1532worker1 # [ 0.903677] usbcore: registered new interface driver usbhid1533worker1 # [ 0.903683] usbhid: USB HID core driver1534worker2 # [ 0.906695] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1535worker2 # [ 0.908261] drop_monitor: Initializing network drop monitor service1536lb # [ 0.903986] Freeing initrd memory: 26140K1537worker2 # [ 0.908449] NET: Registered PF_INET6 protocol family1538client # [ 0.937122] registered taskstats version 11539worker2 # [ 0.911484] Segment Routing with IPv61540worker1 # [ 0.909328] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1541worker2 # [ 0.911502] In-situ OAM (IOAM) with IPv61542worker1 # [ 0.910823] drop_monitor: Initializing network drop monitor service1543worker2 # [ 0.911532] NET: Registered PF_PACKET protocol family1544worker1 # [ 0.911010] NET: Registered PF_INET6 protocol family1545worker1 # [ 0.914097] Segment Routing with IPv61546worker2 # [ 0.913210] 9pnet: Installing 9P2000 support1547worker1 # [ 0.914127] In-situ OAM (IOAM) with IPv61548client # [ 0.937816] Loading compiled-in X.509 certificates1549worker1 # [ 0.914156] NET: Registered PF_PACKET protocol family1550lb # [ 0.910284] tun: Universal TUN/TAP device driver, 1.61551worker2 # [ 0.915939] Key type dns_resolver registered1552worker1 # [ 0.916031] 9pnet: Installing 9P2000 support1553client # [ 0.946017] Demotion targets for Node 0: null1554worker1 # [ 0.918200] Key type dns_resolver registered1555client # [ 0.946121] Key type .fscrypt registered1556client # [ 0.946128] Key type fscrypt-provisioning registered1557client # [ 0.946224] ima: No TPM chip found, activating TPM-bypass!1558client # [ 0.946243] ima: Allocated hash algorithm: sha11559client # [ 0.946266] ima: No architecture policies found1560lb # [ 0.914107] thunder_xcv, ver 1.01561client # [ 0.950322] input: gpio-keys as /devices/platform/gpio-keys/input/input01562lb # [ 0.914152] thunder_bgx, ver 1.01563lb # [ 0.914177] nicpf, ver 1.01564lb # [ 0.914774] e1000: Intel(R) PRO/1000 Network Driver1565lb # [ 0.914781] e1000: Copyright (c) 1999-2006 Intel Corporation.1566worker2 # [ 0.922123] registered taskstats version 11567lb # [ 0.914807] e1000e: Intel(R) PRO/1000 Network Driver1568worker2 # [ 0.922269] Loading compiled-in X.509 certificates1569lb # [ 0.914814] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1570worker1 # [ 0.925072] registered taskstats version 11571lb # [ 0.914844] igb: Intel(R) Gigabit Ethernet Network Driver1572worker1 # [ 0.925231] Loading compiled-in X.509 certificates1573lb # [ 0.914850] igb: Copyright (c) 2007-2014 Intel Corporation.1574lb # [ 0.914874] igbvf: Intel(R) Gigabit Virtual Function Network Driver1575lb # [ 0.914880] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1576lb # [ 0.915041] sky2: driver version 1.301577worker2 # [ 0.930976] Demotion targets for Node 0: null1578lb # [ 0.916818] usbcore: registered new interface driver usb-storage1579worker2 # [ 0.931086] Key type .fscrypt registered1580lb # [ 0.916969] usbcore: registered new interface driver usbserial_generic1581worker2 # [ 0.931093] Key type fscrypt-provisioning registered1582lb # [ 0.916985] usbserial: USB Serial support registered for generic1583worker2 # [ 0.931185] ima: No TPM chip found, activating TPM-bypass!1584worker2 # [ 0.931204] ima: Allocated hash algorithm: sha11585lb # [ 0.918130] ehci-pci 0000:00:0a.0: EHCI Host Controller1586worker1 # [ 0.933637] Demotion targets for Node 0: null1587worker2 # [ 0.931225] ima: No architecture policies found1588worker1 # [ 0.933745] Key type .fscrypt registered1589lb # [ 0.918157] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11590worker1 # [ 0.933751] Key type fscrypt-provisioning registered1591lb # [ 0.918379] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001592worker1 # [ 0.933845] ima: No TPM chip found, activating TPM-bypass!1593worker2 # [ 0.935528] input: gpio-keys as /devices/platform/gpio-keys/input/input01594worker1 # [ 0.933864] ima: Allocated hash algorithm: sha11595lb # [ 0.930093] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001596worker1 # [ 0.933887] ima: No architecture policies found1597lb # [ 0.930435] hub 1-0:1.0: USB hub found1598lb # [ 0.930455] hub 1-0:1.0: 6 ports detected1599worker1 # [ 0.937997] input: gpio-keys as /devices/platform/gpio-keys/input/input01600lb # [ 0.932841] hv_vmbus: registering driver hyperv_keyboard1601lb # [ 0.934473] rtc-pl031 9010000.pl031: registered as rtc01602lb # [ 0.934503] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:41 UTC (1789896761)1603lb # [ 0.934831] i2c_dev: i2c /dev entries driver1604client # [ 0.969222] clk: Disabling unused clocks1605client # [ 0.969247] PM: genpd: Disabling unused power domains1606lb # [ 0.940155] sdhci: Secure Digital Host Controller Interface driver1607client # [ 0.973528] Freeing unused kernel memory: 4736K1608lb # [ 0.940168] sdhci: Copyright(c) Pierre Ossman1609client # [ 0.973730] Run /init as init process1610lb # [ 0.940472] Synopsys Designware Multimedia Card Interface Driver1611lb # [ 0.940884] sdhci-pltfm: SDHCI platform and OF driver helper1612lb # [ 0.945572] hid: raw HID events driver (C) Jiri Kosina1613lb # [ 0.945838] usbcore: registered new interface driver usbhid1614lb # [ 0.945844] usbhid: USB HID core driver1615worker2 # [ 0.953905] clk: Disabling unused clocks1616worker2 # [ 0.953938] PM: genpd: Disabling unused power domains1617lb # [ 0.948898] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1618lb # [ 0.951645] drop_monitor: Initializing network drop monitor service1619worker1 # [ 0.956354] clk: Disabling unused clocks1620worker2 # [ 0.958211] Freeing unused kernel memory: 4736K1621lb # [ 0.951846] NET: Registered PF_INET6 protocol family1622worker1 # [ 0.956378] PM: genpd: Disabling unused power domains1623worker2 # [ 0.958405] Run /init as init process1624lb # [ 0.954013] Segment Routing with IPv61625lb # [ 0.954044] In-situ OAM (IOAM) with IPv61626lb # [ 0.954085] NET: Registered PF_PACKET protocol family1627worker1 # [ 0.960626] Freeing unused kernel memory: 4736K1628worker1 # [ 0.960836] Run /init as init process1629lb # [ 0.955754] 9pnet: Installing 9P2000 support1630client # [ 0.991505] systemd[1]: Successfully made /usr/ read-only.1631lb # [ 0.958517] Key type dns_resolver registered1632lb # [ 0.965144] registered taskstats version 11633lb # [ 0.965298] Loading compiled-in X.509 certificates1634worker2 # [ 0.976387] systemd[1]: Successfully made /usr/ read-only.1635worker1 # [ 0.978142] systemd[1]: Successfully made /usr/ read-only.1636lb # [ 0.974137] Demotion targets for Node 0: null1637lb # [ 0.974248] Key type .fscrypt registered1638lb # [ 0.974255] Key type fscrypt-provisioning registered1639lb # [ 0.974351] ima: No TPM chip found, activating TPM-bypass!1640lb # [ 0.974371] ima: Allocated hash algorithm: sha11641lb # [ 0.974395] ima: No architecture policies found1642lb # [ 0.978490] input: gpio-keys as /devices/platform/gpio-keys/input/input01643lb # [ 0.996443] clk: Disabling unused clocks1644lb # [ 0.996473] PM: genpd: Disabling unused power domains1645lb # [ 1.000814] Freeing unused kernel memory: 4736K1646lb # [ 1.001021] Run /init as init process1647lb # [ 1.015666] systemd[1]: Successfully made /usr/ read-only.1648client # [ 1.153227] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker1 # [ 1.139856] usb 1-1: new high-speed USB device number 2 using ehci-pci1650worker2 # [ 1.150187] usb 1-1: new high-speed USB device number 2 using ehci-pci1651lb # [ 1.177447] usb 1-1: new high-speed USB device number 2 using ehci-pci1652client # [ 1.307465] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653worker1 # [ 1.292263] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11654worker2 # [ 1.302412] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11655client # [ 1.326343] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1656client # [ 1.339045] systemd[1]: Detected virtualization qemu.1657client # [ 1.341243] systemd[1]: Detected architecture arm64.1658client # [ 1.343248] systemd[1]: Running in initrd.1659client # [ 1.346001] systemd[1]: Initializing machine ID from random generator.1660worker2 # [ 1.311231] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1661client # [ 1.348963] systemd[1]: Hostname set to <client>.1662worker1 # [ 1.313029] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1663worker2 # [ 1.323912] systemd[1]: Detected virtualization qemu.1664worker1 # [ 1.325421] systemd[1]: Detected virtualization qemu.1665worker2 # [ 1.326050] systemd[1]: Detected architecture arm64.1666worker1 # [ 1.327525] systemd[1]: Detected architecture arm64.1667worker2 # [ 1.328125] systemd[1]: Running in initrd.1668worker1 # [ 1.329588] systemd[1]: Running in initrd.1669worker2 # [ 1.330877] systemd[1]: Initializing machine ID from random generator.1670worker1 # [ 1.332344] systemd[1]: Initializing machine ID from random generator.1671worker2 # [ 1.333999] systemd[1]: Hostname set to <worker2>.1672worker1 # [ 1.335288] systemd[1]: Hostname set to <worker1>.1673lb # [ 1.329922] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11674lb # [ 1.350467] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1675client # [ 1.393469] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01676lb # [ 1.362803] systemd[1]: Detected virtualization qemu.1677lb # [ 1.362895] systemd[1]: Detected architecture arm64.1678lb # [ 1.362936] systemd[1]: Running in initrd.1679lb # [ 1.363923] systemd[1]: Initializing machine ID from random generator.1680lb # [ 1.364211] systemd[1]: Hostname set to <lb>.1681worker1 # [ 1.380158] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682worker2 # [ 1.390347] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683lb # [ 1.417705] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01684client # [ 1.517245] usb 1-2: new high-speed USB device number 3 using ehci-pci1685worker1 # [ 1.507861] usb 1-2: new high-speed USB device number 3 using ehci-pci1686worker2 # [ 1.510192] usb 1-2: new high-speed USB device number 3 using ehci-pci1687lb # [ 1.541463] usb 1-2: new high-speed USB device number 3 using ehci-pci1688client # [ 1.664034] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689worker2 # [ 1.639246] systemd[1]: bpf-restrict-fs: LSM BPF program attached1690worker1 # [ 1.650329] systemd[1]: bpf-restrict-fs: LSM BPF program attached1691client # [ 1.680749] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21692client # [ 1.686303] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01693worker2 # [ 1.670637] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21694worker2 # [ 1.675407] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01695worker1 # [ 1.675148] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21696worker1 # [ 1.680557] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01697lb # [ 1.693579] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21698lb # [ 1.699616] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01699client # [ 1.772995] systemd[1]: Queued start job for default target Initrd Default Target.1700worker2 # [ 1.754817] systemd[1]: Queued start job for default target Initrd Default Target.1701client # [ 1.783526] systemd[1]: Created slice Slice /system/modprobe.1702client # [ 1.784655] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1703client # [ 1.785966] systemd[1]: Expecting device /dev/disk/by-label/nixos...1704client # [ 1.787046] systemd[1]: Reached target Path Units.1705client # [ 1.787824] systemd[1]: Reached target Slice Units.1706client # [ 1.788608] systemd[1]: Reached target Swaps.1707client # [ 1.789348] systemd[1]: Reached target Timer Units.1708client # [ 1.790305] systemd[1]: Listening on D-Bus System Message Bus Socket.1709worker1 # [ 1.763881] systemd[1]: Queued start job for default target Initrd Default Target.1710worker2 # [ 1.764677] systemd[1]: Created slice Slice /system/modprobe.1711client # [ 1.791481] systemd[1]: Listening on Journal Socket (/dev/log).1712client # [ 1.792551] systemd[1]: Listening on Journal Sockets.1713worker2 # [ 1.765916] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1714worker2 # [ 1.767345] systemd[1]: Expecting device /dev/disk/by-label/nixos...1715worker2 # [ 1.768408] systemd[1]: Reached target Path Units.1716client # [ 1.793535] systemd[1]: Listening on udev Control Socket.1717client # [ 1.793654] systemd[1]: Listening on udev Kernel Socket.1718worker2 # [ 1.769257] systemd[1]: Reached target Slice Units.1719client # [ 1.793678] systemd[1]: Reached target Socket Units.1720worker2 # [ 1.770133] systemd[1]: Reached target Swaps.1721worker2 # [ 1.770896] systemd[1]: Reached target Timer Units.1722worker2 # [ 1.771921] systemd[1]: Listening on D-Bus System Message Bus Socket.1723client # [ 1.797694] systemd[1]: Starting Create List of Static Device Nodes...1724worker2 # [ 1.773170] systemd[1]: Listening on Journal Socket (/dev/log).1725worker1 # [ 1.773884] systemd[1]: Created slice Slice /system/modprobe.1726worker2 # [ 1.774333] systemd[1]: Listening on Journal Sockets.1727worker1 # [ 1.774914] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1728worker2 # [ 1.775340] systemd[1]: Listening on udev Control Socket.1729worker2 # [ 1.776466] systemd[1]: Listening on udev Kernel Socket.1730worker2 # [ 1.777374] systemd[1]: Reached target Socket Units.1731worker1 # [ 1.776100] systemd[1]: Expecting device /dev/disk/by-label/nixos...1732worker1 # [ 1.776132] systemd[1]: Reached target Path Units.1733client # [ 1.805333] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1734worker1 # [ 1.776149] systemd[1]: Reached target Slice Units.1735worker1 # [ 1.776166] systemd[1]: Reached target Swaps.1736worker1 # [ 1.776183] systemd[1]: Reached target Timer Units.1737client # [ 1.806459] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1738worker2 # [ 1.779906] systemd[1]: Starting Create List of Static Device Nodes...1739worker1 # [ 1.776354] systemd[1]: Listening on D-Bus System Message Bus Socket.1740worker1 # [ 1.776500] systemd[1]: Listening on Journal Socket (/dev/log).1741worker1 # [ 1.776622] systemd[1]: Listening on Journal Sockets.1742worker1 # [ 1.776735] systemd[1]: Listening on udev Control Socket.1743worker1 # [ 1.776842] systemd[1]: Listening on udev Kernel Socket.1744worker1 # [ 1.776861] systemd[1]: Reached target Socket Units.1745worker1 # [ 1.786312] systemd[1]: Starting Create List of Static Device Nodes...1746client # [ 1.812657] systemd[1]: Mounting Kernel Configuration File System...1747worker2 # [ 1.790296] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1748worker1 # [ 1.792805] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1749lb # [ 1.785928] systemd[1]: bpf-restrict-fs: LSM BPF program attached1750worker2 # [ 1.790389] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1751worker1 # [ 1.793812] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1752worker2 # [ 1.794882] systemd[1]: Mounting Kernel Configuration File System...1753worker1 # [ 1.803702] systemd[1]: Mounting Kernel Configuration File System...1754client # [ 1.832212] systemd[1]: Starting Journal Service...1755worker2 # [ 1.806769] systemd[1]: Starting Journal Service...1756client # [ 1.845427] systemd[1]: Starting Load Kernel Modules...1757worker1 # [ 1.818508] systemd[1]: Starting Journal Service...1758client # [ 1.846317] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1759worker2 # [ 1.826507] systemd[1]: Starting Load Kernel Modules...1760worker2 # [ 1.826635] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1761client # [ 1.857522] systemd[1]: Starting Coldplug All udev Devices...1762worker1 # [ 1.836201] systemd[1]: Starting Load Kernel Modules...1763worker1 # [ 1.836325] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1764client # [ 1.866555] systemd[1]: Finished Create List of Static Device Nodes.1765client # [ 1.867535] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1766client # [ 1.867842] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1767client # [ 1.868076] systemd[1]: Mounted Kernel Configuration File System.1768worker1 # [ 1.845418] systemd[1]: Starting Coldplug All udev Devices...1769worker2 # [ 1.854313] systemd[1]: Starting Coldplug All udev Devices...1770worker1 # [ 1.857163] systemd[1]: Finished Create List of Static Device Nodes.1771worker2 # [ 1.857708] systemd-journald[73]: Collecting audit messages is disabled.1772worker1 # [ 1.859157] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1773worker1 # [ 1.866404] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1774worker2 # [ 1.866268] systemd[1]: Finished Create List of Static Device Nodes.1775lb # [ 1.862936] systemd[1]: Queued start job for default target Initrd Default Target.1776worker2 # [ 1.867204] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1777worker2 # [ 1.867513] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1778client # [ 1.895309] systemd-journald[73]: Collecting audit messages is disabled.1779client # [ 1.898295] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1780worker1 # [ 1.872479] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1781worker1 # [ 1.872826] systemd[1]: Mounted Kernel Configuration File System.1782lb # [ 1.871626] systemd[1]: Created slice Slice /system/modprobe.1783lb # [ 1.872747] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1784lb # [ 1.874045] systemd[1]: Expecting device /dev/disk/by-label/nixos...1785lb # [ 1.875030] systemd[1]: Reached target Path Units.1786worker2 # [ 1.879516] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1787lb # [ 1.875791] systemd[1]: Reached target Slice Units.1788lb # [ 1.876565] systemd[1]: Reached target Swaps.1789lb # [ 1.877264] systemd[1]: Reached target Timer Units.1790worker1 # [ 1.880164] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1791lb # [ 1.878282] systemd[1]: Listening on D-Bus System Message Bus Socket.1792lb # [ 1.879432] systemd[1]: Listening on Journal Socket (/dev/log).1793lb # [ 1.880485] systemd[1]: Listening on Journal Sockets.1794lb # [ 1.881439] systemd[1]: Listening on udev Control Socket.1795worker1 # [ 1.884912] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1796lb # [ 1.882397] systemd[1]: Listening on udev Kernel Socket.1797lb # [ 1.883262] systemd[1]: Reached target Socket Units.1798lb # [ 1.885463] systemd[1]: Starting Create List of Static Device Nodes...1799worker2 # [ 1.899410] systemd[1]: Mounted Kernel Configuration File System.1800lb # [ 1.893569] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1801lb # [ 1.894667] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1802client # [ 1.929835] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1803lb # [ 1.900876] systemd[1]: Mounting Kernel Configuration File System...1804worker1 # [ 1.906070] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01805worker1 # [ 1.906313] [drm] features: -virgl +edid -resource_blob -host_visible1806worker1 # [ 1.906322] [drm] features: -context_init1807worker1 # [ 1.907036] [drm] number of scanouts: 11808worker1 # [ 1.907052] [drm] number of cap sets: 01809client # [ 1.935677] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1810client # [ 1.937847] systemd[1]: Starting Create Static Device Nodes in /dev...1811worker2 # [ 1.918815] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1812worker2 # [ 1.921345] systemd[1]: Starting Create Static Device Nodes in /dev...1813client # [ 1.949247] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1814lb # [ 1.917798] systemd[1]: Starting Journal Service...1815worker1 # [ 1.920809] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1816worker1 # [ 1.920833] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01817client # [ 1.957138] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01818worker1 # [ 1.930366] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1819lb # [ 1.932774] systemd[1]: Starting Load Kernel Modules...1820worker2 # [ 1.942744] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1821worker1 # [ 1.940361] systemd[1]: Starting Create Static Device Nodes in /dev...1822client # [ 1.969878] [drm] features: -virgl +edid -resource_blob -host_visible1823client # [ 1.969902] [drm] features: -context_init1824client # [ 1.970687] [drm] number of scanouts: 11825client # [ 1.970706] [drm] number of cap sets: 01826worker1 # [ 1.948819] systemd-journald[73]: Collecting audit messages is disabled.1827lb # [ 1.945589] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1828lb # [ 1.949540] systemd[1]: Starting Coldplug All udev Devices...1829worker2 # [ 1.957114] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1830worker1 # [ 1.952896] Console: switching to colour frame buffer device 160x501831client # [ 1.981356] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1832client # [ 1.981373] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01833worker2 # [ 1.963291] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01834worker2 # [ 1.963533] [drm] features: -virgl +edid -resource_blob -host_visible1835worker2 # [ 1.963543] [drm] features: -context_init1836worker2 # [ 1.964265] [drm] number of scanouts: 11837worker2 # [ 1.964283] [drm] number of cap sets: 01838lb # [ 1.965083] systemd[1]: Finished Create List of Static Device Nodes.1839lb # [ 1.967131] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1840lb # [ 1.972642] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1841client # [ 2.005810] systemd[1]: Finished Create Static Device Nodes in /dev.1842client # [ 2.006202] systemd[1]: Reached target Preparation for Local File Systems.1843worker2 # [ 1.979797] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1844client # [ 2.006229] systemd[1]: Reached target Local File Systems.1845worker2 # [ 1.979820] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01846worker1 # [ 1.984381] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1847worker2 # [ 1.986865] systemd[1]: Finished Create Static Device Nodes in /dev.1848worker2 # [ 1.987873] systemd[1]: Reached target Preparation for Local File Systems.1849worker2 # [ 1.988768] systemd[1]: Reached target Local File Systems.1850lb # [ 1.982004] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1851worker1 # [ 1.989519] systemd[1]: Finished Create Static Device Nodes in /dev.1852worker1 # [ 1.989729] systemd[1]: Reached target Preparation for Local File Systems.1853worker1 # [ 1.989766] systemd[1]: Reached target Local File Systems.1854client # [ 2.013438] Console: switching to colour frame buffer device 160x501855client # [ 2.020151] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1856worker1 # [ 1.995602] systemd[1]: Starting Rule-based Manager for Device Events and Files...1857client # [ 2.023580] systemd[1]: Starting Rule-based Manager for Device Events and Files...1858lb # [ 1.989535] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1859worker2 # [ 1.998356] systemd[1]: Starting Rule-based Manager for Device Events and Files...1860lb # [ 1.994351] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01861lb # [ 1.994583] [drm] features: -virgl +edid -resource_blob -host_visible1862lb # [ 1.994590] [drm] features: -context_init1863lb # [ 1.995329] [drm] number of scanouts: 11864lb # [ 1.995347] [drm] number of cap sets: 01865worker1 # [ 2.008352] systemd[1]: Finished Load Kernel Modules.1866lb # [ 2.005521] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1867lb # [ 2.006088] systemd[1]: Mounted Kernel Configuration File System.1868lb # [ 2.011486] systemd-journald[73]: Collecting audit messages is disabled.1869lb # [ 2.013750] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1870lb # [ 2.013768] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01871worker2 # [ 2.018380] Console: switching to colour frame buffer device 160x501872worker2 # [ 2.024995] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1873client # [ 2.061562] systemd[1]: Finished Load Kernel Modules.1874client # [ 2.065136] systemd[1]: Starting Apply Kernel Variables...1875worker1 # [ 2.044011] systemd[1]: Starting Apply Kernel Variables...1876worker2 # [ 2.050508] systemd[1]: Started Journal Service.1877lb # [ 2.046117] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1878lb # [ 2.049708] systemd[1]: Starting Create Static Device Nodes in /dev...1879worker2 # [ 2.044523] systemd-modules-load[74]: Inserted module 'dm_mod'1880worker2 # [ 2.046806] systemd-modules-load[74]: Module 'virtio_balloon' is built in1881worker2 # [ 2.047892] systemd-modules-load[74]: Module 'virtio_console' is built in1882worker1 # [ 2.068558] systemd[1]: Finished Apply Kernel Variables.1883lb # [ 2.057755] Console: switching to colour frame buffer device 160x501884client # [ 2.080443] systemd-modules-load[74]: Inserted module 'dm_mod'1885lb # [ 2.064221] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1886worker2 # [ 2.060393] systemd-modules-load[74]: Inserted module 'virtio_gpu'1887client # [ 2.098723] systemd[1]: Started Journal Service.1888worker2 # [ 2.061430] systemd-modules-load[74]: Module 'virtio_rng' is built in1889client # [ 2.084920] systemd-modules-load[74]: Module 'virtio_balloon' is built in1890worker2 # [ 2.062467] systemd[1]: Starting Create System Files and Directories...1891worker2 # [ 2.068108] systemd[1]: Finished Load Kernel Modules.1892client # [ 2.096367] systemd-modules-load[74]: Module 'virtio_console' is built in1893client # [ 2.098466] systemd-modules-load[74]: Inserted module 'virtio_gpu'1894client # [ 2.104413] systemd-modules-load[74]: Module 'virtio_rng' is built in1895lb # [ 2.089644] systemd[1]: Finished Load Kernel Modules.1896lb # [ 2.093020] systemd[1]: Starting Apply Kernel Variables...1897client # [ 2.112361] systemd[1]: Starting Create System Files and Directories...1898worker2 # [ 2.091024] systemd-udevd[80]: Using default interface naming scheme 'v261'.1899client # [ 2.122608] systemd-udevd[80]: Using default interface naming scheme 'v261'.1900worker2 # [ 2.105808] systemd[1]: Starting Apply Kernel Variables...1901worker1 # [ 2.119036] systemd[1]: Started Journal Service.1902worker1 # [ 2.109128] systemd-modules-load[74]: Inserted module 'dm_mod'1903worker1 # [ 2.110236] systemd-modules-load[74]: Module 'virtio_balloon' is built in1904worker1 # [ 2.111342] systemd-modules-load[74]: Module 'virtio_console' is built in1905client # [ 2.137660] systemd[1]: Finished Apply Kernel Variables.1906lb # [ 2.125708] systemd[1]: Finished Create Static Device Nodes in /dev.1907worker1 # [ 2.118780] systemd-modules-load[74]: Inserted module 'virtio_gpu'1908lb # [ 2.125936] systemd[1]: Reached target Preparation for Local File Systems.1909lb # [ 2.125971] systemd[1]: Reached target Local File Systems.1910worker2 # [ 2.121916] systemd[1]: Finished Create System Files and Directories.1911worker1 # [ 2.121397] systemd-modules-load[74]: Module 'virtio_rng' is built in1912lb # [ 2.131218] systemd[1]: Starting Rule-based Manager for Device Events and Files...1913worker1 # [ 2.124395] systemd-udevd[80]: Using default interface naming scheme 'v261'.1914client # [ 2.155039] systemd[1]: Finished Create System Files and Directories.1915worker1 # [ 2.133647] systemd[1]: Starting Create System Files and Directories...1916worker2 # [ 2.145986] systemd[1]: Finished Apply Kernel Variables.1917client # [ 2.169966] systemd[1]: Started Rule-based Manager for Device Events and Files.1918worker2 # [ 2.147416] systemd[1]: Started Rule-based Manager for Device Events and Files.1919lb # [ 2.157964] systemd[1]: Finished Apply Kernel Variables.1920worker1 # [ 2.157300] systemd[1]: Finished Create System Files and Directories.1921worker1 # [ 2.162945] systemd[1]: Started Rule-based Manager for Device Events and Files.1922lb # [ 2.173841] systemd-modules-load[74]: Inserted module 'dm_mod'1923lb # [ 2.193629] systemd[1]: Started Journal Service.1924lb # [ 2.188399] systemd-modules-load[74]: Module 'virtio_balloon' is built in1925lb # [ 2.189562] systemd-modules-load[74]: Module 'virtio_console' is built in1926lb # [ 2.190611] systemd-modules-load[74]: Inserted module 'virtio_gpu'1927client # [ 2.224110] systemd[1]: Starting Virtual Console Setup...1928lb # [ 2.191586] systemd-modules-load[74]: Module 'virtio_rng' is built in1929worker2 # [ 2.208501] systemd[1]: Starting Virtual Console Setup...1930lb # [ 2.208466] systemd[1]: Starting Create System Files and Directories...1931worker1 # [ 2.223867] systemd[1]: Starting Virtual Console Setup...1932lb # [ 2.220490] systemd-udevd[81]: Using default interface naming scheme 'v261'.1933lb # [ 2.232429] systemd[1]: Finished Create System Files and Directories.1934client # [ 2.276456] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1935client # [ 2.280060] systemd[1]: Finished Virtual Console Setup.1936lb # [ 2.254710] systemd[1]: Started Rule-based Manager for Device Events and Files.1937worker2 # [ 2.268510] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1938worker2 # [ 2.271975] systemd[1]: Finished Virtual Console Setup.1939worker1 # [ 2.280491] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1940worker1 # [ 2.283885] systemd[1]: Finished Virtual Console Setup.1941lb # [ 2.320193] systemd[1]: Starting Virtual Console Setup...1942lb # [ 2.364453] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1943lb # [ 2.368082] systemd[1]: Finished Virtual Console Setup.1944client # [ 2.897519] systemd[1]: Finished Coldplug All udev Devices.1945client # [ 2.898461] systemd[1]: Reached target System Initialization.1946worker2 # [ 2.875477] systemd[1]: Finished Coldplug All udev Devices.1947client # [ 2.899262] systemd[1]: Reached target Basic System.1948worker2 # [ 2.876462] systemd[1]: Reached target System Initialization.1949worker2 # [ 2.877255] systemd[1]: Reached target Basic System.1950worker1 # [ 2.885319] systemd[1]: Finished Coldplug All udev Devices.1951worker1 # [ 2.888137] systemd[1]: Reached target System Initialization.1952worker1 # [ 2.888965] systemd[1]: Reached target Basic System.1953lb # [ 2.974526] systemd[1]: Finished Coldplug All udev Devices.1954lb # [ 2.980780] systemd[1]: Reached target System Initialization.1955lb # [ 2.981697] systemd[1]: Reached target Basic System.1956client # [ 3.035942] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1957worker2 # [ 3.016426] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1958worker2 # [ 3.021075] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1959worker2 # [ 3.032079] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1960worker1 # [ 3.047622] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1961client # [ 3.072678] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1962client # [ 3.077999] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1963worker1 # [ 3.074336] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1964worker1 # [ 3.080223] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1965client # [ 3.132495] systemd[1]: Found device /dev/disk/by-label/nixos.1966client # [ 3.139414] systemd[1]: Reached target Initrd Root Device.1967worker2 # [ 3.120709] systemd[1]: Found device /dev/disk/by-label/nixos.1968client # [ 3.144107] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1969worker2 # [ 3.123666] systemd[1]: Reached target Initrd Root Device.1970worker2 # [ 3.127301] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1971lb # [ 3.123961] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1972worker1 # [ 3.137187] systemd[1]: Found device /dev/disk/by-label/nixos.1973worker1 # [ 3.140931] systemd[1]: Reached target Initrd Root Device.1974worker1 # [ 3.143996] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1975lb # [ 3.145236] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1976client # [ 3.192067] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1977lb # [ 3.163433] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1978client # [ 3.199207] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1979client # [ 3.202561] systemd[1]: Mounting /sysroot...1980worker2 # [ 3.179298] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1981worker2 # [ 3.187051] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1982worker2 # [ 3.196321] systemd[1]: Mounting /sysroot...1983worker1 # [ 3.201719] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1984worker1 # [ 3.209349] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1985worker1 # [ 3.211399] systemd[1]: Mounting /sysroot...1986client # [ 3.251754] EXT4-fs (vda): mounted filesystem 37009b6a-fbe0-40d2-a15e-de82b874ec46 r/w with ordered data mode. Quota mode: none.1987client # [ 3.241405] systemd[1]: Mounted /sysroot.1988client # [ 3.244406] systemd[1]: Reached target Initrd Root File System.1989client # [ 3.252112] systemd[1]: Starting Mountpoints Configured in the Real Root...1990worker2 # [ 3.244108] EXT4-fs (vda): mounted filesystem 98a4235e-afaf-4a21-9a87-9e1d3d90e796 r/w with ordered data mode. Quota mode: none.1991lb # [ 3.225232] systemd[1]: Found device /dev/disk/by-label/nixos.1992worker2 # [ 3.235423] systemd[1]: Mounted /sysroot.1993lb # [ 3.228635] systemd[1]: Reached target Initrd Root Device.1994worker2 # [ 3.240137] systemd[1]: Reached target Initrd Root File System.1995lb # [ 3.232170] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1996worker2 # [ 3.245379] systemd[1]: Starting Mountpoints Configured in the Real Root...1997worker1 # [ 3.260489] EXT4-fs (vda): mounted filesystem 994cdaf9-6843-495b-a529-514756fb73ac r/w with ordered data mode. Quota mode: none.1998client # [ 3.275816] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1999worker1 # [ 3.252869] systemd[1]: Mounted /sysroot.2000worker1 # [ 3.253938] systemd[1]: Reached target Initrd Root File System.3361worker1: Guest shell says: b'Spawning backdoor root shell...\n'3362worker1: connected to guest root shell3363worker1: (connecting took 0.00 seconds)3364worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3365worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds)3366worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3367worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3368worker2: waiting for unit network-addresses-eth1.service3369worker2: waiting for the VM to finish booting3370worker2: Guest shell says: b'Spawning backdoor root shell...\n'3371worker2: connected to guest root shell3372worker2: (connecting took 0.00 seconds)3373worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3374worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds)3375worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3376worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3377lb: waiting for unit niks3.service3378worker2 # [ 14.586642] dhcpcd[631]: eth0: soliciting an IPv6 router3379worker2 # [ 14.590164] dhcpcd[631]: eth0: Router Advertisement from fe80::23380worker2 # [ 14.592772] dhcpcd[631]: eth0: adding address fec0::5054:ff:fe12:3456/643381worker2 # [ 14.595565] dhcpcd[631]: eth0: adding route to fec0::/643382worker2 # [ 14.598012] dhcpcd[631]: eth0: adding default route via fe80::23383lb # [ 14.828447] dhcpcd[673]: eth0: soliciting a DHCP lease3384lb # [ 14.832477] dhcpcd[673]: eth0: offered 10.0.2.15 from 10.0.2.23385lb # [ 14.840271] dhcpcd[673]: eth0: probing address 10.0.2.15/243386worker1 # [ 14.849267] dhcpcd[642]: eth0: soliciting an IPv6 router3387worker1 # [ 14.849614] dhcpcd[642]: eth0: Router Advertisement from fe80::23388lb # [ 14.863298] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33389worker1 # [ 14.849747] dhcpcd[642]: eth0: adding address fec0::5054:ff:fe12:3456/643390worker1 # [ 14.849909] dhcpcd[642]: eth0: adding route to fec0::/643391worker1 # [ 14.850032] dhcpcd[642]: eth0: adding default route via fe80::23392lb # [ 15.299295] systemd[1]: Starting Virtual Console Setup...3393lb # [ 15.345899] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3394lb # [ 15.365260] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3395lb # [ 15.370178] systemd[1]: Stopped Virtual Console Setup.3396lb # [ 15.382421] systemd[1]: Starting Virtual Console Setup...3397lb # [ 15.447906] systemd-logind[529]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3398lb # [ 15.512774] dhcpcd[673]: eth0: soliciting an IPv6 router3399lb # [ 15.514364] dhcpcd[673]: eth0: Router Advertisement from fe80::23400lb # [ 15.516284] dhcpcd[673]: eth0: adding address fec0::5054:ff:fe12:3456/643401lb # [ 15.518465] dhcpcd[673]: eth0: adding route to fec0::/643402lb # [ 15.520129] dhcpcd[673]: eth0: adding default route via fe80::23403lb # [ 15.884455] systemd-vconsole-setup[775]: Configuration of first virtual console was skipped, ignoring remaining ones.3404lb # [ 15.889300] systemd[1]: Finished Virtual Console Setup.3405lb # [ 16.209409] postgresql-pre-start[708]: selecting default time zone ... UTC3406lb # [ 16.213455] postgresql-pre-start[708]: creating configuration files ... ok3407lb # [ 16.475118] postgresql-pre-start[708]: running bootstrap script ... ok3408lb # [ 17.145679] postgresql-pre-start[708]: performing post-bootstrap initialization ... ok3409lb # [ 17.293894] postgresql-pre-start[708]: syncing data to disk ... ok3410lb # [ 17.296060] postgresql-pre-start[708]: initdb: warning: enabling "trust" authentication for local connections3411lb # [ 17.297512] postgresql-pre-start[708]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3412lb # [ 17.299650] postgresql-pre-start[708]: Success. You can now start the database server using:3413lb # [ 17.300957] postgresql-pre-start[708]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3414lb # [ 17.428899] postgres[809]: [809] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3415lb # [ 17.433201] postgres[809]: [809] LOG: listening on IPv6 address "::1", port 54323416lb # [ 17.434406] postgres[809]: [809] LOG: listening on IPv4 address "127.0.0.1", port 54323417lb # [ 17.437098] postgres[809]: [809] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3418lb # [ 17.450563] postgres[818]: [818] LOG: database system was shut down at 2026-09-20 09:32:57 GMT3419lb # [ 17.455843] postgres[809]: [809] LOG: database system is ready to accept connections3420lb # [ 17.460496] systemd[1]: Started PostgreSQL Server.3421lb # [ 17.466937] systemd[1]: Starting PostgreSQL Setup Scripts...3422lb # [ 17.694011] postgresql-setup-start[829]: CREATE DATABASE3423lb # [ 17.744681] postgresql-setup-start[834]: CREATE ROLE3424lb # [ 17.770155] postgresql-setup-start[836]: ALTER DATABASE3425lb # [ 17.776603] systemd[1]: Finished PostgreSQL Setup Scripts.3426lb # [ 17.778569] systemd[1]: Reached target PostgreSQL.3427worker1 # [ 17.831494] dhcpcd[642]: eth0: leased 10.0.2.15 for 86400 seconds3428worker1 # [ 17.835338] dhcpcd[642]: eth0: adding route to 10.0.2.0/243429worker1 # [ 17.838642] dhcpcd[642]: eth0: adding default route via 10.0.2.23430worker1 # [ 17.998133] systemd[1]: Started DHCP Client.3431worker1 # [ 18.000462] systemd[1]: Reached target Multi-User System.3432worker1 # [ 18.001369] systemd[1]: Startup finished in 949ms (kernel) + 5.434s (initrd) + 11.615s (userspace) = 17.999s.3433client # [ 18.326619] dhcpcd[540]: eth0: leased 10.0.2.15 for 86400 seconds3434worker2 # [ 18.313055] dhcpcd[631]: eth0: leased 10.0.2.15 for 86400 seconds3435worker2 # [ 18.316885] dhcpcd[631]: eth0: adding route to 10.0.2.0/243436worker2 # [ 18.319970] dhcpcd[631]: eth0: adding default route via 10.0.2.23437client # [ 18.330058] dhcpcd[540]: eth0: adding route to 10.0.2.0/243438client # [ 18.330230] dhcpcd[540]: eth0: adding default route via 10.0.2.23439client # [ 18.487635] systemd[1]: Started DHCP Client.3440client # [ 18.491627] systemd[1]: Reached target Multi-User System.3441client # [ 18.492815] systemd[1]: Startup finished in 961ms (kernel) + 5.440s (initrd) + 12.089s (userspace) = 18.491s.3442worker2 # [ 18.481850] systemd[1]: Started DHCP Client.3443worker2 # [ 18.484272] systemd[1]: Reached target Multi-User System.3444worker2 # [ 18.485312] systemd[1]: Startup finished in 948ms (kernel) + 4.637s (initrd) + 12.897s (userspace) = 18.483s.3445lb # [ 19.603758] dhcpcd[673]: eth0: leased 10.0.2.15 for 86400 seconds3446lb # [ 19.606895] dhcpcd[673]: eth0: adding route to 10.0.2.0/243447lb # [ 19.609958] dhcpcd[673]: eth0: adding default route via 10.0.2.23448lb # [ 19.760589] systemd[1]: Started DHCP Client.3449lb # [ 19.763314] systemd[1]: Reached target Network is Online.3450lb # [ 19.768809] systemd[1]: Started Envoy reverse proxy.3451lb # [ 19.777833] systemd[1]: Started mock-oidc.service.3452lb # [ 19.884698] mock-oidc-server[914]: Mock OIDC Server running3453lb # [ 19.885601] mock-oidc-server[914]: OIDC Address: 192.168.1.2:80803454lb # [ 19.886442] mock-oidc-server[914]: Issue Address: 0.0.0.0:80813455lb # [ 19.887249] mock-oidc-server[914]: Issuer: http://192.168.1.2:8080/oidc3456lb # [ 19.888553] mock-oidc-server[914]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3457lb # [ 19.890676] mock-oidc-server[914]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3458lb # [ 19.892849] mock-oidc-server[914]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3459lb # [ 20.447634] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3460lb # [ 20.449871] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:469] statically linked extensions:3461lb # [ 20.451753] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3462lb # [ 20.454064] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3463lb # [ 20.456704] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3464lb # [ 20.459470] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3465lb # [ 20.462318] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3466lb # [ 20.466673] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3467lb # [ 20.487544] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3468lb # [ 20.489886] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3469lb # [ 20.498166] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3470lb # [ 20.500565] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3471lb # [ 20.503244] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3472lb # [ 20.508742] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3473lb # [ 20.511596] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3474lb # [ 20.516423] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3475lb # [ 20.519008] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3476lb # [ 20.522256] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3477lb # [ 20.526839] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3478lb # [ 20.529207] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3479lb # [ 20.531934] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3480lb # [ 20.534092] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3481lb # [ 20.542679] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3482lb # [ 20.556622] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3483lb # [ 20.558582] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3484lb # [ 20.562607] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3485lb # [ 20.565928] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3486lb # [ 20.568913] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3487lb # [ 20.571057] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3488lb # [ 20.573343] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3489lb # [ 20.575141] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3490lb # [ 20.580201] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3491lb # [ 20.582123] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3492lb # [ 20.583865] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3493lb # [ 20.588846] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3494lb # [ 20.590820] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3495lb # [ 20.593552] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3496lb # [ 20.595503] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3497lb # [ 20.598242] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3498lb # [ 20.600116] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3499lb # [ 20.602832] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3500lb # [ 20.606487] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3501lb # [ 20.608697] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3502lb # [ 20.611775] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3503lb # [ 20.614915] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3504lb # [ 20.624458] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13505lb # [ 20.626735] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3506lb # [ 20.629080] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3507lb # [ 20.631036] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3508lb # [ 20.633940] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3509lb # [ 20.637144] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3510lb # [ 20.639911] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3511lb # [ 20.643415] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3512lb # [ 20.646162] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3513lb # [ 20.651267] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3514lb # [ 20.653571] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3515lb # [ 20.655843] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3516lb # [ 20.657969] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3517lb # [ 20.660306] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3518lb # [ 20.662819] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3519lb # [ 20.665793] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3520lb # [ 20.669335] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3521lb # [ 20.671864] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3522lb # [ 20.675589] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3523lb # [ 20.679015] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3524lb # [ 20.681398] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3525lb # [ 20.688832] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3526lb # [ 20.690500] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3527lb # [ 20.695880] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3528lb # [ 20.698070] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3529lb # [ 20.702948] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3530lb # [ 20.708679] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3531lb # [ 20.740033] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3532lb # [ 20.741895] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23533lb # [ 20.743726] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83534lb # [ 20.745980] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3535lb # [ 20.750225] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3536lb # [ 20.752282] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3537lb # [ 20.755003] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3538lb # [ 20.757395] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3539lb # [ 20.759386] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3540lb # [ 20.762254] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3541lb # [ 20.770617] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3542lb # [ 20.778026] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3543lb # [ 20.781699] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3544lb # [ 20.783993] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3545lb # [ 20.786708] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3546lb # [ 20.789282] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3547lb # [ 20.792818] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23548lb # [ 20.795293] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3549lb # [ 20.797491] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3550lb # [ 20.799306] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3551lb # [ 20.801565] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3552lb # [ 20.803525] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3553lb # [ 20.806845] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3554lb # [ 20.813808] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3555lb # [ 20.815735] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3556lb # [ 20.822280] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3557lb # [ 20.824624] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3558lb # [ 20.827297] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3559lb # [ 20.829515] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3560lb # [ 20.832385] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3561lb # [ 20.835622] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3562lb # [ 20.842625] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23563lb # [ 20.844856] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3564lb # [ 20.847062] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3565lb # [ 20.850961] envoy[913]: [2026-09-20 09:33:01.067][913][info][main] [source/server/server.cc:531] HTTP header map info:3566lb # [ 20.852885] envoy[913]: [2026-09-20 09:33:01.069][913][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3567lb # [ 20.868787] envoy[913]: [2026-09-20 09:33:01.069][913][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3568lb # [ 20.870586] envoy[913]: [2026-09-20 09:33:01.069][913][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3569lb # [ 20.879863] envoy[913]: [2026-09-20 09:33:01.069][913][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3570lb # [ 20.881938] envoy[913]: [2026-09-20 09:33:01.332][913][info][main] [source/server/server.cc:968] runtime: {}3571lb # [ 20.883395] envoy[913]: [2026-09-20 09:33:01.360][913][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3572lb # [ 20.885702] envoy[913]: [2026-09-20 09:33:01.361][913][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013573lb # [ 20.887425] envoy[913]: [2026-09-20 09:33:01.361][913][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013574lb # [ 20.889243] envoy[913]: [2026-09-20 09:33:01.369][913][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3575lb # [ 20.890977] envoy[913]: [2026-09-20 09:33:01.369][913][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3576lb # [ 20.892947] envoy[913]: [2026-09-20 09:33:01.369][913][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3577lb # [ 20.917340] envoy[913]: [2026-09-20 09:33:01.500][913][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3578lb # [ 20.927834] envoy[913]: [2026-09-20 09:33:01.510][913][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3579worker1 # [ 20.937052] systemd[1]: Starting Nix worker-protocol over gRPC...3580lb # [ 20.930685] envoy[913]: [2026-09-20 09:33:01.513][913][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3581lb # [ 20.934144] envoy[913]: [2026-09-20 09:33:01.513][913][info][main] [source/server/server.cc:1077] starting main dispatch loop3582worker2 # [ 20.948383] systemd[1]: Starting Nix worker-protocol over gRPC...3583worker2 # [ 21.192620] nix-grpc-daemon[778]: ts=2026-09-20T09:33:00Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3584worker1 # [ 21.191982] nix-grpc-daemon[774]: ts=2026-09-20T09:33:00Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3585worker2 # [ 21.204217] nix-grpc-daemon[778]: ts=2026-09-20T09:33:00Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13586worker1 # [ 21.203728] nix-grpc-daemon[774]: ts=2026-09-20T09:33:00Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13587worker2 # [ 21.247193] nix-grpc-daemon[778]: ts=2026-09-20T09:33:00Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3588worker1 # [ 21.248815] nix-grpc-daemon[774]: ts=2026-09-20T09:33:00Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3589worker2 # [ 21.251559] systemd[1]: Started Nix worker-protocol over gRPC.3590worker1 # [ 21.253620] systemd[1]: Started Nix worker-protocol over gRPC.3591lb # [ 21.288987] envoy[913]: [2026-09-20 09:33:01.871][913][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3592lb # [ 21.300277] envoy[913]: [2026-09-20 09:33:01.871][913][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3593lb # [ 21.306208] envoy[913]: [2026-09-20 09:33:01.871][913][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3594worker2 # [ 21.322740] nix-grpc-daemon[778]: ts=2026-09-20T09:33:00Z level=info event=scheduler_connected addr=lb:500513595lb # [ 21.312843] envoy[913]: [2026-09-20 09:33:01.871][913][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3596worker2 # [ 21.331531] nix-grpc-daemon[778]: ts=2026-09-20T09:33:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3597worker1 # [ 21.331463] nix-grpc-daemon[774]: ts=2026-09-20T09:33:00Z level=info event=scheduler_connected addr=lb:500513598worker1 # [ 21.333900] nix-grpc-daemon[774]: ts=2026-09-20T09:33:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3599worker2 # [ 21.532970] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:500513600worker1 # [ 21.535386] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:500513601worker2 # [ 21.538358] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3602worker1 # [ 21.540480] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3603worker1 # [ 21.737503] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:500513604worker2 # [ 21.739196] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:500513605worker2 # [ 21.744430] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3606worker1 # [ 21.742878] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3607worker2 # [ 21.945391] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:500513608worker1 # [ 21.943993] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:500513609worker2 # [ 21.950769] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3610worker1 # [ 21.949400] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3611worker2 # [ 22.151673] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:500513612worker1 # [ 22.150350] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:500513613worker2 # [ 22.157198] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3614worker1 # [ 22.155638] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3615worker2 # [ 22.358405] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:500513616worker2 # [ 22.361142] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3617worker1 # [ 22.358535] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:500513618worker1 # [ 22.362787] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3619worker1 # [ 22.559127] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=scheduler_connected addr=lb:500513620worker2 # [ 22.562271] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=scheduler_connected addr=lb:500513621worker2 # [ 22.567641] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3622worker1 # [ 22.569975] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3623worker1 # [ 22.766357] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=scheduler_connected addr=lb:500513624worker2 # [ 22.768565] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=scheduler_connected addr=lb:500513625worker2 # [ 22.773956] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3626worker1 # [ 22.772460] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3627worker1 # [ 22.973128] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=scheduler_connected addr=lb:500513628worker2 # [ 22.974835] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=scheduler_connected addr=lb:500513629worker1 # [ 22.978353] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3630worker2 # [ 22.980278] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3631worker1 # [ 23.179280] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=scheduler_connected addr=lb:500513632worker2 # [ 23.181311] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=scheduler_connected addr=lb:500513633worker1 # [ 23.184588] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3634worker2 # [ 23.186598] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3635worker1 # [ 23.386591] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:500513636worker2 # [ 23.388704] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:500513637worker1 # [ 23.391414] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3638worker2 # [ 23.393487] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3639worker1 # [ 23.588314] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:500513640worker2 # [ 23.594601] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:500513641worker1 # [ 23.593425] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3642worker2 # [ 23.599639] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3643worker1 # [ 23.794243] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:500513644worker2 # [ 23.796600] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:500513645worker1 # [ 23.799491] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3646worker2 # [ 23.801916] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3647worker1 # [ 24.000699] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:500513648worker2 # [ 24.002842] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:500513649worker1 # [ 24.006239] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3650worker2 # [ 24.008354] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3651worker1 # [ 24.206908] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:500513652worker2 # [ 24.208984] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:500513653worker1 # [ 24.212413] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3654worker2 # [ 24.214344] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3655worker1 # [ 24.415157] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:500513656worker2 # [ 24.417193] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:500513657worker1 # [ 24.419450] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3658worker2 # [ 24.421412] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3659worker1 # [ 24.616277] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:500513660worker2 # [ 24.617948] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:500513661worker1 # [ 24.621648] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3662worker2 # [ 24.623428] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3663worker1 # [ 24.822539] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:500513664worker2 # [ 24.824254] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:500513665worker1 # [ 24.827838] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3666worker2 # [ 24.829568] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3667worker1 # [ 25.028756] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:500513668worker2 # [ 25.030438] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:500513669worker1 # [ 25.034087] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3670worker2 # [ 25.035838] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3671worker1 # [ 25.235065] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:500513672worker2 # [ 25.236699] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:500513673worker1 # [ 25.240545] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3674worker2 # [ 25.242116] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3675worker2 # [ 25.444740] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:500513676worker1 # [ 25.443441] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:500513677worker2 # [ 25.448949] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3678worker1 # [ 25.447713] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3679worker2 # [ 25.646272] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:500513680worker1 # [ 25.644609] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:500513681worker2 # [ 25.651151] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3682worker1 # [ 25.650052] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3683worker2 # [ 25.852195] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:500513684worker1 # [ 25.852286] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:500513685worker2 # [ 25.857646] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3686worker1 # [ 25.860316] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3687worker1 # [ 26.053631] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:500513688worker2 # [ 26.058567] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:500513689worker1 # [ 26.059107] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3690worker2 # [ 26.064001] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3691worker1 # [ 26.260083] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:500513692worker2 # [ 26.264929] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:500513693worker1 # [ 26.265461] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3694worker2 # [ 26.270287] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3695worker1 # [ 26.468461] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:500513696worker2 # [ 26.473182] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:500513697worker1 # [ 26.472863] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3698worker2 # [ 26.477391] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3699worker1 # [ 26.669116] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:500513700worker2 # [ 26.673646] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:500513701worker1 # [ 26.674718] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3702worker2 # [ 26.679186] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3703worker1 # [ 26.875643] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:500513704worker2 # [ 26.880585] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:500513705worker1 # [ 26.881321] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3706worker2 # [ 26.885918] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3707worker1 # [ 27.081988] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:500513708worker2 # [ 27.086835] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:500513709worker1 # [ 27.087393] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3710worker2 # [ 27.092300] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3711worker1 # [ 27.288628] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:500513712worker2 # [ 27.293131] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:500513713worker1 # [ 27.294267] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3714worker2 # [ 27.298672] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3715worker1 # [ 27.496754] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:500513716worker2 # [ 27.501353] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:500513717worker1 # [ 27.501953] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3718worker2 # [ 27.505827] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3719worker1 # [ 27.702896] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:500513720worker2 # [ 27.706803] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:500513721worker1 # [ 27.708493] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3722worker2 # [ 27.712287] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3723worker1 # [ 27.909405] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:500513724worker2 # [ 27.913187] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:500513725worker1 # [ 27.914881] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3726worker2 # [ 27.918676] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3727worker1 # [ 28.115886] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:500513728worker2 # [ 28.119726] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:500513729worker1 # [ 28.121262] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3730worker2 # [ 28.124874] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3731worker2 # [ 28.321486] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:500513732worker1 # [ 28.322091] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:500513733worker2 # [ 28.326965] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3734worker1 # [ 28.327359] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3735worker2 # [ 28.529900] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:500513736worker1 # [ 28.530526] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:500513737worker2 # [ 28.534182] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3738worker1 # [ 28.534780] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3739worker2 # [ 28.730819] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:500513740worker1 # [ 28.730792] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:500513741worker2 # [ 28.736333] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3742worker1 # [ 28.736688] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3743worker2 # [ 28.937034] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:500513744worker1 # [ 28.937949] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:500513745worker1 # [ 28.943472] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3746worker2 # [ 28.945868] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3747worker2 # [ 29.142619] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:500513748worker1 # [ 29.144414] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:500513749worker2 # [ 29.147992] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3750worker1 # [ 29.149968] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3751worker2 # [ 29.348880] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:500513752worker1 # [ 29.351166] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:500513753worker2 # [ 29.354693] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3754worker1 # [ 29.357239] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3755worker2 # [ 29.557135] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:500513756worker1 # [ 29.560000] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:500513757worker2 # [ 29.562762] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3758worker1 # [ 29.564425] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3759worker1 # [ 29.760489] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:500513760worker2 # [ 29.763389] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:500513761worker1 # [ 29.766051] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3762worker2 # [ 29.768746] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3763worker1 # [ 29.967145] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:500513764worker2 # [ 29.969543] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:500513765worker1 # [ 29.972911] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3766worker2 # [ 29.974676] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3767worker2 # [ 30.175413] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:500513768worker1 # [ 30.174025] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:500513769worker2 # [ 30.180937] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3770worker1 # [ 30.179649] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3771worker2 # [ 30.381798] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:500513772worker1 # [ 30.380656] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:500513773worker2 # [ 30.387262] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3774worker1 # [ 30.386214] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3775lb # [ 30.473968] rustfs-bucket-start[1022]: mb s3://farm3776lb # [ 30.483022] systemd[1]: Finished rustfs-bucket.service.3777lb # [ 30.491573] systemd[1]: Starting niks3 server...3778worker2 # [ 30.590235] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:500513779worker1 # [ 30.589276] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:500513780worker2 # [ 30.594557] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3781worker1 # [ 30.593522] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3782lb # [ 30.712938] postgres[1037]: [1037] ERROR: relation "goose_db_version" does not exist at character 363783lb # [ 30.714272] postgres[1037]: [1037] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3784lb # [ 30.749196] niks3-server[1032]: 2026/09/20 09:33:11 OK 20241026095416_initial_model.sql (21.21ms)3785lb # [ 30.752758] niks3-server[1032]: 2026/09/20 09:33:11 OK 20251210153512_drop_unused_gin_index.sql (3.95ms)3786lb # [ 30.758552] niks3-server[1032]: 2026/09/20 09:33:11 OK 20251218171726_add_pins.sql (5.73ms)3787lb # [ 30.763410] niks3-server[1032]: 2026/09/20 09:33:11 OK 20260628120000_add_object_size_and_stats.sql (4.81ms)3788lb # [ 30.768935] niks3-server[1032]: 2026/09/20 09:33:11 OK 20260905000000_add_claims.sql (5.49ms)3789lb # [ 30.773935] niks3-server[1032]: 2026/09/20 09:33:11 OK 20260920000000_drop_claims.sql (4.84ms)3790lb # [ 30.775214] niks3-server[1032]: 2026/09/20 09:33:11 goose: successfully migrated database to version: 202609200000003791lb # [ 30.780574] niks3-server[1032]: 2026/09/20 09:33:11 OK 1_commit_pending_closure.sql (6.61ms)3792worker2 # [ 30.790648] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:500513793worker1 # [ 30.789346] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:500513794lb # [ 30.784942] niks3-server[1032]: 2026/09/20 09:33:11 OK 2_object_stats_trigger.sql (4.18ms)3795lb # [ 30.786480] niks3-server[1032]: 2026/09/20 09:33:11 goose: up to current file version: 23796worker2 # [ 30.796208] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3797worker1 # [ 30.794880] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3798lb # [ 30.790884] niks3-server[1032]: 2026/09/20 09:33:11 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3799lb # [ 30.840114] niks3-server[1032]: 2026/09/20 09:33:11 INFO Read proxy enabled — serving cache objects from S33800lb # [ 30.843201] niks3-server[1032]: 2026/09/20 09:33:11 INFO Using socket-activated listener address=0.0.0.0:57513801lb # [ 30.846434] systemd[1]: Started niks3 server.3802lb # [ 30.847142] niks3-server[1032]: 2026/09/20 09:33:11 INFO systemd watchdog enabled interval=15s3803lb # [ 30.852302] niks3-server[1032]: 2026/09/20 09:33:11 INFO Starting HTTP server address=0.0.0.0:57513804lb # [ 30.855708] systemd[1]: Reached target Multi-User System.3805lb # [ 30.857988] niks3-server[1032]: 2026/09/20 09:33:11 INFO lead: acquired remote=192.168.1.3:351303806lb # [ 30.861394] systemd[1]: Startup finished in 988ms (kernel) + 5.562s (initrd) + 24.299s (userspace) = 30.850s.3807worker1 # [ 30.868972] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_take_over3808worker2 # [ 30.997133] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:500513809worker1 # [ 30.995996] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:500513810worker2 # [ 31.002711] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3811worker1 # [ 31.001574] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3812worker1 # [ 31.202669] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:500513813worker2 # [ 31.203606] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:500513814worker2 # [ 31.209363] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3815worker1 # [ 31.208475] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3816worker2 # [ 31.410106] nix-grpc-daemon[778]: ts=2026-09-20T09:33:11Z level=info event=scheduler_connected addr=lb:500513817worker1 # [ 31.409325] nix-grpc-daemon[774]: ts=2026-09-20T09:33:11Z level=info event=scheduler_connected addr=lb:500513818worker1 # [ 31.421302] nix-grpc-daemon[774]: ts=2026-09-20T09:33:11Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03819worker1 # [ 31.427488] nix-grpc-daemon[774]: ts=2026-09-20T09:33:11Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03820lb: (finished: waiting for unit niks3.service, in 17.03 seconds)3821lb: waiting for TCP port 5751 on localhost3822lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3823lb: (finished: waiting for TCP port 5751 on localhost, in 0.10 seconds)3824lb: waiting for unit envoy.service3825lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3826lb: waiting for TCP port 50051 on localhost3827lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3828lb # [ 31.762467] envoy[913]: conn peer=[::1]:58144 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=43829lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds)3830lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3831??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3832 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283833lb: must succeed: curl -sf localhost:9901/clusters3834lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)3835lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds)3836subtest: one node schedules and both builders hold a WorkerSession on it3837lb: must succeed: curl -sf localhost:9901/clusters3838lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3839worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true3840worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)3841(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.15 seconds)3842subtest: balancer auth: client cert, bearer token, nothing, unknown CN3843worker1 # [ 32.585911] nix-grpc-daemon[774]: ts=2026-09-20T09:33:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:492383844worker1 # [ 32.596335] systemd[1]: Started Nix Daemon.3845worker1 # [ 32.862365] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3846worker1 # [ 32.896903] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 1/5)3847worker1 # [ 32.968196] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 9 ms (attempt 2/5)3848worker1 # [ 32.983439] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 117 ms (attempt 3/5)3849worker1 # [ 33.107978] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 118 ms (attempt 4/5)3850worker1 # [ 33.235808] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3851worker2 # [ 33.279248] nix-grpc-daemon[778]: ts=2026-09-20T09:33:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:500503852worker2 # [ 33.295097] systemd[1]: Started Nix Daemon.3853worker2 # [ 33.588997] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3854worker2 # [ 33.616330] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5)3855worker2 # [ 33.656174] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 2/5)3856worker2 # [ 33.715572] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 3/5)3857worker2 # [ 33.812914] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 792 ms (attempt 4/5)3858worker2 # [ 34.615858] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3859worker2 # [ 34.632104] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=path_info_miss path=w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test error="error: path '/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test' is required, but there is no substituter that can build it"3860worker2 # [ 34.645360] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:500503861worker2 # [ 34.657550] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=path_info_miss path=w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test error="error: path '/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test' is required, but there is no substituter that can build it"3862client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3863client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.11 seconds)3864client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3865client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3866worker2 # [ 35.108228] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=info event=oidc_jwks provider=mock keys=13867worker2 # [ 35.114574] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:500503868worker1 # [ 35.138908] nix-grpc-daemon[774]: ts=2026-09-20T09:33:14Z level=info event=oidc_jwks provider=mock keys=13869worker1 # [ 35.144708] nix-grpc-daemon[774]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:492383870worker2 # [ 35.164966] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:500503871worker1 # [ 35.158161] nix-grpc-daemon[774]: ts=2026-09-20T09:33:14Z level=debug event=path_info_miss path=w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test error="error: path '/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test' is required, but there is no substituter that can build it"3872worker2 # [ 35.177325] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=path_info_miss path=w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test error="error: path '/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test' is required, but there is no substituter that can build it"3873client: must succeed: rm -r /var/lib/nix-grpc-store3874client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.06 seconds)3875worker1 # [ 37.546099] nix-grpc-daemon[774]: ts=2026-09-20T09:33:17Z level=info event=denied method=QueryMissing cn=- role=none3876worker2 # [ 37.827668] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=info event=denied method=QueryMissing cn=stranger role=none3877(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.62 seconds)3878subtest: DAG build is scheduled across workers and lands in the cache3879client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23880worker1 # [ 38.094144] nix-grpc-daemon[774]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:492383881client # don't know how to build these paths:3882client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3883worker2 # [ 38.111884] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500503884worker1 # [ 38.163697] nix-grpc-daemon[774]: ts=2026-09-20T09:33:17Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03885worker1 # [ 38.170283] nix-grpc-daemon[774]: ts=2026-09-20T09:33:17Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=13886worker2 # [ 38.220158] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500503887worker2 # [ 38.248551] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500503888client # copying 1 paths to 'lb:50051'...3889worker2 # [ 38.268139] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500503890client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3891worker2 # [ 38.309082] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3892worker2 # [ 38.353531] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=info event=niks3_push_started pid=8463893worker2 # [ 38.849915] nix-daemon[836]: accepted connection from pid 859, user nix-grpc-daemon (trusted)3894worker2 # [ 38.871035] nix-daemon[836]: reaped child process 862, status = succeeded3895worker2 # [ 39.090608] nix-daemon[836]: accepted connection from pid 864, user nix-grpc-daemon (trusted)3896worker2 # [ 39.109261] nix-daemon[836]: reaped child process 868, status = succeeded3897lb # [ 39.114241] niks3-server[1032]: 2026/09/20 09:33:19 INFO Received uploads request method=POST path=/api/pending_closures3898worker2 # [ 39.173824] nix-grpc-daemon[846]: time=2026-09-20T09:33:18.794Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3899worker2 # [ 39.175918] nix-grpc-daemon[846]: time=2026-09-20T09:33:18.794Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3900lb # [ 39.227690] niks3-server[1032]: 2026/09/20 09:33:19 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3901lb # [ 39.243157] niks3-server[1032]: 2026/09/20 09:33:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3902worker2 # [ 39.265371] nix-grpc-daemon[846]: time=2026-09-20T09:33:18.887Z level=INFO msg="Uploading 1 narinfos"3903lb # [ 39.254628] niks3-server[1032]: 2026/09/20 09:33:19 INFO Signed narinfos id=1 count=13904lb # [ 39.279197] niks3-server[1032]: 2026/09/20 09:33:19 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3905lb # [ 39.292367] niks3-server[1032]: 2026/09/20 09:33:19 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3906lb # [ 39.320607] niks3-server[1032]: 2026/09/20 09:33:19 INFO Completed upload id=13907lb # [ 39.329347] niks3-server[1032]: 2026/09/20 09:33:19 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3908worker2 # [ 39.330401] nix-grpc-daemon[846]: time=2026-09-20T09:33:18.953Z level=INFO msg="Upload complete. (680ms)"3909worker2 # [ 39.348741] nix-grpc-daemon[778]: ts=2026-09-20T09:33:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 paths=1 nar_bytes_in=5043910worker2 # [ 39.361155] nix-grpc-daemon[778]: ts=2026-09-20T09:33:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500503911worker2 # [ 39.380077] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3912worker2 # [ 39.385287] nix-daemon[836]: reaped child process 844, status = succeeded3913client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3914worker2 # [ 39.401366] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3915client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3916client # farm-a> LOG-farm-a-t13917lb # [ 40.921407] envoy[913]: conn peer=[2001:db8:1::1]:55908 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=21213918lb # [ 40.927557] envoy[913]: conn peer=[2001:db8:1::1]:55920 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=983919lb # [ 40.933557] envoy[913]: conn peer=[2001:db8:1::1]:55930 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=199 ms=253920lb # [ 40.940275] envoy[913]: conn peer=[2001:db8:1::1]:55936 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=183921worker2 # [ 41.074002] nix-daemon[836]: reaped child process 872, status = succeeded3922worker2 # [ 41.268166] nix-daemon[836]: accepted connection from pid 887, user nix-grpc-daemon (trusted)3923worker2 # [ 41.291544] nix-daemon[836]: reaped child process 890, status = succeeded3924lb # [ 41.299294] niks3-server[1032]: 2026/09/20 09:33:21 INFO Received uploads request method=POST path=/api/pending_closures3925worker2 # [ 41.332862] nix-grpc-daemon[846]: time=2026-09-20T09:33:20.955Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3926worker2 # [ 41.335788] nix-grpc-daemon[846]: time=2026-09-20T09:33:20.958Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3927lb # [ 41.369459] niks3-server[1032]: 2026/09/20 09:33:21 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3928lb # [ 41.382440] niks3-server[1032]: 2026/09/20 09:33:21 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3929lb # [ 41.399369] niks3-server[1032]: 2026/09/20 09:33:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3930lb # [ 41.410211] niks3-server[1032]: 2026/09/20 09:33:21 INFO Signed narinfos id=2 count=13931worker2 # [ 41.417911] nix-grpc-daemon[846]: time=2026-09-20T09:33:21.039Z level=INFO msg="Uploading 1 narinfos"3932lb # [ 41.413819] niks3-server[1032]: 2026/09/20 09:33:21 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3933lb # [ 41.428569] niks3-server[1032]: 2026/09/20 09:33:22 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3934lb # [ 41.438850] niks3-server[1032]: 2026/09/20 09:33:22 INFO Completed upload id=23935worker2 # [ 41.448419] nix-grpc-daemon[846]: time=2026-09-20T09:33:21.071Z level=INFO msg="Upload complete. (426ms)"3936lb # [ 41.442949] niks3-server[1032]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3937worker2 # [ 41.466322] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13938worker1 # [ 41.475339] nix-grpc-daemon[774]: ts=2026-09-20T09:33:21Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03939worker1 # [ 41.482246] nix-grpc-daemon[774]: ts=2026-09-20T09:33:21Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=13940worker2 # [ 41.496998] nix-daemon[836]: reaped child process 870, status = succeeded3941worker2 # [ 41.528810] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500503942worker2 # [ 41.549423] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500503943worker2 # [ 41.570010] nix-grpc-daemon[846]: time=2026-09-20T09:33:21.193Z level=INFO msg="All 1 paths already cached"3944client # copying 1 paths to 'lb:50051'...3945worker2 # [ 41.582002] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500503946client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3947worker2 # [ 41.608346] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3948worker2 # [ 41.851333] nix-daemon[836]: accepted connection from pid 894, user nix-grpc-daemon (trusted)3949worker2 # [ 41.874525] nix-daemon[836]: reaped child process 897, status = succeeded3950worker2 # [ 42.058093] nix-daemon[836]: accepted connection from pid 899, user nix-grpc-daemon (trusted)3951worker2 # [ 42.077991] nix-daemon[836]: reaped child process 902, status = succeeded3952lb # [ 42.080150] niks3-server[1032]: 2026/09/20 09:33:22 INFO Received uploads request method=POST path=/api/pending_closures3953worker2 # [ 42.104927] nix-grpc-daemon[846]: time=2026-09-20T09:33:21.727Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3954worker2 # [ 42.106517] nix-grpc-daemon[846]: time=2026-09-20T09:33:21.727Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3955lb # [ 42.118977] niks3-server[1032]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3956worker2 # [ 42.145116] nix-grpc-daemon[846]: time=2026-09-20T09:33:21.768Z level=INFO msg="Uploading 1 narinfos"3957lb # [ 42.136249] niks3-server[1032]: 2026/09/20 09:33:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3958lb # [ 42.145036] niks3-server[1032]: 2026/09/20 09:33:22 INFO Signed narinfos id=3 count=13959lb # [ 42.154298] niks3-server[1032]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3960lb # [ 42.165487] niks3-server[1032]: 2026/09/20 09:33:22 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3961lb # [ 42.170392] niks3-server[1032]: 2026/09/20 09:33:22 INFO Completed upload id=33962worker2 # [ 42.179864] nix-grpc-daemon[846]: time=2026-09-20T09:33:21.803Z level=INFO msg="Upload complete. (551ms)"3963lb # [ 42.173273] niks3-server[1032]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3964worker2 # [ 42.191056] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=0 paths=1 nar_bytes_in=6243965worker2 # [ 42.209851] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500503966worker2 # [ 42.219968] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3967worker2 # [ 42.226187] nix-daemon[836]: reaped child process 892, status = succeeded3968client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3969client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3970worker2 # [ 42.248450] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3971client # farm-b> LOG-farm-b-t13972worker2 # [ 43.287082] nix-daemon[836]: reaped child process 906, status = succeeded3973worker2 # [ 43.458737] nix-daemon[836]: accepted connection from pid 922, user nix-grpc-daemon (trusted)3974worker2 # [ 43.479702] nix-daemon[836]: reaped child process 925, status = succeeded3975lb # [ 43.487553] niks3-server[1032]: 2026/09/20 09:33:24 INFO Received uploads request method=POST path=/api/pending_closures3976worker2 # [ 43.512454] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.134Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3977worker2 # [ 43.514112] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.134Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3978lb # [ 43.533512] niks3-server[1032]: 2026/09/20 09:33:24 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3979lb # [ 43.546647] niks3-server[1032]: 2026/09/20 09:33:24 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3980worker2 # [ 43.562967] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.185Z level=INFO msg="Uploading 1 narinfos"3981lb # [ 43.556604] niks3-server[1032]: 2026/09/20 09:33:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3982lb # [ 43.559849] niks3-server[1032]: 2026/09/20 09:33:24 INFO Signed narinfos id=4 count=13983lb # [ 43.570841] niks3-server[1032]: 2026/09/20 09:33:24 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3984lb # [ 43.577767] niks3-server[1032]: 2026/09/20 09:33:24 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3985worker2 # [ 43.586335] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.209Z level=INFO msg="Upload complete. (315ms)"3986lb # [ 43.580637] niks3-server[1032]: 2026/09/20 09:33:24 INFO Completed upload id=43987lb # [ 43.584040] niks3-server[1032]: 2026/09/20 09:33:24 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3988worker2 # [ 43.597121] nix-grpc-daemon[778]: ts=2026-09-20T09:33:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13989worker1 # [ 43.605802] nix-grpc-daemon[774]: ts=2026-09-20T09:33:23Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03990worker2 # [ 43.615321] nix-daemon[836]: reaped child process 904, status = succeeded3991worker1 # [ 43.612373] nix-grpc-daemon[774]: ts=2026-09-20T09:33:23Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=13992worker2 # [ 43.663167] nix-grpc-daemon[778]: ts=2026-09-20T09:33:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500503993worker2 # [ 43.685361] nix-grpc-daemon[778]: ts=2026-09-20T09:33:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500503994worker2 # [ 43.704852] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.328Z level=INFO msg="All 2 paths already cached"3995client # copying 1 paths to 'lb:50051'...3996client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3997worker2 # [ 43.717642] nix-grpc-daemon[778]: ts=2026-09-20T09:33:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500503998worker2 # [ 43.738196] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3999worker2 # [ 43.955598] nix-daemon[836]: accepted connection from pid 929, user nix-grpc-daemon (trusted)4000worker2 # [ 43.975704] nix-daemon[836]: reaped child process 932, status = succeeded4001worker2 # [ 44.160192] nix-daemon[836]: accepted connection from pid 934, user nix-grpc-daemon (trusted)4002worker2 # [ 44.179983] nix-daemon[836]: reaped child process 937, status = succeeded4003lb # [ 44.183534] niks3-server[1032]: 2026/09/20 09:33:24 INFO Received uploads request method=POST path=/api/pending_closures4004worker2 # [ 44.203724] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.827Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4005worker2 # [ 44.205985] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.828Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"4006lb # [ 44.223659] niks3-server[1032]: 2026/09/20 09:33:24 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst4007worker2 # [ 44.247636] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.870Z level=INFO msg="Uploading 1 narinfos"4008lb # [ 44.242044] niks3-server[1032]: 2026/09/20 09:33:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4009lb # [ 44.251273] niks3-server[1032]: 2026/09/20 09:33:24 INFO Signed narinfos id=5 count=14010lb # [ 44.257290] niks3-server[1032]: 2026/09/20 09:33:24 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls4011lb # [ 44.267665] niks3-server[1032]: 2026/09/20 09:33:24 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4012lb # [ 44.274102] niks3-server[1032]: 2026/09/20 09:33:24 INFO Completed upload id=54013lb # [ 44.278032] niks3-server[1032]: 2026/09/20 09:33:24 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo4014worker2 # [ 44.281870] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.905Z level=INFO msg="Upload complete. (523ms)"4015worker2 # [ 44.292373] nix-grpc-daemon[778]: ts=2026-09-20T09:33:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=0 paths=1 nar_bytes_in=7524016worker2 # [ 44.308206] nix-grpc-daemon[778]: ts=2026-09-20T09:33:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500504017worker2 # [ 44.315993] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4018worker2 # [ 44.321780] nix-daemon[836]: reaped child process 927, status = succeeded4019client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...4020client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4021worker2 # [ 44.337698] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4022client # farm-top> LOG-farm-top-t14023worker2 # [ 45.586125] nix-daemon[836]: reaped child process 941, status = succeeded4024worker2 # [ 45.770554] nix-daemon[836]: accepted connection from pid 956, user nix-grpc-daemon (trusted)4025worker2 # [ 45.792235] nix-daemon[836]: reaped child process 960, status = succeeded4026lb # [ 45.802433] niks3-server[1032]: 2026/09/20 09:33:26 INFO Received uploads request method=POST path=/api/pending_closures4027worker2 # [ 45.826748] nix-grpc-daemon[846]: time=2026-09-20T09:33:25.447Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4028worker2 # [ 45.828541] nix-grpc-daemon[846]: time=2026-09-20T09:33:25.448Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4029lb # [ 45.862957] niks3-server[1032]: 2026/09/20 09:33:26 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4030lb # [ 45.877841] niks3-server[1032]: 2026/09/20 09:33:26 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4031worker2 # [ 45.892907] nix-grpc-daemon[846]: time=2026-09-20T09:33:25.515Z level=INFO msg="Uploading 1 narinfos"4032lb # [ 45.886479] niks3-server[1032]: 2026/09/20 09:33:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4033lb # [ 45.892624] niks3-server[1032]: 2026/09/20 09:33:26 INFO Signed narinfos id=6 count=14034lb # [ 45.894382] niks3-server[1032]: 2026/09/20 09:33:26 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4035lb # [ 45.899697] niks3-server[1032]: 2026/09/20 09:33:26 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4036lb # [ 45.911731] niks3-server[1032]: 2026/09/20 09:33:26 INFO Completed upload id=64037lb # [ 45.913890] niks3-server[1032]: 2026/09/20 09:33:26 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4038worker2 # [ 45.921250] nix-grpc-daemon[846]: time=2026-09-20T09:33:25.544Z level=INFO msg="Upload complete. (371ms)"4039worker2 # [ 45.933678] nix-grpc-daemon[778]: ts=2026-09-20T09:33:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14040worker2 # [ 45.963019] nix-daemon[836]: reaped child process 939, status = succeeded4041client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 8.15 seconds)4042client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4043client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.29 seconds)4044client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4045client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)4046client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4047client # copying 3 paths...4048client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4049client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4050client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4051client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.33 seconds)4052(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.94 seconds)4053subtest: repeat is answered Cached by the scheduler without building4054worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4055worker1 # finding garbage collector roots...4056worker1 # deleting specified paths...4057worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4058worker1 # deleting unused links...4059worker1 # note: hard linking is currently saving 0.0 KiB4060worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.33 seconds)4061worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4062worker2 # finding garbage collector roots...4063worker2 # deleting specified paths...4064worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4065worker2 # deleting unused links...4066worker2 # note: hard linking is currently saving 0.0 KiB4067worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds)4068client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24069worker1 # [ 47.705731] nix-grpc-daemon[774]: ts=2026-09-20T09:33:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:492384070client # don't know how to build these paths:4071client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4072worker2 # [ 47.725246] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500504073worker2 # [ 47.742032] nix-grpc-daemon[846]: time=2026-09-20T09:33:27.362Z level=INFO msg="All 2 paths already cached"4074worker1 # [ 47.757415] nix-grpc-daemon[774]: ts=2026-09-20T09:33:27Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14075client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.38 seconds)4076client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4077client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds)4078lb: must succeed: curl -sf localhost:9901/clusters4079lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4080lb: must succeed: curl -sf localhost:9901/clusters4081lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4082worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4083worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.09 seconds)4084(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.62 seconds)4085subtest: inputs already in the cache are not sent to the scheduler4086lb: must succeed: curl -sf localhost:9901/clusters4087lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4088lb: must succeed: curl -sf localhost:9901/clusters4089lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4090worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4091worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4092client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24093worker2 # [ 48.866562] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:500504094client # don't know how to build these paths:4095client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4096worker2 # [ 48.878028] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500504097worker2 # [ 48.891046] nix-grpc-daemon[846]: time=2026-09-20T09:33:28.513Z level=INFO msg="All 2 paths already cached"4098worker1 # [ 48.907670] nix-grpc-daemon[774]: ts=2026-09-20T09:33:28Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04099worker1 # [ 48.913838] nix-grpc-daemon[774]: ts=2026-09-20T09:33:28Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=14100worker2 # [ 48.954118] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500504101worker2 # [ 48.971199] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500504102worker2 # [ 48.987556] nix-grpc-daemon[846]: time=2026-09-20T09:33:28.610Z level=INFO msg="All 2 paths already cached"4103client # copying 1 paths to 'lb:50051'...4104client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4105worker2 # [ 49.000938] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500504106worker2 # [ 49.019761] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4107worker2 # [ 49.233268] nix-daemon[836]: accepted connection from pid 977, user nix-grpc-daemon (trusted)4108worker2 # [ 49.255426] nix-daemon[836]: reaped child process 980, status = succeeded4109worker2 # [ 49.430384] nix-daemon[836]: accepted connection from pid 982, user nix-grpc-daemon (trusted)4110worker2 # [ 49.448426] nix-daemon[836]: reaped child process 985, status = succeeded4111lb # [ 49.451534] niks3-server[1032]: 2026/09/20 09:33:30 INFO Received uploads request method=POST path=/api/pending_closures4112worker2 # [ 49.470773] nix-grpc-daemon[846]: time=2026-09-20T09:33:29.093Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4113worker2 # [ 49.472378] nix-grpc-daemon[846]: time=2026-09-20T09:33:29.093Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4114lb # [ 49.480928] niks3-server[1032]: 2026/09/20 09:33:30 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4115worker2 # [ 49.504449] nix-grpc-daemon[846]: time=2026-09-20T09:33:29.127Z level=INFO msg="Uploading 1 narinfos"4116lb # [ 49.498368] niks3-server[1032]: 2026/09/20 09:33:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4117lb # [ 49.508818] niks3-server[1032]: 2026/09/20 09:33:30 INFO Signed narinfos id=7 count=14118lb # [ 49.513605] niks3-server[1032]: 2026/09/20 09:33:30 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4119lb # [ 49.521586] niks3-server[1032]: 2026/09/20 09:33:30 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4120worker2 # [ 49.535862] nix-grpc-daemon[846]: time=2026-09-20T09:33:29.159Z level=INFO msg="Upload complete. (497ms)"4121lb # [ 49.526530] niks3-server[1032]: 2026/09/20 09:33:30 INFO Completed upload id=74122lb # [ 49.529516] niks3-server[1032]: 2026/09/20 09:33:30 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4123worker2 # [ 49.544283] nix-grpc-daemon[778]: ts=2026-09-20T09:33:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=0 paths=1 nar_bytes_in=7524124worker2 # [ 49.556309] nix-grpc-daemon[778]: ts=2026-09-20T09:33:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500504125worker2 # [ 49.564374] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4126worker2 # [ 49.567799] nix-daemon[836]: reaped child process 975, status = succeeded4127client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4128client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4129worker2 # [ 49.581435] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4130client # farm-top> LOG-farm-top-t1b4131worker2 # [ 50.618096] nix-daemon[836]: reaped child process 989, status = succeeded4132worker2 # [ 50.783004] nix-daemon[836]: accepted connection from pid 1004, user nix-grpc-daemon (trusted)4133worker2 # [ 50.804242] nix-daemon[836]: reaped child process 1007, status = succeeded4134lb # [ 50.807775] niks3-server[1032]: 2026/09/20 09:33:31 INFO Received uploads request method=POST path=/api/pending_closures4135worker2 # [ 50.828437] nix-grpc-daemon[846]: time=2026-09-20T09:33:30.449Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4136worker2 # [ 50.829939] nix-grpc-daemon[846]: time=2026-09-20T09:33:30.449Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4137lb # [ 50.851232] niks3-server[1032]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4138worker2 # [ 50.875897] nix-grpc-daemon[846]: time=2026-09-20T09:33:30.498Z level=INFO msg="Uploading 1 narinfos"4139lb # [ 50.863023] niks3-server[1032]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4140lb # [ 50.877600] niks3-server[1032]: 2026/09/20 09:33:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4141lb # [ 50.886869] niks3-server[1032]: 2026/09/20 09:33:31 INFO Signed narinfos id=8 count=14142lb # [ 50.892142] niks3-server[1032]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4143lb # [ 50.895969] niks3-server[1032]: 2026/09/20 09:33:31 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4144worker2 # [ 50.910035] nix-grpc-daemon[846]: time=2026-09-20T09:33:30.533Z level=INFO msg="Upload complete. (319ms)"4145lb # [ 50.900828] niks3-server[1032]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4146lb # [ 50.904929] niks3-server[1032]: 2026/09/20 09:33:31 INFO Completed upload id=84147worker2 # [ 50.919717] nix-grpc-daemon[778]: ts=2026-09-20T09:33:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14148lb # [ 50.919669] envoy[913]: conn peer=[2001:db8:1::1]:55942 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9549 tx=3821 ms=78674149lb # [ 50.924408] envoy[913]: conn peer=[2001:db8:1::1]:45642 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=481 ms=764150worker2 # [ 50.936973] nix-daemon[836]: reaped child process 987, status = succeeded4151lb # [ 50.928736] envoy[913]: conn peer=[2001:db8:1::1]:45646 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1731 ms=20704152client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.35 seconds)4153client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4154client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.23 seconds)4155lb: must succeed: curl -sf localhost:9901/clusters4156lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4157lb: must succeed: curl -sf localhost:9901/clusters4158lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4159worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4160worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4161(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.98 seconds)4162subtest: two clients wanting the same drv build it once4163client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4164client # [ 51.497317] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4165client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds)4166client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4167client # Running as unit: dedup1.service; invocation ID: abeb70959be545eb82df2d7b13dd82894168client # [ 51.747408] nix[885]: don't know how to build these paths:4169client # [ 51.749458] nix[885]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4170worker1 # [ 51.722244] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:492384171worker1 # [ 51.736267] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04172worker1 # [ 51.742454] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=14173worker1 # [ 51.787564] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492384174worker1 # [ 51.809516] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492384175client # [ 51.848194] nix[885]: copying 1 paths to 'lb:50051'...4176worker1 # [ 51.825165] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:492384177client # [ 51.852295] nix[885]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4178worker1 # [ 51.845398] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4179worker1 # [ 51.876510] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=info event=niks3_push_started pid=8904180worker1 # [ 52.329934] nix-daemon[836]: accepted connection from pid 903, user nix-grpc-daemon (trusted)4181worker1 # [ 52.353758] nix-daemon[836]: reaped child process 906, status = succeeded4182worker1 # [ 52.529397] nix-daemon[836]: accepted connection from pid 908, user nix-grpc-daemon (trusted)4183worker1 # [ 52.548130] nix-daemon[836]: reaped child process 911, status = succeeded4184lb # [ 52.552972] niks3-server[1032]: 2026/09/20 09:33:33 INFO Received uploads request method=POST path=/api/pending_closures4185worker1 # [ 52.573562] nix-grpc-daemon[890]: time=2026-09-20T09:33:32.190Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4186worker1 # [ 52.575119] nix-grpc-daemon[890]: time=2026-09-20T09:33:32.191Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4187lb # [ 52.589989] niks3-server[1032]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4188client # [ 52.617555] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4189client # Running as unit: dedup2.service; invocation ID: c6697a977cd44777823cbfb2f750c7064190lb # [ 52.603788] niks3-server[1032]: 2026/09/20 09:33:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4191worker1 # [ 52.618252] nix-grpc-daemon[890]: time=2026-09-20T09:33:32.237Z level=INFO msg="Uploading 1 narinfos"4192lb # [ 52.613458] niks3-server[1032]: 2026/09/20 09:33:33 INFO Signed narinfos id=9 count=14193client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds)4194lb # [ 52.622915] niks3-server[1032]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4195lb # [ 52.635270] niks3-server[1032]: 2026/09/20 09:33:33 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4196worker1 # [ 52.653512] nix-grpc-daemon[890]: time=2026-09-20T09:33:32.272Z level=INFO msg="Upload complete. (511ms)"4197lb # [ 52.646129] niks3-server[1032]: 2026/09/20 09:33:33 INFO Completed upload id=94198worker1 # [ 52.659453] nix-grpc-daemon[774]: ts=2026-09-20T09:33:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_in=4324199lb # [ 52.650470] niks3-server[1032]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4200worker1 # [ 52.671271] nix-grpc-daemon[774]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492384201worker1 # [ 52.676788] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4202worker1 # [ 52.680191] nix-daemon[836]: reaped child process 888, status = succeeded4203client # [ 52.713938] nix[885]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4204worker1 # [ 52.691748] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4205worker2 # [ 52.911223] nix-grpc-daemon[778]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:500504206client # [ 52.942391] nix[901]: don't know how to build these paths:4207client # [ 52.944052] nix[901]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4208worker1 # [ 52.931268] nix-grpc-daemon[774]: ts=2026-09-20T09:33:32Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04209worker1 # [ 52.944152] nix-grpc-daemon[774]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492384210client # [ 52.975916] nix[901]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4211client: must succeed: sleep 24212client: (finished: must succeed: sleep 2, in 2.07 seconds)4213??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4214 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394215client: waiting for success: ! systemctl is-active dedup1 dedup24216??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4217 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394218worker1 # [ 56.343817] nix-daemon[836]: reaped child process 919, status = succeeded4219worker1 # [ 56.525572] nix-daemon[836]: accepted connection from pid 946, user nix-grpc-daemon (trusted)4220worker1 # [ 56.545259] nix-daemon[836]: reaped child process 949, status = succeeded4221lb # [ 56.550319] niks3-server[1032]: 2026/09/20 09:33:37 INFO Received uploads request method=POST path=/api/pending_closures4222worker1 # [ 56.568595] nix-grpc-daemon[890]: time=2026-09-20T09:33:36.186Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4223worker1 # [ 56.570488] nix-grpc-daemon[890]: time=2026-09-20T09:33:36.186Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4224lb # [ 56.595328] niks3-server[1032]: 2026/09/20 09:33:37 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4225lb # [ 56.608765] niks3-server[1032]: 2026/09/20 09:33:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4226worker1 # [ 56.617813] nix-grpc-daemon[890]: time=2026-09-20T09:33:36.235Z level=INFO msg="Uploading 1 narinfos"4227lb # [ 56.619105] niks3-server[1032]: 2026/09/20 09:33:37 INFO Signed narinfos id=10 count=14228lb # [ 56.625194] niks3-server[1032]: 2026/09/20 09:33:37 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4229worker1 # [ 56.643520] nix-grpc-daemon[890]: time=2026-09-20T09:33:36.262Z level=INFO msg="Upload complete. (336ms)"4230lb # [ 56.636700] niks3-server[1032]: 2026/09/20 09:33:37 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4231lb # [ 56.641688] niks3-server[1032]: 2026/09/20 09:33:37 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4232lb # [ 56.647248] niks3-server[1032]: 2026/09/20 09:33:37 INFO Completed upload id=104233lb # [ 56.649940] niks3-server[1032]: 2026/09/20 09:33:37 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4234worker1 # [ 56.663963] nix-grpc-daemon[774]: ts=2026-09-20T09:33:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14235worker1 # [ 56.669233] nix-grpc-daemon[774]: ts=2026-09-20T09:33:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14236worker1 # [ 56.674128] nix-daemon[836]: reaped child process 917, status = succeeded4237client # [ 56.738065] systemd[1]: dedup2.service: Deactivated successfully.4238client # [ 56.742787] systemd[1]: dedup2.service: Consumed 183ms CPU time over 4.125s wall clock time, 31M memory peak, 7.6K incoming IP traffic, 6.5K outgoing IP traffic.4239client # [ 56.753752] systemd[1]: dedup1.service: Deactivated successfully.4240client # [ 56.755642] systemd[1]: dedup1.service: Consumed 163ms CPU time over 5.254s wall clock time, 39.2M memory peak, 8.6K incoming IP traffic, 8.9K outgoing IP traffic.4241client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds)4242client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4243client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4244worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4245worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4246worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4247worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4248worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4249worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4250worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4251worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4252(finished: subtest: two clients wanting the same drv build it once, in 6.33 seconds)4253subtest: build hook: nix-daemon with builders = grpc://lb4254client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4255client # [ 57.975924] systemd[1]: Started Nix Daemon.4256client # [ 58.166182] nix-daemon[943]: accepted connection from pid 940, user root (trusted)4257worker2 # [ 58.346864] nix-grpc-daemon[778]: ts=2026-09-20T09:33:37Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:500504258worker2 # [ 58.358115] nix-grpc-daemon[778]: ts=2026-09-20T09:33:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500504259worker1 # [ 58.377130] nix-grpc-daemon[774]: ts=2026-09-20T09:33:37Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04260worker1 # [ 58.383217] nix-grpc-daemon[774]: ts=2026-09-20T09:33:37Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14261worker2 # [ 58.425998] nix-grpc-daemon[778]: ts=2026-09-20T09:33:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500504262worker2 # [ 58.442127] nix-grpc-daemon[778]: ts=2026-09-20T09:33:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500504263worker2 # [ 58.457774] nix-grpc-daemon[778]: ts=2026-09-20T09:33:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500504264worker2 # [ 58.476395] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4265worker2 # [ 58.700346] nix-daemon[836]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4266worker2 # [ 58.723694] nix-daemon[836]: reaped child process 1037, status = succeeded4267worker2 # [ 58.902712] nix-daemon[836]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)4268worker2 # [ 58.921187] nix-daemon[836]: reaped child process 1042, status = succeeded4269lb # [ 58.925965] niks3-server[1032]: 2026/09/20 09:33:39 INFO Received uploads request method=POST path=/api/pending_closures4270worker2 # [ 58.943794] nix-grpc-daemon[846]: time=2026-09-20T09:33:38.566Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4271worker2 # [ 58.945474] nix-grpc-daemon[846]: time=2026-09-20T09:33:38.566Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4272lb # [ 58.951343] niks3-server[1032]: 2026/09/20 09:33:39 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4273lb # [ 58.966873] niks3-server[1032]: 2026/09/20 09:33:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4274worker2 # [ 58.981545] nix-grpc-daemon[846]: time=2026-09-20T09:33:38.604Z level=INFO msg="Uploading 1 narinfos"4275lb # [ 58.978159] niks3-server[1032]: 2026/09/20 09:33:39 INFO Signed narinfos id=11 count=14276lb # [ 58.984300] niks3-server[1032]: 2026/09/20 09:33:39 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4277worker2 # [ 59.000881] nix-grpc-daemon[846]: time=2026-09-20T09:33:38.624Z level=INFO msg="Upload complete. (507ms)"4278lb # [ 58.993192] niks3-server[1032]: 2026/09/20 09:33:39 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4279lb # [ 58.998209] niks3-server[1032]: 2026/09/20 09:33:39 INFO Completed upload id=114280worker2 # [ 59.006773] nix-grpc-daemon[778]: ts=2026-09-20T09:33:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=0 paths=1 nar_bytes_in=5124281lb # [ 59.001493] niks3-server[1032]: 2026/09/20 09:33:39 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4282worker2 # [ 59.016864] nix-grpc-daemon[778]: ts=2026-09-20T09:33:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500504283worker2 # [ 59.028166] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4284worker2 # [ 59.031309] nix-daemon[836]: reaped child process 1032, status = succeeded4285worker2 # [ 59.045022] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4286worker2 # [ 60.287874] nix-daemon[836]: reaped child process 1046, status = succeeded4287worker2 # [ 60.468305] nix-daemon[836]: accepted connection from pid 1061, user nix-grpc-daemon (trusted)4288worker2 # [ 60.487757] nix-daemon[836]: reaped child process 1064, status = succeeded4289lb # [ 60.491170] niks3-server[1032]: 2026/09/20 09:33:41 INFO Received uploads request method=POST path=/api/pending_closures4290worker2 # [ 60.509866] nix-grpc-daemon[846]: time=2026-09-20T09:33:40.132Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4291worker2 # [ 60.514734] nix-grpc-daemon[846]: time=2026-09-20T09:33:40.134Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4292lb # [ 60.532834] niks3-server[1032]: 2026/09/20 09:33:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4293worker2 # [ 60.554844] nix-grpc-daemon[846]: time=2026-09-20T09:33:40.177Z level=INFO msg="Uploading 1 narinfos"4294lb # [ 60.550054] niks3-server[1032]: 2026/09/20 09:33:41 INFO Signed narinfos id=12 count=14295lb # [ 60.562377] niks3-server[1032]: 2026/09/20 09:33:41 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4296lb # [ 60.571319] niks3-server[1032]: 2026/09/20 09:33:41 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4297lb # [ 60.580357] niks3-server[1032]: 2026/09/20 09:33:41 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4298lb # [ 60.585526] niks3-server[1032]: 2026/09/20 09:33:41 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4299worker2 # [ 60.594842] nix-grpc-daemon[846]: time=2026-09-20T09:33:40.218Z level=INFO msg="Upload complete. (340ms)"4300lb # [ 60.589179] niks3-server[1032]: 2026/09/20 09:33:41 INFO Completed upload id=124301lb # [ 60.592180] niks3-server[1032]: 2026/09/20 09:33:41 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4302worker2 # [ 60.605141] nix-grpc-daemon[778]: ts=2026-09-20T09:33:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14303worker2 # [ 60.624648] nix-grpc-daemon[778]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:500504304worker2 # [ 60.629558] nix-daemon[836]: reaped child process 1044, status = succeeded4305worker1 # [ 60.641847] nix-grpc-daemon[774]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:492384306worker1 # [ 60.664621] nix-grpc-daemon[774]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4307worker1 # [ 60.687788] nix-grpc-daemon[774]: ts=2026-09-20T09:33:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_out=1284308lb # [ 60.917484] envoy[913]: conn peer=[2001:db8:1::1]:45888 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1085 ms=37664309lb # [ 60.922573] envoy[913]: conn peer=[2001:db8:1::1]:45878 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1372 ms=49534310lb # [ 60.927654] envoy[913]: conn peer=[2001:db8:1::1]:45906 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=334 ms=1084311lb # [ 60.932469] envoy[913]: conn peer=[2001:db8:1::1]:45890 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3401 tx=1664 ms=24004312worker2 # [ 60.989757] nix-grpc-daemon[778]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:500504313worker2 # [ 60.997117] nix-grpc-daemon[778]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500504314worker2 # [ 61.003779] nix-grpc-daemon[846]: time=2026-09-20T09:33:40.626Z level=INFO msg="All 1 paths already cached"4315worker1 # [ 61.016446] nix-grpc-daemon[774]: ts=2026-09-20T09:33:40Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04316worker1 # [ 61.022986] nix-grpc-daemon[774]: ts=2026-09-20T09:33:40Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14317worker2 # [ 61.027218] nix-grpc-daemon[778]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500504318worker2 # [ 61.042046] nix-grpc-daemon[778]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500504319worker2 # [ 61.056225] nix-grpc-daemon[846]: time=2026-09-20T09:33:40.679Z level=INFO msg="All 1 paths already cached"4320worker2 # [ 61.065149] nix-grpc-daemon[778]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500504321worker2 # [ 61.079087] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4322worker2 # [ 61.288610] nix-daemon[836]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)4323worker2 # [ 61.306846] nix-daemon[836]: reaped child process 1071, status = succeeded4324worker2 # [ 61.478957] nix-daemon[836]: accepted connection from pid 1073, user nix-grpc-daemon (trusted)4325worker2 # [ 61.495694] nix-daemon[836]: reaped child process 1076, status = succeeded4326lb # [ 61.498654] niks3-server[1032]: 2026/09/20 09:33:42 INFO Received uploads request method=POST path=/api/pending_closures4327worker2 # [ 61.517208] nix-grpc-daemon[846]: time=2026-09-20T09:33:41.140Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4328worker2 # [ 61.518685] nix-grpc-daemon[846]: time=2026-09-20T09:33:41.140Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4329lb # [ 61.524352] niks3-server[1032]: 2026/09/20 09:33:42 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4330worker2 # [ 61.547154] nix-grpc-daemon[846]: time=2026-09-20T09:33:41.170Z level=INFO msg="Uploading 1 narinfos"4331lb # [ 61.541192] niks3-server[1032]: 2026/09/20 09:33:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4332lb # [ 61.552316] niks3-server[1032]: 2026/09/20 09:33:42 INFO Signed narinfos id=13 count=14333lb # [ 61.563994] niks3-server[1032]: 2026/09/20 09:33:42 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4334worker2 # [ 61.578070] nix-grpc-daemon[846]: time=2026-09-20T09:33:41.201Z level=INFO msg="Upload complete. (481ms)"4335lb # [ 61.569693] niks3-server[1032]: 2026/09/20 09:33:42 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4336worker2 # [ 61.584275] nix-grpc-daemon[778]: ts=2026-09-20T09:33:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=0 paths=1 nar_bytes_in=6244337lb # [ 61.575301] niks3-server[1032]: 2026/09/20 09:33:42 INFO Completed upload id=134338lb # [ 61.579931] niks3-server[1032]: 2026/09/20 09:33:42 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4339worker2 # [ 61.597161] nix-grpc-daemon[778]: ts=2026-09-20T09:33:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500504340worker2 # [ 61.602588] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4341worker2 # [ 61.607382] nix-daemon[836]: reaped child process 1066, status = succeeded4342worker2 # [ 61.619864] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4343worker2 # [ 62.668812] nix-daemon[836]: reaped child process 1080, status = succeeded4344worker2 # [ 62.849752] nix-daemon[836]: accepted connection from pid 1095, user nix-grpc-daemon (trusted)4345worker2 # [ 62.868533] nix-daemon[836]: reaped child process 1098, status = succeeded4346lb # [ 62.874064] niks3-server[1032]: 2026/09/20 09:33:43 INFO Received uploads request method=POST path=/api/pending_closures4347worker2 # [ 62.894091] nix-grpc-daemon[846]: time=2026-09-20T09:33:42.516Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4348worker2 # [ 62.895617] nix-grpc-daemon[846]: time=2026-09-20T09:33:42.516Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4349lb # [ 62.915321] niks3-server[1032]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4350worker2 # [ 62.936714] nix-grpc-daemon[846]: time=2026-09-20T09:33:42.559Z level=INFO msg="Uploading 1 narinfos"4351lb # [ 62.929376] niks3-server[1032]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4352lb # [ 62.938325] niks3-server[1032]: 2026/09/20 09:33:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4353lb # [ 62.946842] niks3-server[1032]: 2026/09/20 09:33:43 INFO Signed narinfos id=14 count=14354worker2 # [ 62.959778] nix-grpc-daemon[846]: time=2026-09-20T09:33:42.583Z level=INFO msg="Upload complete. (328ms)"4355lb # [ 62.952738] niks3-server[1032]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4356lb # [ 62.955702] niks3-server[1032]: 2026/09/20 09:33:43 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4357lb # [ 62.959828] niks3-server[1032]: 2026/09/20 09:33:43 INFO Completed upload id=144358lb # [ 62.962399] niks3-server[1032]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4359worker2 # [ 62.973101] nix-grpc-daemon[778]: ts=2026-09-20T09:33:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14360worker2 # [ 62.986737] nix-daemon[836]: reaped child process 1078, status = succeeded4361worker2 # [ 63.017355] nix-grpc-daemon[778]: ts=2026-09-20T09:33:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:500504362worker1 # [ 63.050360] nix-grpc-daemon[774]: ts=2026-09-20T09:33:42Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:492384363worker1 # [ 63.065035] nix-grpc-daemon[774]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4364worker1 # [ 63.082255] nix-grpc-daemon[774]: ts=2026-09-20T09:33:42Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_out=1764365worker1 # [ 63.387439] nix-grpc-daemon[774]: ts=2026-09-20T09:33:43Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:492384366worker2 # [ 63.394161] nix-grpc-daemon[778]: ts=2026-09-20T09:33:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500504367worker2 # [ 63.405292] nix-grpc-daemon[846]: time=2026-09-20T09:33:43.028Z level=INFO msg="All 2 paths already cached"4368worker1 # [ 63.422140] nix-grpc-daemon[774]: ts=2026-09-20T09:33:43Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04369worker1 # [ 63.428392] nix-grpc-daemon[774]: ts=2026-09-20T09:33:43Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14370worker2 # [ 63.469853] nix-grpc-daemon[778]: ts=2026-09-20T09:33:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500504371worker2 # [ 63.486328] nix-grpc-daemon[778]: ts=2026-09-20T09:33:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500504372worker2 # [ 63.500896] nix-grpc-daemon[846]: time=2026-09-20T09:33:43.124Z level=INFO msg="All 2 paths already cached"4373worker2 # [ 63.510410] nix-grpc-daemon[778]: ts=2026-09-20T09:33:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500504374worker2 # [ 63.524601] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4375worker2 # [ 63.732888] nix-daemon[836]: accepted connection from pid 1102, user nix-grpc-daemon (trusted)4376worker2 # [ 63.752637] nix-daemon[836]: reaped child process 1105, status = succeeded4377worker2 # [ 63.929284] nix-daemon[836]: accepted connection from pid 1107, user nix-grpc-daemon (trusted)4378worker2 # [ 63.946764] nix-daemon[836]: reaped child process 1110, status = succeeded4379lb # [ 63.952146] niks3-server[1032]: 2026/09/20 09:33:44 INFO Received uploads request method=POST path=/api/pending_closures4380worker2 # [ 63.968538] nix-grpc-daemon[846]: time=2026-09-20T09:33:43.591Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4381worker2 # [ 63.970487] nix-grpc-daemon[846]: time=2026-09-20T09:33:43.593Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4382lb # [ 63.984134] niks3-server[1032]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4383worker2 # [ 64.007049] nix-grpc-daemon[846]: time=2026-09-20T09:33:43.630Z level=INFO msg="Uploading 1 narinfos"4384lb # [ 64.001336] niks3-server[1032]: 2026/09/20 09:33:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4385lb # [ 64.010317] niks3-server[1032]: 2026/09/20 09:33:44 INFO Signed narinfos id=15 count=14386lb # [ 64.014118] niks3-server[1032]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4387lb # [ 64.022248] niks3-server[1032]: 2026/09/20 09:33:44 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4388worker2 # [ 64.035556] nix-grpc-daemon[846]: time=2026-09-20T09:33:43.658Z level=INFO msg="Upload complete. (493ms)"4389lb # [ 64.026997] niks3-server[1032]: 2026/09/20 09:33:44 INFO Completed upload id=154390lb # [ 64.029942] niks3-server[1032]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4391worker2 # [ 64.044747] nix-grpc-daemon[778]: ts=2026-09-20T09:33:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=0 paths=1 nar_bytes_in=7524392worker2 # [ 64.055181] nix-grpc-daemon[778]: ts=2026-09-20T09:33:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500504393worker2 # [ 64.064449] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4394worker2 # [ 64.067175] nix-daemon[836]: reaped child process 1100, status = succeeded4395worker2 # [ 64.079889] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4396worker2 # [ 64.925166] nix-daemon[836]: reaped child process 1114, status = succeeded4397worker2 # [ 65.106855] nix-daemon[836]: accepted connection from pid 1129, user nix-grpc-daemon (trusted)4398worker2 # [ 65.125346] nix-daemon[836]: reaped child process 1132, status = succeeded4399lb # [ 65.129709] niks3-server[1032]: 2026/09/20 09:33:45 INFO Received uploads request method=POST path=/api/pending_closures4400worker2 # [ 65.148470] nix-grpc-daemon[846]: time=2026-09-20T09:33:44.771Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4401worker2 # [ 65.149963] nix-grpc-daemon[846]: time=2026-09-20T09:33:44.771Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4402lb # [ 65.171947] niks3-server[1032]: 2026/09/20 09:33:45 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4403lb # [ 65.185700] niks3-server[1032]: 2026/09/20 09:33:45 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4404lb # [ 65.195656] niks3-server[1032]: 2026/09/20 09:33:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4405worker2 # [ 65.211704] nix-grpc-daemon[846]: time=2026-09-20T09:33:44.834Z level=INFO msg="Uploading 1 narinfos"4406lb # [ 65.202046] niks3-server[1032]: 2026/09/20 09:33:45 INFO Signed narinfos id=16 count=14407lb # [ 65.208483] niks3-server[1032]: 2026/09/20 09:33:45 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4408lb # [ 65.217951] niks3-server[1032]: 2026/09/20 09:33:45 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4409lb # [ 65.226065] niks3-server[1032]: 2026/09/20 09:33:45 INFO Completed upload id=164410worker2 # [ 65.234801] nix-grpc-daemon[846]: time=2026-09-20T09:33:44.858Z level=INFO msg="Upload complete. (345ms)"4411lb # [ 65.229108] niks3-server[1032]: 2026/09/20 09:33:45 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4412worker1 # [ 65.249771] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:492384413worker2 # [ 65.249125] nix-grpc-daemon[778]: ts=2026-09-20T09:33:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14414worker2 # [ 65.264804] nix-daemon[836]: reaped child process 1112, status = succeeded4415worker1 # [ 65.263651] nix-grpc-daemon[774]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4416worker1 # [ 65.306055] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:492384417worker1 # [ 65.311454] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_out=2324418client # [ 65.461887] nix-daemon[943]: reaped child process 945, status = succeeded4419client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.73 seconds)4420client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4421client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4422client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4423client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4424client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4425client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4426(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.86 seconds)4427subtest: an input only one worker has still reaches the builder4428client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4429client # this derivation will be built:4430client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4431client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4432client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.44 seconds)4433client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4434client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds)4435worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4436worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.26 seconds)4437worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4438worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4439client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24440client # [ 66.764765] nix-daemon[943]: accepted connection from pid 1026, user root (trusted)4441client # this derivation will be built:4442client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4443worker2 # [ 66.944564] nix-grpc-daemon[778]: ts=2026-09-20T09:33:46Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:500504444client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4445worker2 # [ 66.952339] nix-grpc-daemon[778]: ts=2026-09-20T09:33:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500504446client # copying 1 paths...4447client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'...4448worker1 # [ 66.963402] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:492384449worker1 # [ 66.980376] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4450worker1 # [ 67.188402] nix-daemon[836]: accepted connection from pid 978, user nix-grpc-daemon (trusted)4451worker1 # [ 67.205869] nix-daemon[836]: reaped child process 981, status = succeeded4452lb # [ 67.211815] niks3-server[1032]: 2026/09/20 09:33:47 INFO Received uploads request method=POST path=/api/pending_closures4453worker1 # [ 67.229256] nix-grpc-daemon[890]: time=2026-09-20T09:33:46.847Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4454worker1 # [ 67.231055] nix-grpc-daemon[890]: time=2026-09-20T09:33:46.847Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4455lb # [ 67.238854] niks3-server[1032]: 2026/09/20 09:33:47 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4456lb # [ 67.254067] niks3-server[1032]: 2026/09/20 09:33:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4457worker1 # [ 67.268136] nix-grpc-daemon[890]: time=2026-09-20T09:33:46.886Z level=INFO msg="Uploading 1 narinfos"4458lb # [ 67.267005] niks3-server[1032]: 2026/09/20 09:33:47 INFO Signed narinfos id=17 count=14459lb # [ 67.272472] niks3-server[1032]: 2026/09/20 09:33:47 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4460lb # [ 67.281019] niks3-server[1032]: 2026/09/20 09:33:47 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4461worker1 # [ 67.288319] nix-grpc-daemon[890]: time=2026-09-20T09:33:46.907Z level=INFO msg="Upload complete. (293ms)"4462lb # [ 67.285534] niks3-server[1032]: 2026/09/20 09:33:47 INFO Completed upload id=174463lb # [ 67.288520] niks3-server[1032]: 2026/09/20 09:33:47 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4464worker1 # [ 67.300606] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_in=1204465worker1 # [ 67.320304] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04466worker1 # [ 67.327213] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14467worker1 # [ 67.332357] nix-daemon[836]: reaped child process 976, status = succeeded4468worker1 # [ 67.364311] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492384469worker1 # [ 67.381072] nix-grpc-daemon[774]: ts=2026-09-20T09:33:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492384470client # copying 2 paths to 'lb:50051'...4471client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4472worker1 # [ 67.401182] nix-grpc-daemon[774]: ts=2026-09-20T09:33:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:492384473client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4474worker1 # [ 67.412288] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4475worker1 # [ 67.620394] nix-daemon[836]: accepted connection from pid 987, user nix-grpc-daemon (trusted)4476worker1 # [ 67.639175] nix-daemon[836]: reaped child process 990, status = succeeded4477worker1 # [ 67.810410] nix-daemon[836]: accepted connection from pid 992, user nix-grpc-daemon (trusted)4478worker1 # [ 67.827455] nix-daemon[836]: reaped child process 995, status = succeeded4479lb # [ 67.832514] niks3-server[1032]: 2026/09/20 09:33:48 INFO Received uploads request method=POST path=/api/pending_closures4480lb # [ 67.842548] niks3-server[1032]: 2026/09/20 09:33:48 INFO Received uploads request method=POST path=/api/pending_closures4481worker1 # [ 67.859555] nix-grpc-daemon[890]: time=2026-09-20T09:33:47.478Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4482worker1 # [ 67.861247] nix-grpc-daemon[890]: time=2026-09-20T09:33:47.478Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4483worker1 # [ 67.862991] nix-grpc-daemon[890]: time=2026-09-20T09:33:47.478Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4484lb # [ 67.879516] niks3-server[1032]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4485lb # [ 67.892236] niks3-server[1032]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4486lb # [ 67.904338] niks3-server[1032]: 2026/09/20 09:33:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4487worker1 # [ 67.919054] nix-grpc-daemon[890]: time=2026-09-20T09:33:47.537Z level=INFO msg="Uploading 3 narinfos"4488lb # [ 67.913820] niks3-server[1032]: 2026/09/20 09:33:48 INFO Signed narinfos id=19 count=24489lb # [ 67.915934] niks3-server[1032]: 2026/09/20 09:33:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4490lb # [ 67.926213] niks3-server[1032]: 2026/09/20 09:33:48 INFO Signed narinfos id=18 count=14491lb # [ 67.931430] niks3-server[1032]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4492lb # [ 67.938735] niks3-server[1032]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4493lb # [ 67.946418] niks3-server[1032]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4494lb # [ 67.954604] niks3-server[1032]: 2026/09/20 09:33:48 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4495lb # [ 67.961702] niks3-server[1032]: 2026/09/20 09:33:48 INFO Completed upload id=194496lb # [ 67.964090] niks3-server[1032]: 2026/09/20 09:33:48 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4497lb # [ 67.966559] niks3-server[1032]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4498lb # [ 67.969328] niks3-server[1032]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4499lb # [ 67.971532] niks3-server[1032]: 2026/09/20 09:33:48 INFO Completed upload id=184500worker1 # [ 67.977135] nix-grpc-daemon[890]: time=2026-09-20T09:33:47.596Z level=INFO msg="Upload complete. (543ms)"4501worker1 # [ 67.989325] nix-grpc-daemon[774]: ts=2026-09-20T09:33:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=2 nar_bytes_in=9844502worker1 # [ 68.004603] nix-grpc-daemon[774]: ts=2026-09-20T09:33:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492384503worker1 # [ 68.018834] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4504worker1 # [ 68.027796] nix-daemon[836]: reaped child process 985, status = succeeded4505client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4506client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4507worker1 # [ 68.036348] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4508worker1 # [ 69.286984] nix-daemon[836]: reaped child process 999, status = succeeded4509worker1 # [ 69.470089] nix-daemon[836]: accepted connection from pid 1014, user nix-grpc-daemon (trusted)4510worker1 # [ 69.488108] nix-daemon[836]: reaped child process 1017, status = succeeded4511lb # [ 69.493445] niks3-server[1032]: 2026/09/20 09:33:50 INFO Received uploads request method=POST path=/api/pending_closures4512worker1 # [ 69.511381] nix-grpc-daemon[890]: time=2026-09-20T09:33:49.129Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4513lb # [ 69.523691] niks3-server[1032]: 2026/09/20 09:33:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4514worker1 # [ 69.541313] nix-grpc-daemon[890]: time=2026-09-20T09:33:49.160Z level=INFO msg="Uploading 1 narinfos"4515lb # [ 69.536845] niks3-server[1032]: 2026/09/20 09:33:50 INFO Signed narinfos id=20 count=14516lb # [ 69.547669] niks3-server[1032]: 2026/09/20 09:33:50 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4517lb # [ 69.556516] niks3-server[1032]: 2026/09/20 09:33:50 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4518lb # [ 69.567486] niks3-server[1032]: 2026/09/20 09:33:50 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4519lb # [ 69.576457] niks3-server[1032]: 2026/09/20 09:33:50 INFO Completed upload id=204520worker1 # [ 69.583343] nix-grpc-daemon[890]: time=2026-09-20T09:33:49.202Z level=INFO msg="Upload complete. (333ms)"4521lb # [ 69.579607] niks3-server[1032]: 2026/09/20 09:33:50 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4522worker1 # [ 69.597169] nix-grpc-daemon[774]: ts=2026-09-20T09:33:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14523worker1 # [ 69.612112] nix-daemon[836]: reaped child process 997, status = succeeded4524client # copying 1 paths...4525worker1 # [ 69.641290] nix-grpc-daemon[774]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:492384526client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4527worker1 # [ 69.671612] nix-grpc-daemon[774]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:492384528worker1 # [ 69.676945] nix-grpc-daemon[774]: ts=2026-09-20T09:33:49Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_out=1204529client # [ 69.825260] nix-daemon[943]: reaped child process 1029, status = succeeded4530client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.30 seconds)4531client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24532client # [ 70.043847] nix-daemon[943]: accepted connection from pid 1048, user root (trusted)4533client # this derivation will be built:4534client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4535worker2 # [ 70.223327] nix-grpc-daemon[778]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:500504536client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4537worker1 # [ 70.224907] nix-grpc-daemon[774]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492384538worker1 # [ 70.235226] nix-grpc-daemon[890]: time=2026-09-20T09:33:49.854Z level=INFO msg="All 1 paths already cached"4539worker1 # [ 70.254267] nix-grpc-daemon[774]: ts=2026-09-20T09:33:49Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04540worker1 # [ 70.261218] nix-grpc-daemon[774]: ts=2026-09-20T09:33:49Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14541worker2 # [ 70.266183] nix-grpc-daemon[778]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500504542worker2 # [ 70.282429] nix-grpc-daemon[778]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500504543client # copying 1 paths to 'lb:50051'...4544client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4545worker2 # [ 70.309881] nix-grpc-daemon[778]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500504546worker2 # [ 70.325418] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4547worker2 # [ 70.349273] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 1/5)4548worker2 # [ 70.411991] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 2/5)4549worker2 # [ 70.511712] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 127 ms (attempt 3/5)4550worker2 # [ 70.646500] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 513 ms (attempt 4/5)4551lb # [ 70.917840] envoy[913]: conn peer=[2001:db8:1::1]:34122 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3874 tx=1878 ms=21524552lb # [ 70.922851] envoy[913]: conn peer=[2001:db8:1::1]:34126 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=984553lb # [ 70.927986] envoy[913]: conn peer=[2001:db8:1::1]:34144 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=634554lb # [ 70.932659] envoy[913]: conn peer=[2001:db8:1::1]:34142 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4330 tx=2242 ms=19784555lb # [ 70.937384] envoy[913]: conn peer=[2001:db8:1::1]:34148 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4267 tx=1769 ms=27874556lb # [ 70.942157] envoy[913]: conn peer=[2001:db8:1::1]:34162 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=634557worker2 # [ 71.167704] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4558worker2 # [ 71.177558] nix-grpc-daemon[778]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4559worker2 # [ 71.417703] nix-daemon[836]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)4560worker2 # [ 71.437203] nix-daemon[836]: reaped child process 1146, status = succeeded4561worker2 # [ 71.613171] nix-daemon[836]: accepted connection from pid 1148, user nix-grpc-daemon (trusted)4562worker2 # [ 71.630505] nix-daemon[836]: reaped child process 1151, status = succeeded4563lb # [ 71.634213] niks3-server[1032]: 2026/09/20 09:33:52 INFO Received uploads request method=POST path=/api/pending_closures4564worker2 # [ 71.654008] nix-grpc-daemon[846]: time=2026-09-20T09:33:51.276Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4565worker2 # [ 71.655867] nix-grpc-daemon[846]: time=2026-09-20T09:33:51.276Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4566lb # [ 71.671830] niks3-server[1032]: 2026/09/20 09:33:52 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4567worker2 # [ 71.691798] nix-grpc-daemon[846]: time=2026-09-20T09:33:51.314Z level=INFO msg="Uploading 1 narinfos"4568lb # [ 71.687799] niks3-server[1032]: 2026/09/20 09:33:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4569worker2 # [ 71.709788] nix-grpc-daemon[846]: time=2026-09-20T09:33:51.333Z level=INFO msg="Upload complete. (502ms)"4570lb # [ 71.697033] niks3-server[1032]: 2026/09/20 09:33:52 INFO Signed narinfos id=21 count=14571lb # [ 71.706799] niks3-server[1032]: 2026/09/20 09:33:52 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4572worker2 # [ 71.716593] nix-grpc-daemon[778]: ts=2026-09-20T09:33:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 paths=1 nar_bytes_in=5684573lb # [ 71.712549] niks3-server[1032]: 2026/09/20 09:33:52 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4574lb # [ 71.716907] niks3-server[1032]: 2026/09/20 09:33:52 INFO Completed upload id=214575worker2 # [ 71.725995] nix-grpc-daemon[778]: ts=2026-09-20T09:33:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500504576lb # [ 71.719387] niks3-server[1032]: 2026/09/20 09:33:52 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4577worker2 # [ 71.735809] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4578worker2 # [ 71.740553] nix-daemon[836]: reaped child process 1137, status = succeeded4579worker2 # [ 71.755941] nix-grpc-daemon[778]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4580worker2 # [ 71.770389] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4581client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4582client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4583worker2 # [ 72.994764] nix-daemon[836]: reaped child process 1156, status = succeeded4584worker2 # [ 73.153507] nix-daemon[836]: accepted connection from pid 1171, user nix-grpc-daemon (trusted)4585worker2 # [ 73.172964] nix-daemon[836]: reaped child process 1174, status = succeeded4586lb # [ 73.178791] niks3-server[1032]: 2026/09/20 09:33:53 INFO Received uploads request method=POST path=/api/pending_closures4587worker2 # [ 73.198006] nix-grpc-daemon[846]: time=2026-09-20T09:33:52.820Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4588lb # [ 73.206034] niks3-server[1032]: 2026/09/20 09:33:53 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4589lb # [ 73.216802] niks3-server[1032]: 2026/09/20 09:33:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4590worker2 # [ 73.232275] nix-grpc-daemon[846]: time=2026-09-20T09:33:52.855Z level=INFO msg="Uploading 1 narinfos"4591lb # [ 73.225657] niks3-server[1032]: 2026/09/20 09:33:53 INFO Signed narinfos id=22 count=14592lb # [ 73.234948] niks3-server[1032]: 2026/09/20 09:33:53 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4593lb # [ 73.250539] niks3-server[1032]: 2026/09/20 09:33:53 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4594worker2 # [ 73.264728] nix-grpc-daemon[846]: time=2026-09-20T09:33:52.888Z level=INFO msg="Upload complete. (282ms)"4595lb # [ 73.256067] niks3-server[1032]: 2026/09/20 09:33:53 INFO Completed upload id=224596lb # [ 73.258855] niks3-server[1032]: 2026/09/20 09:33:53 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4597worker2 # [ 73.272813] nix-grpc-daemon[778]: ts=2026-09-20T09:33:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14598worker2 # [ 73.288298] nix-daemon[836]: reaped child process 1153, status = succeeded4599client # copying 1 paths...4600worker1 # [ 73.323104] nix-grpc-daemon[774]: ts=2026-09-20T09:33:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:492384601worker1 # [ 73.331998] nix-grpc-daemon[774]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4602client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4603worker1 # [ 73.379541] nix-grpc-daemon[774]: ts=2026-09-20T09:33:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:492384604worker1 # [ 73.385221] nix-grpc-daemon[774]: ts=2026-09-20T09:33:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_out=1204605client # [ 73.529448] nix-daemon[943]: reaped child process 1051, status = succeeded4606client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.71 seconds)4607client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24608client # [ 73.758925] nix-daemon[943]: accepted connection from pid 1070, user root (trusted)4609client # this derivation will be built:4610client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4611worker1 # [ 73.934771] nix-grpc-daemon[774]: ts=2026-09-20T09:33:53Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:492384612client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4613worker1 # [ 73.942972] nix-grpc-daemon[774]: ts=2026-09-20T09:33:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492384614worker1 # [ 73.951250] nix-grpc-daemon[890]: time=2026-09-20T09:33:53.568Z level=INFO msg="All 1 paths already cached"4615worker1 # [ 73.964170] nix-grpc-daemon[774]: ts=2026-09-20T09:33:53Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04616worker1 # [ 73.972146] nix-grpc-daemon[774]: ts=2026-09-20T09:33:53Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14617worker1 # [ 73.981329] nix-grpc-daemon[774]: ts=2026-09-20T09:33:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492384618worker1 # [ 73.992713] nix-grpc-daemon[774]: ts=2026-09-20T09:33:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:492384619client # copying 1 paths to 'lb:50051'...4620worker1 # [ 74.008129] nix-grpc-daemon[890]: time=2026-09-20T09:33:53.626Z level=INFO msg="All 1 paths already cached"4621client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4622worker1 # [ 74.014124] nix-grpc-daemon[774]: ts=2026-09-20T09:33:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:492384623worker1 # [ 74.029367] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4624worker1 # [ 74.225377] nix-daemon[836]: accepted connection from pid 1026, user nix-grpc-daemon (trusted)4625worker1 # [ 74.245473] nix-daemon[836]: reaped child process 1029, status = succeeded4626worker1 # [ 74.431005] nix-daemon[836]: accepted connection from pid 1031, user nix-grpc-daemon (trusted)4627worker1 # [ 74.449623] nix-daemon[836]: reaped child process 1034, status = succeeded4628lb # [ 74.456808] niks3-server[1032]: 2026/09/20 09:33:55 INFO Received uploads request method=POST path=/api/pending_closures4629worker1 # [ 74.475409] nix-grpc-daemon[890]: time=2026-09-20T09:33:54.094Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4630worker1 # [ 74.477177] nix-grpc-daemon[890]: time=2026-09-20T09:33:54.094Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4631lb # [ 74.491886] niks3-server[1032]: 2026/09/20 09:33:55 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4632lb # [ 74.506243] niks3-server[1032]: 2026/09/20 09:33:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4633worker1 # [ 74.520589] nix-grpc-daemon[890]: time=2026-09-20T09:33:54.139Z level=INFO msg="Uploading 1 narinfos"4634lb # [ 74.518682] niks3-server[1032]: 2026/09/20 09:33:55 INFO Signed narinfos id=23 count=14635lb # [ 74.524393] niks3-server[1032]: 2026/09/20 09:33:55 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4636lb # [ 74.531300] niks3-server[1032]: 2026/09/20 09:33:55 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4637lb # [ 74.537216] niks3-server[1032]: 2026/09/20 09:33:55 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4638lb # [ 74.542062] niks3-server[1032]: 2026/09/20 09:33:55 INFO Completed upload id=234639worker1 # [ 74.550052] nix-grpc-daemon[890]: time=2026-09-20T09:33:54.169Z level=INFO msg="Upload complete. (505ms)"4640worker1 # [ 74.560261] nix-grpc-daemon[774]: ts=2026-09-20T09:33:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_in=5684641worker1 # [ 74.575434] nix-grpc-daemon[774]: ts=2026-09-20T09:33:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:492384642worker1 # [ 74.581865] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4643worker1 # [ 74.587027] nix-daemon[836]: reaped child process 1024, status = succeeded4644client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4645worker1 # [ 74.598417] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4646client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4647worker1 # [ 75.622411] nix-daemon[836]: reaped child process 1038, status = succeeded4648worker1 # [ 75.780955] nix-daemon[836]: accepted connection from pid 1053, user nix-grpc-daemon (trusted)4649worker1 # [ 75.800276] nix-daemon[836]: reaped child process 1056, status = succeeded4650lb # [ 75.805879] niks3-server[1032]: 2026/09/20 09:33:56 INFO Received uploads request method=POST path=/api/pending_closures4651worker1 # [ 75.823436] nix-grpc-daemon[890]: time=2026-09-20T09:33:55.442Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4652lb # [ 75.838379] niks3-server[1032]: 2026/09/20 09:33:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4653worker1 # [ 75.854721] nix-grpc-daemon[890]: time=2026-09-20T09:33:55.473Z level=INFO msg="Uploading 1 narinfos"4654lb # [ 75.853126] niks3-server[1032]: 2026/09/20 09:33:56 INFO Signed narinfos id=24 count=14655lb # [ 75.861608] niks3-server[1032]: 2026/09/20 09:33:56 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4656lb # [ 75.872920] niks3-server[1032]: 2026/09/20 09:33:56 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4657lb # [ 75.882970] niks3-server[1032]: 2026/09/20 09:33:56 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4658lb # [ 75.889324] niks3-server[1032]: 2026/09/20 09:33:56 INFO Completed upload id=244659worker1 # [ 75.896773] nix-grpc-daemon[890]: time=2026-09-20T09:33:55.515Z level=INFO msg="Upload complete. (286ms)"4660lb # [ 75.890970] niks3-server[1032]: 2026/09/20 09:33:56 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4661worker1 # [ 75.904996] nix-grpc-daemon[774]: ts=2026-09-20T09:33:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14662worker1 # [ 75.920395] nix-daemon[836]: reaped child process 1036, status = succeeded4663client # copying 1 paths...4664worker1 # [ 75.955605] nix-grpc-daemon[774]: ts=2026-09-20T09:33:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:492384665client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4666worker1 # [ 75.990939] nix-grpc-daemon[774]: ts=2026-09-20T09:33:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:492384667worker1 # [ 75.997710] nix-grpc-daemon[774]: ts=2026-09-20T09:33:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_out=1204668client # [ 76.146095] nix-daemon[943]: reaped child process 1073, status = succeeded4669client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.61 seconds)4670(finished: subtest: an input only one worker has still reaches the builder, in 10.55 seconds)4671subtest: upload whose reference the worker lacks is completed from the cache4672client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4673client # this derivation will be built:4674client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4675client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4676client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.45 seconds)4677client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4678client # this derivation will be built:4679client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4680client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4681client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.43 seconds)4682client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4683client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds)4684worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4685worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds)4686worker2 # [ 77.538944] systemd[1]: Stopping Nix worker-protocol over gRPC...4687worker2 # [ 78.291482] nix-grpc-daemon[778]: ts=2026-09-20T09:33:57Z level=info event=signal_exit4688worker1 # [ 79.552807] nix-grpc-daemon[774]: ts=2026-09-20T09:33:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:492364689worker2 # [ 79.555569] nix-grpc-daemon[778]: ts=2026-09-20T09:33:59Z level=info event=scheduler_restarting4690worker1 # [ 79.557698] nix-grpc-daemon[774]: ts=2026-09-20T09:33:59Z level=info event=worker_gone addr=192.168.1.4:500514691worker2 # [ 79.591602] nix-grpc-daemon[778]: ts=2026-09-20T09:33:59Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4692worker2 # [ 79.614291] nix-daemon[836]: reaped child process 838, status = succeeded4693worker2 # [ 79.787278] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4694worker2 # [ 79.797055] systemd[1]: Stopped Nix worker-protocol over gRPC.4695worker2 # [ 79.799560] systemd[1]: nix-grpc-daemon.service: Consumed 3.642s CPU time over 58.847s wall clock time, 62.1M memory peak, 84.2K incoming IP traffic, 152.2K outgoing IP traffic.4696worker2 # [ 79.817598] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4697worker2 # [ 79.821262] systemd[1]: Closed Nix worker-protocol over gRPC.4698worker2 # [ 79.822993] systemd[1]: nix-grpc-daemon.socket: Consumed 562us CPU time over 1min 9.015s wall clock time, 256K memory peak, 73.6K incoming IP traffic, 60.1K outgoing IP traffic.4699lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4700lb: must succeed: curl -sf localhost:9901/clusters4701lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4702lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4703client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24704worker1 # [ 80.148666] nix-grpc-daemon[774]: ts=2026-09-20T09:33:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:492384705worker1 # [ 80.157609] nix-grpc-daemon[774]: ts=2026-09-20T09:33:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:492384706client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4707client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.28 seconds)4708worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4709worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.03 seconds)4710worker2 # [ 80.307117] systemd[1]: Listening on Nix worker-protocol over gRPC.4711worker1 # [ 80.390068] systemd[1]: Stopping Nix worker-protocol over gRPC...4712worker2 # [ 80.446410] systemd[1]: Starting Nix worker-protocol over gRPC...4713worker2 # [ 80.677827] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:00Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4714worker2 # [ 80.680664] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:00Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14715worker2 # [ 80.689473] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:00Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4716worker2 # [ 80.691300] systemd[1]: Started Nix worker-protocol over gRPC.4717worker2 # [ 80.734990] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:500514718worker1 # [ 80.737396] nix-grpc-daemon[774]: ts=2026-09-20T09:34:00Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04719lb # [ 80.920652] envoy[913]: conn peer=[2001:db8:1::1]:34164 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3723 tx=1919 ms=32174720lb # [ 80.925839] envoy[913]: conn peer=[2001:db8:1::1]:54468 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=624721lb # [ 80.931273] envoy[913]: conn peer=[2001:db8:1::1]:54482 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3711 tx=1803 ms=21164722lb # [ 80.936456] envoy[913]: conn peer=[2001:db8:1::1]:54494 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=634723lb # [ 80.941235] envoy[913]: conn peer=[2001:db8:1::4]:56084 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=8374 tx=2478 ms=582504724lb # [ 80.946311] envoy[913]: conn peer=[2001:db8:1::1]:54498 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=294725worker1 # [ 81.288324] nix-grpc-daemon[774]: ts=2026-09-20T09:34:00Z level=info event=signal_exit4726worker1 # [ 81.547665] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=scheduler_yield4727worker2 # [ 81.553914] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:01Z level=info event=scheduler_restarting addr=lb:500514728lb # [ 81.545833] niks3-server[1032]: 2026/09/20 09:34:02 INFO lead: released remote=192.168.1.3:351304729worker1 # [ 81.555362] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:492364730worker1 # [ 81.560473] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=worker_gone addr=192.168.1.4:500514731worker1 # [ 81.566610] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=scheduler_restarting addr=lb:500514732worker1 # [ 81.573746] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:492364733worker1 # [ 81.578635] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=worker_gone addr=192.168.1.3:500514734worker2 # [ 81.756857] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:500514735worker2 # [ 81.762404] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4736worker1 # [ 81.770190] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:500514737worker1 # [ 81.774612] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4738worker2 # [ 81.964170] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:500514739worker2 # [ 81.970151] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4740worker1 # [ 81.970700] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:500514741worker1 # [ 81.976485] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4742worker2 # [ 82.171132] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:500514743worker2 # [ 82.176892] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4744worker1 # [ 82.177320] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:500514745worker1 # [ 82.182697] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4746worker2 # [ 82.377897] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_connected addr=lb:500514747worker2 # [ 82.383428] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4748worker1 # [ 82.383767] nix-grpc-daemon[774]: ts=2026-09-20T09:34:02Z level=info event=scheduler_connected addr=lb:500514749worker1 # [ 82.389744] nix-grpc-daemon[774]: ts=2026-09-20T09:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4750worker1 # [ 82.554244] nix-grpc-daemon[774]: ts=2026-09-20T09:34:02Z level=info event=scheduler_restarting4751worker2 # [ 82.584745] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_connected addr=lb:500514752worker2 # [ 82.590223] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4753worker1 # [ 82.615871] nix-daemon[836]: reaped child process 839, status = succeeded4754worker1 # [ 82.618448] nix-grpc-daemon[774]: ts=2026-09-20T09:34:02Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4755worker2 # [ 82.793117] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_connected addr=lb:500514756worker2 # [ 82.797578] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4757worker2 # [ 82.993861] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_connected addr=lb:500514758worker2 # [ 82.999439] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4759worker2 # [ 83.200401] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_connected addr=lb:500514760worker2 # [ 83.205894] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4761worker2 # [ 83.407233] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_connected addr=lb:500514762worker1 # [ 83.410511] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4763worker2 # [ 83.413120] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4764worker1 # [ 83.415451] nix-grpc-daemon[774]: E0000 00:00:1789896843.027871 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4765worker1 # [ 83.423224] nix-grpc-daemon[774]: E0000 00:00:1789896843.041732 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4766worker2 # [ 83.614277] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_connected addr=lb:500514767worker2 # [ 83.619952] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4768worker1 # [ 83.705154] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4769worker1 # [ 83.714105] systemd[1]: Stopped Nix worker-protocol over gRPC.4770worker1 # [ 83.718687] systemd[1]: nix-grpc-daemon.service: Consumed 2.033s CPU time over 1min 2.764s wall clock time, 54.7M memory peak, 58.3K incoming IP traffic, 103.4K outgoing IP traffic.4771worker1 # [ 83.737822] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4772worker1 # [ 83.741828] systemd[1]: Closed Nix worker-protocol over gRPC.4773worker1 # [ 83.745561] systemd[1]: nix-grpc-daemon.socket: Consumed 560us CPU time over 1min 12.354s wall clock time, 256K memory peak, 78.2K incoming IP traffic, 67.5K outgoing IP traffic.4774lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4775lb: must succeed: curl -sf localhost:9901/clusters4776worker2 # [ 83.823064] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_connected addr=lb:500514777worker2 # [ 83.827537] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4778lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4779lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.10 seconds)4780client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24781worker2 # [ 84.023939] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_connected addr=lb:500514782worker2 # [ 84.029471] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4783worker2 # [ 84.107329] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410824784worker2 # [ 84.123083] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)4785worker2 # [ 84.152993] nix-grpc-daemon[1195]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 1/5)4786worker2 # [ 84.230396] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_connected addr=lb:500514787worker2 # [ 84.235586] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4788worker2 # [ 84.243590] nix-grpc-daemon[1195]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 120 ms (attempt 2/5)4789worker2 # [ 84.371383] nix-grpc-daemon[1195]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 3/5)4790worker2 # [ 84.434971] nix-grpc-daemon[1195]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 4/5)4791worker2 # [ 84.443698] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_connected addr=lb:500514792worker2 # [ 84.449166] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4793worker2 # [ 84.480933] nix-grpc-daemon[1195]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4794client # copying 2 paths...4795client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4796worker2 # [ 84.507793] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:410824797client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4798worker2 # [ 84.530765] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)4799worker2 # [ 84.561903] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=niks3_push_started pid=12514800worker2 # [ 84.649869] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_connected addr=lb:500514801worker2 # [ 84.655066] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4802worker2 # [ 84.854921] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_connected addr=lb:500514803worker2 # [ 84.857534] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4804worker2 # [ 84.962978] nix-daemon[836]: accepted connection from pid 1264, user nix-grpc-daemon (trusted)4805worker2 # [ 84.983515] nix-daemon[836]: reaped child process 1267, status = succeeded4806lb # [ 84.990145] niks3-server[1032]: 2026/09/20 09:34:05 INFO Received uploads request method=POST path=/api/pending_closures4807lb # [ 84.998179] niks3-server[1032]: 2026/09/20 09:34:05 INFO Received uploads request method=POST path=/api/pending_closures4808worker2 # [ 85.018538] nix-grpc-daemon[1251]: time=2026-09-20T09:34:04.639Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4809worker2 # [ 85.020992] nix-grpc-daemon[1251]: time=2026-09-20T09:34:04.639Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4810worker2 # [ 85.022881] nix-grpc-daemon[1251]: time=2026-09-20T09:34:04.639Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4811worker2 # [ 85.058090] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_connected addr=lb:500514812lb # [ 85.045787] niks3-server[1032]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4813worker2 # [ 85.063962] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4814lb # [ 85.069694] niks3-server[1032]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4815lb # [ 85.081715] niks3-server[1032]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4816lb # [ 85.090282] niks3-server[1032]: 2026/09/20 09:34:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4817lb # [ 85.097102] niks3-server[1032]: 2026/09/20 09:34:05 INFO Signed narinfos id=25 count=14818worker2 # [ 85.108167] nix-grpc-daemon[1251]: time=2026-09-20T09:34:04.729Z level=INFO msg="Uploading 3 narinfos"4819lb # [ 85.103071] niks3-server[1032]: 2026/09/20 09:34:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4820lb # [ 85.111778] niks3-server[1032]: 2026/09/20 09:34:05 INFO Signed narinfos id=26 count=24821lb # [ 85.116443] niks3-server[1032]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4822lb # [ 85.134980] niks3-server[1032]: 2026/09/20 09:34:05 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4823lb # [ 85.142927] niks3-server[1032]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4824lb # [ 85.146692] niks3-server[1032]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4825lb # [ 85.151837] niks3-server[1032]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4826lb # [ 85.165300] niks3-server[1032]: 2026/09/20 09:34:05 INFO Completed upload id=254827lb # [ 85.168212] niks3-server[1032]: 2026/09/20 09:34:05 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4828lb # [ 85.171323] niks3-server[1032]: 2026/09/20 09:34:05 INFO Completed upload id=264829worker2 # [ 85.181116] nix-grpc-daemon[1251]: time=2026-09-20T09:34:04.804Z level=INFO msg="Upload complete. (392ms)"4830worker2 # [ 85.192349] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=0 paths=2 nar_bytes_in=3124831worker2 # [ 85.210128] nix-daemon[836]: reaped child process 1249, status = succeeded4832client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.38 seconds)4833worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4834worker2 # [ 85.265482] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_connected addr=lb:500514835worker2 # [ 85.274093] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4836worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.05 seconds)4837worker1 # [ 85.372956] systemd[1]: Listening on Nix worker-protocol over gRPC.4838worker1 # [ 85.379592] systemd[1]: Starting Nix worker-protocol over gRPC...4839worker2 # [ 85.472492] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:05Z level=info event=scheduler_connected addr=lb:500514840worker2 # [ 85.477816] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4841worker1 # [ 85.577506] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4842worker1 # [ 85.580956] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14843worker1 # [ 85.590777] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4844lb # [ 85.595180] niks3-server[1032]: 2026/09/20 09:34:06 INFO lead: acquired remote=192.168.1.3:333204845worker1 # [ 85.607632] systemd[1]: Started Nix worker-protocol over gRPC.4846worker1 # [ 85.617934] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=scheduler_take_over4847lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4848lb: must succeed: curl -sf localhost:9901/clusters4849worker1 # [ 85.640483] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=scheduler_connected addr=lb:500514850worker1 # [ 85.642325] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4851worker2 # [ 85.678534] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:05Z level=info event=scheduler_connected addr=lb:500514852worker2 # [ 85.684066] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4853lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4854lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds)4855(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.60 seconds)4856subtest: scheduler down: the other node takes the lock and keeps it4857lb: must succeed: curl -sf localhost:9901/clusters4858lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4859lb: must succeed: curl -sf localhost:9901/clusters4860lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4861lb: must succeed: curl -sf localhost:9901/clusters4862worker1 # [ 85.843510] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=scheduler_connected addr=lb:500514863worker1 # [ 85.853322] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04864lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4865lb: must succeed: curl -sf localhost:9901/clusters4866worker2 # [ 85.886167] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:05Z level=info event=scheduler_connected addr=lb:500514867worker1 # [ 85.884935] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04868lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4869worker1 # [ 85.999522] systemd[1]: Stopping Nix worker-protocol over gRPC...4870worker1 # [ 86.595843] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=signal_exit4871worker1 # [ 86.801084] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=scheduler_yield4872worker2 # [ 86.807168] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:06Z level=info event=scheduler_restarting addr=lb:500514873worker1 # [ 86.807462] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:397204874lb # [ 86.805480] niks3-server[1032]: 2026/09/20 09:34:07 INFO lead: released remote=192.168.1.3:333204875worker1 # [ 86.813884] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=worker_gone addr=192.168.1.4:500514876worker1 # [ 86.818780] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=scheduler_restarting addr=lb:500514877worker1 # [ 86.822998] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:397204878worker1 # [ 86.827562] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=worker_gone addr=192.168.1.3:500514879worker1 # [ 87.008657] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=scheduler_connected addr=lb:500514880worker2 # [ 87.015056] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:06Z level=info event=scheduler_connected addr=lb:500514881worker1 # [ 87.013873] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4882worker2 # [ 87.019365] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4883worker2 # [ 87.215483] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:06Z level=info event=scheduler_connected addr=lb:500514884worker1 # [ 87.214771] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=scheduler_connected addr=lb:500514885worker2 # [ 87.221234] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4886worker1 # [ 87.220201] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4887worker2 # [ 87.422066] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_connected addr=lb:500514888worker1 # [ 87.420951] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:07Z level=info event=scheduler_connected addr=lb:500514889worker2 # [ 87.427587] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4890worker1 # [ 87.426254] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4891worker2 # [ 87.628687] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_connected addr=lb:500514892worker1 # [ 87.628914] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:07Z level=info event=scheduler_connected addr=lb:500514893worker2 # [ 87.634209] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4894worker1 # [ 87.634581] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4895worker1 # [ 87.806425] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:07Z level=info event=scheduler_restarting4896worker2 # [ 87.834887] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_connected addr=lb:500514897worker2 # [ 87.840631] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4898worker2 # [ 88.042688] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_connected addr=lb:500514899worker2 # [ 88.048121] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4900worker2 # [ 88.248988] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_connected addr=lb:500514901worker2 # [ 88.254384] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4902worker2 # [ 88.455176] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_connected addr=lb:500514903worker2 # [ 88.460820] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4904worker2 # [ 88.661805] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_connected addr=lb:500514905worker2 # [ 88.667487] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4906worker1 # [ 88.707251] nix-grpc-daemon[1079]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4907worker1 # [ 88.712227] nix-grpc-daemon[1079]: E0000 00:00:1789896848.325084 1122 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true4908worker1 # [ 88.719381] nix-grpc-daemon[1079]: E0000 00:00:1789896848.338110 1122 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4909worker2 # [ 88.868704] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_connected addr=lb:500514910worker2 # [ 88.874142] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4911worker2 # [ 89.077047] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_connected addr=lb:500514912worker2 # [ 89.081336] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4913worker2 # [ 89.277697] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_connected addr=lb:500514914worker2 # [ 89.283243] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4915worker2 # [ 89.484079] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_connected addr=lb:500514916worker2 # [ 89.489399] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4917worker1 # [ 89.629597] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4918worker1 # [ 89.635736] systemd[1]: Stopped Nix worker-protocol over gRPC.4919worker1 # [ 89.640585] systemd[1]: nix-grpc-daemon.service: Consumed 196ms CPU time over 4.246s wall clock time, 12.8M memory peak, 7.5K incoming IP traffic, 7.5K outgoing IP traffic.4920worker1 # [ 89.655313] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4921worker1 # [ 89.658570] systemd[1]: Closed Nix worker-protocol over gRPC.4922worker1 # [ 89.661944] systemd[1]: nix-grpc-daemon.socket: Consumed 933us CPU time over 4.292s wall clock time, 256K memory peak, 13.1K incoming IP traffic, 10.4K outgoing IP traffic.4923worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4924worker2 # [ 89.690375] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_connected addr=lb:500514925worker2 # [ 89.703859] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4926worker2 # [ 89.898830] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_connected addr=lb:500514927worker2 # [ 89.904373] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4928worker2 # [ 90.107068] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_connected addr=lb:500514929worker2 # [ 90.111297] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4930worker2 # [ 90.307648] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_connected addr=lb:500514931worker2 # [ 90.313018] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4932worker2 # [ 90.513466] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:10Z level=info event=scheduler_connected addr=lb:500514933worker2 # [ 90.516272] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4934lb # [ 90.694729] niks3-server[1032]: 2026/09/20 09:34:11 INFO lead: acquired remote=192.168.1.4:456644935worker2 # [ 90.704886] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:10Z level=info event=scheduler_take_over4936worker2 # [ 90.717240] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:10Z level=info event=scheduler_connected addr=lb:500514937worker2 # [ 90.722422] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4938worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.18 seconds)4939worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4940worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)4941worker2 # [ 90.923219] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:10Z level=info event=scheduler_connected addr=lb:500514942lb # [ 90.925269] envoy[913]: conn peer=[2001:db8:1::3]:42682 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=8314 tx=2265 ms=612844943lb # [ 90.933447] envoy[913]: conn peer=[2001:db8:1::1]:56690 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1006 tx=304 ms=11014944worker2 # [ 90.950158] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:10Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04945lb # [ 90.941023] envoy[913]: conn peer=[2001:db8:1::3]:58582 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1163 tx=400 ms=22104946worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4947worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)4948client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24949worker2 # [ 92.237197] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:410824950client # don't know how to build these paths:4951client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4952worker2 # [ 92.249160] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410824953worker2 # [ 92.276797] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:11Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04954worker2 # [ 92.283841] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:11Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=14955worker2 # [ 92.321616] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410824956worker2 # [ 92.337962] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410824957client # copying 1 paths to 'lb:50051'...4958client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4959worker2 # [ 92.354868] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:410824960worker2 # [ 92.371363] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)4961worker2 # [ 92.584419] nix-daemon[836]: accepted connection from pid 1298, user nix-grpc-daemon (trusted)4962worker2 # [ 92.603873] nix-daemon[836]: reaped child process 1301, status = succeeded4963worker2 # [ 92.782126] nix-daemon[836]: accepted connection from pid 1303, user nix-grpc-daemon (trusted)4964worker2 # [ 92.801023] nix-daemon[836]: reaped child process 1306, status = succeeded4965lb # [ 92.804871] niks3-server[1032]: 2026/09/20 09:34:13 INFO Received uploads request method=POST path=/api/pending_closures4966worker2 # [ 92.824826] nix-grpc-daemon[1251]: time=2026-09-20T09:34:12.447Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4967worker2 # [ 92.826468] nix-grpc-daemon[1251]: time=2026-09-20T09:34:12.447Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4968lb # [ 92.840892] niks3-server[1032]: 2026/09/20 09:34:13 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4969worker2 # [ 92.863722] nix-grpc-daemon[1251]: time=2026-09-20T09:34:12.486Z level=INFO msg="Uploading 1 narinfos"4970lb # [ 92.856428] niks3-server[1032]: 2026/09/20 09:34:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4971lb # [ 92.865572] niks3-server[1032]: 2026/09/20 09:34:13 INFO Signed narinfos id=27 count=14972worker2 # [ 92.882652] nix-grpc-daemon[1251]: time=2026-09-20T09:34:12.506Z level=INFO msg="Upload complete. (493ms)"4973lb # [ 92.873626] niks3-server[1032]: 2026/09/20 09:34:13 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4974lb # [ 92.879008] niks3-server[1032]: 2026/09/20 09:34:13 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4975lb # [ 92.883925] niks3-server[1032]: 2026/09/20 09:34:13 INFO Completed upload id=274976worker2 # [ 92.892223] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=0 paths=1 nar_bytes_in=5204977lb # [ 92.885875] niks3-server[1032]: 2026/09/20 09:34:13 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4978worker2 # [ 92.903038] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410824979worker2 # [ 92.910941] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)4980worker2 # [ 92.913130] nix-daemon[836]: reaped child process 1296, status = succeeded4981client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4982worker2 # [ 92.924902] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)4983client # farm-a> worker2: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4984client # farm-a> LOG-farm-a-on-standby4985worker2 # [ 94.371819] nix-daemon[836]: reaped child process 1310, status = succeeded4986worker2 # [ 94.555357] nix-daemon[836]: accepted connection from pid 1325, user nix-grpc-daemon (trusted)4987worker2 # [ 94.571961] nix-daemon[836]: reaped child process 1328, status = succeeded4988lb # [ 94.578588] niks3-server[1032]: 2026/09/20 09:34:15 INFO Received uploads request method=POST path=/api/pending_closures4989worker2 # [ 94.599315] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.220Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4990worker2 # [ 94.600988] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.220Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4991lb # [ 94.611978] niks3-server[1032]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4992lb # [ 94.626027] niks3-server[1032]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4993lb # [ 94.638223] niks3-server[1032]: 2026/09/20 09:34:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4994lb # [ 94.645082] niks3-server[1032]: 2026/09/20 09:34:15 INFO Signed narinfos id=28 count=14995worker2 # [ 94.654455] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.276Z level=INFO msg="Uploading 1 narinfos"4996lb # [ 94.650187] niks3-server[1032]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4997lb # [ 94.661144] niks3-server[1032]: 2026/09/20 09:34:15 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4998lb # [ 94.670281] niks3-server[1032]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4999lb # [ 94.674807] niks3-server[1032]: 2026/09/20 09:34:15 INFO Completed upload id=285000worker2 # [ 94.684276] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.307Z level=INFO msg="Upload complete. (348ms)"5001worker2 # [ 94.707983] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15002worker2 # [ 94.724327] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:14Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05003worker2 # [ 94.727736] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:14Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=15004worker2 # [ 94.731839] nix-daemon[836]: reaped child process 1308, status = succeeded5005worker2 # [ 94.753582] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410825006worker2 # [ 94.770850] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410825007worker2 # [ 94.785440] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.408Z level=INFO msg="All 1 paths already cached"5008client # copying 1 paths to 'lb:50051'...5009worker2 # [ 94.796118] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:410825010client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5011worker2 # [ 94.814425] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5012worker2 # [ 95.020086] nix-daemon[836]: accepted connection from pid 1334, user nix-grpc-daemon (trusted)5013worker2 # [ 95.039778] nix-daemon[836]: reaped child process 1337, status = succeeded5014worker2 # [ 95.211709] nix-daemon[836]: accepted connection from pid 1339, user nix-grpc-daemon (trusted)5015worker2 # [ 95.231120] nix-daemon[836]: reaped child process 1342, status = succeeded5016lb # [ 95.232825] niks3-server[1032]: 2026/09/20 09:34:15 INFO Received uploads request method=POST path=/api/pending_closures5017worker2 # [ 95.252079] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.875Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5018worker2 # [ 95.253589] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.875Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5019lb # [ 95.263337] niks3-server[1032]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5020worker2 # [ 95.286262] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.909Z level=INFO msg="Uploading 1 narinfos"5021lb # [ 95.280363] niks3-server[1032]: 2026/09/20 09:34:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5022lb # [ 95.291373] niks3-server[1032]: 2026/09/20 09:34:15 INFO Signed narinfos id=29 count=15023lb # [ 95.296316] niks3-server[1032]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5024worker2 # [ 95.315781] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.939Z level=INFO msg="Upload complete. (484ms)"5025lb # [ 95.306968] niks3-server[1032]: 2026/09/20 09:34:15 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5026lb # [ 95.312964] niks3-server[1032]: 2026/09/20 09:34:15 INFO Completed upload id=295027worker2 # [ 95.322787] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=0 paths=1 nar_bytes_in=6405028lb # [ 95.317439] niks3-server[1032]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5029worker2 # [ 95.332621] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410825030worker2 # [ 95.342663] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5031worker2 # [ 95.347493] nix-daemon[836]: reaped child process 1332, status = succeeded5032client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5033worker2 # [ 95.358527] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5034client # farm-b> worker2: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5035worker2 # [ 95.984262] nix-daemon[836]: reaped child process 1346, status = succeeded5036client # farm-b> LOG-farm-b-on-standby5037worker2 # [ 96.142082] nix-daemon[836]: accepted connection from pid 1361, user nix-grpc-daemon (trusted)5038worker2 # [ 96.160538] nix-daemon[836]: reaped child process 1364, status = succeeded5039lb # [ 96.165879] niks3-server[1032]: 2026/09/20 09:34:16 INFO Received uploads request method=POST path=/api/pending_closures5040worker2 # [ 96.185887] nix-grpc-daemon[1251]: time=2026-09-20T09:34:15.808Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5041worker2 # [ 96.187388] nix-grpc-daemon[1251]: time=2026-09-20T09:34:15.808Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5042lb # [ 96.197083] niks3-server[1032]: 2026/09/20 09:34:16 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5043lb # [ 96.213640] niks3-server[1032]: 2026/09/20 09:34:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5044worker2 # [ 96.227947] nix-grpc-daemon[1251]: time=2026-09-20T09:34:15.851Z level=INFO msg="Uploading 1 narinfos"5045lb # [ 96.225421] niks3-server[1032]: 2026/09/20 09:34:16 INFO Signed narinfos id=30 count=15046lb # [ 96.227809] niks3-server[1032]: 2026/09/20 09:34:16 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5047lb # [ 96.236515] niks3-server[1032]: 2026/09/20 09:34:16 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5048lb # [ 96.244299] niks3-server[1032]: 2026/09/20 09:34:16 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5049lb # [ 96.247504] niks3-server[1032]: 2026/09/20 09:34:16 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5050lb # [ 96.251291] niks3-server[1032]: 2026/09/20 09:34:16 INFO Completed upload id=305051worker2 # [ 96.260794] nix-grpc-daemon[1251]: time=2026-09-20T09:34:15.884Z level=INFO msg="Upload complete. (290ms)"5052worker2 # [ 96.274752] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=0 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15053worker2 # [ 96.289414] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:15Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05054worker2 # [ 96.292842] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:15Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=15055worker2 # [ 96.296409] nix-daemon[836]: reaped child process 1344, status = succeeded5056worker2 # [ 96.317118] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410825057worker2 # [ 96.329345] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410825058worker2 # [ 96.340947] nix-grpc-daemon[1251]: time=2026-09-20T09:34:15.964Z level=INFO msg="All 2 paths already cached"5059client # copying 1 paths to 'lb:50051'...5060client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5061worker2 # [ 96.351031] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:410825062worker2 # [ 96.365426] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5063worker2 # [ 96.558205] nix-daemon[836]: accepted connection from pid 1370, user nix-grpc-daemon (trusted)5064worker2 # [ 96.577623] nix-daemon[836]: reaped child process 1373, status = succeeded5065worker2 # [ 96.750262] nix-daemon[836]: accepted connection from pid 1375, user nix-grpc-daemon (trusted)5066worker2 # [ 96.769187] nix-daemon[836]: reaped child process 1378, status = succeeded5067lb # [ 96.773141] niks3-server[1032]: 2026/09/20 09:34:17 INFO Received uploads request method=POST path=/api/pending_closures5068worker2 # [ 96.791576] nix-grpc-daemon[1251]: time=2026-09-20T09:34:16.414Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5069worker2 # [ 96.793216] nix-grpc-daemon[1251]: time=2026-09-20T09:34:16.414Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5070lb # [ 96.800667] niks3-server[1032]: 2026/09/20 09:34:17 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5071worker2 # [ 96.826348] nix-grpc-daemon[1251]: time=2026-09-20T09:34:16.449Z level=INFO msg="Uploading 1 narinfos"5072lb # [ 96.811367] niks3-server[1032]: 2026/09/20 09:34:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5073lb # [ 96.821867] niks3-server[1032]: 2026/09/20 09:34:17 INFO Signed narinfos id=31 count=15074lb # [ 96.828871] niks3-server[1032]: 2026/09/20 09:34:17 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5075lb # [ 96.838582] niks3-server[1032]: 2026/09/20 09:34:17 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5076worker2 # [ 96.853042] nix-grpc-daemon[1251]: time=2026-09-20T09:34:16.476Z level=INFO msg="Upload complete. (472ms)"5077lb # [ 96.843736] niks3-server[1032]: 2026/09/20 09:34:17 INFO Completed upload id=315078lb # [ 96.846724] niks3-server[1032]: 2026/09/20 09:34:17 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5079worker2 # [ 96.859511] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=0 paths=1 nar_bytes_in=7685080worker2 # [ 96.871225] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410825081worker2 # [ 96.877092] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5082worker2 # [ 96.881789] nix-daemon[836]: reaped child process 1368, status = succeeded5083client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5084client # farm-top> worker2: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5085worker2 # [ 96.893914] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5086worker2 # [ 97.914396] nix-daemon[836]: reaped child process 1382, status = succeeded5087client # farm-top> LOG-farm-top-on-standby5088worker2 # [ 98.077114] nix-daemon[836]: accepted connection from pid 1397, user nix-grpc-daemon (trusted)5089worker2 # [ 98.096655] nix-daemon[836]: reaped child process 1400, status = succeeded5090lb # [ 98.099353] niks3-server[1032]: 2026/09/20 09:34:18 INFO Received uploads request method=POST path=/api/pending_closures5091worker2 # [ 98.123175] nix-grpc-daemon[1251]: time=2026-09-20T09:34:17.744Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5092worker2 # [ 98.124791] nix-grpc-daemon[1251]: time=2026-09-20T09:34:17.745Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5093lb # [ 98.147182] niks3-server[1032]: 2026/09/20 09:34:18 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5094worker2 # [ 98.168996] nix-grpc-daemon[1251]: time=2026-09-20T09:34:17.792Z level=INFO msg="Uploading 1 narinfos"5095lb # [ 98.160845] niks3-server[1032]: 2026/09/20 09:34:18 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5096lb # [ 98.169091] niks3-server[1032]: 2026/09/20 09:34:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5097lb # [ 98.174530] niks3-server[1032]: 2026/09/20 09:34:18 INFO Signed narinfos id=32 count=15098lb # [ 98.179949] niks3-server[1032]: 2026/09/20 09:34:18 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5099worker2 # [ 98.193582] nix-grpc-daemon[1251]: time=2026-09-20T09:34:17.816Z level=INFO msg="Upload complete. (290ms)"5100lb # [ 98.184644] niks3-server[1032]: 2026/09/20 09:34:18 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5101lb # [ 98.188087] niks3-server[1032]: 2026/09/20 09:34:18 INFO Completed upload id=325102lb # [ 98.190908] niks3-server[1032]: 2026/09/20 09:34:18 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5103worker2 # [ 98.205017] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15104worker2 # [ 98.219249] nix-daemon[836]: reaped child process 1380, status = succeeded5105client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 6.27 seconds)5106client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5107client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds)5108worker1 # [ 98.582443] systemd[1]: Listening on Nix worker-protocol over gRPC.5109worker1 # [ 98.591739] systemd[1]: Starting Nix worker-protocol over gRPC...5110worker1 # [ 98.790243] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:18Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5111worker1 # [ 98.792627] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:18Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15112worker1 # [ 98.800079] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:18Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5113worker1 # [ 98.824128] systemd[1]: Started Nix worker-protocol over gRPC.5114lb: must succeed: curl -sf localhost:9901/clusters5115worker1 # [ 98.854050] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:18Z level=info event=scheduler_connected addr=lb:500515116worker2 # [ 98.859138] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:18Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05117lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5118worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5119worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5120lb: must succeed: curl -sf localhost:9901/clusters5121lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5122lb: must succeed: curl -sf localhost:9901/clusters5123lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5124worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5125worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5126(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.50 seconds)5127subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5128client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5129client # [ 99.327524] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5130client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.10 seconds)5131worker2 # [ 99.545644] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:410825132client # Running as unit: rs.service; invocation ID: 9e1595d889e747209dd5741bdd3fb4535133client # [ 99.577038] nix[1174]: don't know how to build these paths:5134client # [ 99.578867] nix[1174]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5135worker2 # [ 99.566480] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:19Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05136worker2 # [ 99.573341] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:19Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=15137worker2 # [ 99.615446] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410825138worker2 # [ 99.631521] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:410825139client # [ 99.667155] nix[1174]: copying 1 paths to 'lb:50051'...5140client # [ 99.672433] nix[1174]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5141worker2 # [ 99.649155] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:410825142worker2 # [ 99.663974] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5143worker2 # [ 99.872582] nix-daemon[836]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5144worker2 # [ 99.891191] nix-daemon[836]: reaped child process 1418, status = succeeded5145worker2 # [ 100.062905] nix-daemon[836]: accepted connection from pid 1420, user nix-grpc-daemon (trusted)5146worker2 # [ 100.080431] nix-daemon[836]: reaped child process 1423, status = succeeded5147lb # [ 100.083393] niks3-server[1032]: 2026/09/20 09:34:20 INFO Received uploads request method=POST path=/api/pending_closures5148worker2 # [ 100.102723] nix-grpc-daemon[1251]: time=2026-09-20T09:34:19.725Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5149worker2 # [ 100.104268] nix-grpc-daemon[1251]: time=2026-09-20T09:34:19.725Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5150lb # [ 100.114468] niks3-server[1032]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5151worker2 # [ 100.137039] nix-grpc-daemon[1251]: time=2026-09-20T09:34:19.760Z level=INFO msg="Uploading 1 narinfos"5152lb # [ 100.129978] niks3-server[1032]: 2026/09/20 09:34:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5153lb # [ 100.140851] niks3-server[1032]: 2026/09/20 09:34:20 INFO Signed narinfos id=33 count=15154lb # [ 100.146370] niks3-server[1032]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5155lb # [ 100.154928] niks3-server[1032]: 2026/09/20 09:34:20 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5156lb # [ 100.160719] niks3-server[1032]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5157lb # [ 100.164826] niks3-server[1032]: 2026/09/20 09:34:20 INFO Completed upload id=335158worker2 # [ 100.174063] nix-grpc-daemon[1251]: time=2026-09-20T09:34:19.797Z level=INFO msg="Upload complete. (493ms)"5159worker2 # [ 100.182334] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=0 paths=1 nar_bytes_in=4165160worker2 # [ 100.196105] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:410825161worker2 # [ 100.203355] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5162worker2 # [ 100.208718] nix-daemon[836]: reaped child process 1413, status = succeeded5163client # [ 100.241711] nix[1174]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5164worker2 # [ 100.221721] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted)5165lb # [ 100.923909] envoy[913]: conn peer=[2001:db8:1::1]:51538 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9606 tx=3852 ms=59835166lb: must succeed: curl -sf localhost:9901/clusters5167lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5168lb: must succeed: curl -sf localhost:9901/clusters5169lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5170lb: must succeed: curl -sf localhost:9901/clusters5171lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5172lb: must succeed: curl -sf localhost:9901/clusters5173lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5174worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5175worker1 # [ 102.278831] systemd-journald[273]: Received client request to rotate journal, rotating.5176worker1 # [ 102.305211] systemd-journald[273]: Vacuuming done, freed 0B of archived journals from /var/log/journal/8ce22dac6e05441b95b2412a25a6cd0e.5177worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)5178worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service5179worker2 # [ 102.362258] systemd[1]: Stopping Nix worker-protocol over gRPC...5180worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5181??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5182 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735183client: must succeed: sleep 5.05184worker2 # [ 102.706247] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:22Z level=info event=draining5185client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5186worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5187worker2 # [ 107.862647] nix-daemon[836]: reaped child process 1427, status = succeeded5188worker2 # [ 108.031938] nix-daemon[836]: accepted connection from pid 1467, user nix-grpc-daemon (trusted)5189worker2 # [ 108.051631] nix-daemon[836]: reaped child process 1470, status = succeeded5190lb # [ 108.054635] niks3-server[1032]: 2026/09/20 09:34:28 INFO Received uploads request method=POST path=/api/pending_closures5191worker2 # [ 108.076422] nix-grpc-daemon[1251]: time=2026-09-20T09:34:27.698Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5192worker2 # [ 108.078093] nix-grpc-daemon[1251]: time=2026-09-20T09:34:27.698Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5193lb # [ 108.100819] niks3-server[1032]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5194lb # [ 108.113392] niks3-server[1032]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5195worker2 # [ 108.132357] nix-grpc-daemon[1251]: time=2026-09-20T09:34:27.755Z level=INFO msg="Uploading 1 narinfos"5196lb # [ 108.125441] niks3-server[1032]: 2026/09/20 09:34:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5197lb # [ 108.132928] niks3-server[1032]: 2026/09/20 09:34:28 INFO Signed narinfos id=34 count=15198lb # [ 108.134913] niks3-server[1032]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5199lb # [ 108.141927] niks3-server[1032]: 2026/09/20 09:34:28 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5200lb # [ 108.148139] niks3-server[1032]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5201lb # [ 108.151646] niks3-server[1032]: 2026/09/20 09:34:28 INFO Completed upload id=345202worker2 # [ 108.160984] nix-grpc-daemon[1251]: time=2026-09-20T09:34:27.784Z level=INFO msg="Upload complete. (323ms)"5203worker2 # [ 108.177183] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15204worker2 # [ 108.191510] nix-daemon[836]: reaped child process 1425, status = succeeded5205client # [ 108.237451] systemd[1]: rs.service: Deactivated successfully.5206client # [ 108.241764] systemd[1]: rs.service: Consumed 162ms CPU time over 8.913s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5207worker2 # [ 108.707287] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=signal_exit5208worker2 # [ 108.929082] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=scheduler_yield5209lb # [ 108.927941] niks3-server[1032]: 2026/09/20 09:34:29 INFO lead: released remote=192.168.1.4:456645210worker2 # [ 108.939473] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=scheduler_restarting addr=lb:500515211worker1 # [ 108.939440] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:28Z level=info event=scheduler_restarting addr=lb:500515212worker2 # [ 108.945932] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:422205213worker2 # [ 108.950531] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=worker_gone addr=192.168.1.3:500515214worker2 # [ 108.954643] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:422205215worker2 # [ 108.959135] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=worker_gone addr=192.168.1.4:500515216worker1 # [ 109.139452] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:28Z level=info event=scheduler_connected addr=lb:500515217worker2 # [ 109.140917] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=scheduler_connected addr=lb:500515218worker1 # [ 109.145246] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5219worker2 # [ 109.147183] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5220worker1 # [ 109.345936] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:28Z level=info event=scheduler_connected addr=lb:500515221worker2 # [ 109.349440] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=scheduler_connected addr=lb:500515222worker1 # [ 109.351415] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5223worker2 # [ 109.353665] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5224worker2 # [ 109.550195] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:29Z level=info event=scheduler_connected addr=lb:500515225worker1 # [ 109.552390] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_connected addr=lb:500515226worker2 # [ 109.555511] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5227worker1 # [ 109.557516] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5228worker2 # [ 109.756088] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:29Z level=info event=scheduler_connected addr=lb:500515229worker1 # [ 109.758595] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_connected addr=lb:500515230worker2 # [ 109.761302] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5231worker1 # [ 109.763923] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5232worker2 # [ 109.934719] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:29Z level=info event=scheduler_restarting5233worker1 # [ 109.965852] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_connected addr=lb:500515234worker1 # [ 109.971040] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5235worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.23 seconds)5236client: waiting for success: ! systemctl is-active rs5237worker2 # [ 109.990003] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:29Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5238worker2 # [ 109.995420] nix-daemon[836]: reaped child process 1244, status = succeeded5239client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5240client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5241client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5242client: must fail: journalctl -u rs | grep -q 'reconnecting'5243client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5244lb: must succeed: curl -sf localhost:9901/clusters5245worker1 # [ 110.170148] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_connected addr=lb:500515246worker1 # [ 110.175492] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5247lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5248worker1 # [ 110.376467] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_connected addr=lb:500515249worker1 # [ 110.381631] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5250worker1 # [ 110.582724] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_connected addr=lb:500515251worker1 # [ 110.588519] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5252worker2 # [ 110.769559] nix-grpc-daemon[1195]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5253worker2 # [ 110.769883] nix-grpc-daemon[1195]: E0000 00:00:1789896870.391374 1238 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true5254worker2 # [ 110.770087] nix-grpc-daemon[1195]: E0000 00:00:1789896870.391739 1238 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5255worker1 # [ 110.789294] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_connected addr=lb:500515256worker1 # [ 110.794633] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5257lb # [ 110.922062] envoy[913]: conn peer=[2001:db8:1::1]:51548 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1351 ms=86395258lb # [ 110.922429] envoy[913]: conn peer=[2001:db8:1::4]:42312 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=7226 tx=2123 ms=292395259worker1 # [ 110.997587] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_connected addr=lb:500515260worker1 # [ 111.001824] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5261worker2 # [ 111.063460] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5262worker2 # [ 111.070997] systemd[1]: Stopped Nix worker-protocol over gRPC.5263worker2 # [ 111.077879] systemd[1]: nix-grpc-daemon.service: Consumed 1.994s CPU time over 30.614s wall clock time, 36.4M memory peak, 60.9K incoming IP traffic, 121.6K outgoing IP traffic.5264worker2 # [ 111.090432] systemd[1]: Starting Nix worker-protocol over gRPC...5265worker1 # [ 111.198218] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_connected addr=lb:500515266worker1 # [ 111.203498] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5267lb: must succeed: curl -sf localhost:9901/clusters5268worker2 # [ 111.286814] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5269worker2 # [ 111.289380] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15270worker2 # [ 111.296854] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5271worker2 # [ 111.298632] systemd[1]: Started Nix worker-protocol over gRPC.5272worker2 # [ 111.306791] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:30Z level=info event=scheduler_take_over5273lb # [ 111.298468] niks3-server[1032]: 2026/09/20 09:34:31 INFO lead: acquired remote=192.168.1.4:483505274lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5275worker2 # [ 111.333213] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:30Z level=info event=scheduler_connected addr=lb:500515276worker2 # [ 111.335027] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5277worker1 # [ 111.404470] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:500515278worker1 # [ 111.409816] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5279worker2 # [ 111.536194] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:500515280worker2 # [ 111.541432] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5281worker1 # [ 111.610750] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:500515282worker1 # [ 111.616325] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5283worker2 # [ 111.742141] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:500515284worker2 # [ 111.747560] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5285worker1 # [ 111.817163] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:500515286worker1 # [ 111.822499] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5287worker2 # [ 111.948417] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:500515288worker2 # [ 111.953634] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5289worker1 # [ 112.025454] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:500515290worker1 # [ 112.029924] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5291worker2 # [ 112.154583] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:500515292worker2 # [ 112.163160] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05293worker1 # [ 112.226209] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:500515294worker2 # [ 112.228963] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05295lb: must succeed: curl -sf localhost:9901/clusters5296lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5297worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5298worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5299(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.26 seconds)5300subtest: scheduler restart mid-build: build finishes, no double build5301client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5302client # [ 112.585102] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5303client # Running as unit: mid.service; invocation ID: 1c5f89cca7624954809060788261632b5304client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds)5305worker1 # [ 112.806884] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:506105306worker1 # [ 112.822488] nix-daemon[836]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)5307client # [ 112.866700] nix[1210]: don't know how to build these paths:5308client # [ 112.871145] nix[1210]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5309worker2 # [ 112.860120] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:32Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05310worker2 # [ 112.860417] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:32Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15311worker2 # [ 112.921640] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600805312worker2 # [ 112.935474] nix-daemon[836]: accepted connection from pid 1477, user nix-grpc-daemon (trusted)5313worker2 # [ 112.959000] nix-grpc-daemon[1477]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 1/5)5314worker2 # [ 113.025805] nix-grpc-daemon[1477]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 2/5)5315worker2 # [ 113.101222] nix-grpc-daemon[1477]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 282 ms (attempt 3/5)5316worker2 # [ 113.384066] nix-grpc-daemon[1477]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 119 ms (attempt 4/5)5317worker2 # [ 113.504113] nix-grpc-daemon[1477]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5318worker2 # [ 113.525401] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600805319client # [ 113.564209] nix[1210]: copying 1 paths to 'lb:50051'...5320worker2 # [ 113.541832] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:600805321client # [ 113.568187] nix[1210]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5322worker2 # [ 113.559089] nix-daemon[836]: accepted connection from pid 1477, user nix-grpc-daemon (trusted)5323worker2 # [ 113.588088] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:33Z level=info event=niks3_push_started pid=15445324worker2 # [ 113.992571] nix-daemon[836]: accepted connection from pid 1557, user nix-grpc-daemon (trusted)5325worker2 # [ 114.008933] nix-daemon[836]: reaped child process 1564, status = succeeded5326worker2 # [ 114.187025] nix-daemon[836]: accepted connection from pid 1566, user nix-grpc-daemon (trusted)5327worker2 # [ 114.203879] nix-daemon[836]: reaped child process 1569, status = succeeded5328lb # [ 114.206863] niks3-server[1032]: 2026/09/20 09:34:34 INFO Received uploads request method=POST path=/api/pending_closures5329worker2 # [ 114.230493] nix-grpc-daemon[1544]: time=2026-09-20T09:34:33.852Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5330worker2 # [ 114.231970] nix-grpc-daemon[1544]: time=2026-09-20T09:34:33.852Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5331lb # [ 114.244272] niks3-server[1032]: 2026/09/20 09:34:34 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5332lb # [ 114.258591] niks3-server[1032]: 2026/09/20 09:34:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5333worker2 # [ 114.275147] nix-grpc-daemon[1544]: time=2026-09-20T09:34:33.898Z level=INFO msg="Uploading 1 narinfos"5334lb # [ 114.269878] niks3-server[1032]: 2026/09/20 09:34:34 INFO Signed narinfos id=35 count=15335lb # [ 114.278840] niks3-server[1032]: 2026/09/20 09:34:34 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5336lb # [ 114.291109] niks3-server[1032]: 2026/09/20 09:34:34 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5337lb # [ 114.304720] niks3-server[1032]: 2026/09/20 09:34:34 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5338lb # [ 114.327955] niks3-server[1032]: 2026/09/20 09:34:34 INFO Completed upload id=355339worker2 # [ 114.337612] nix-grpc-daemon[1544]: time=2026-09-20T09:34:33.960Z level=INFO msg="Upload complete. (530ms)"5340worker2 # [ 114.350028] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60080 duration_s=0 paths=1 nar_bytes_in=4245341worker2 # [ 114.368579] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600805342worker2 # [ 114.388405] nix-daemon[836]: accepted connection from pid 1477, user nix-grpc-daemon (trusted)5343worker2 # [ 114.391477] nix-daemon[836]: reaped child process 1542, status = succeeded5344client # [ 114.421427] nix[1210]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5345worker2 # [ 114.402371] nix-daemon[836]: accepted connection from pid 1477, user nix-grpc-daemon (trusted)5346lb: must succeed: curl -sf localhost:9901/clusters5347lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5348lb: must succeed: curl -sf localhost:9901/clusters5349lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5350worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5351worker2 # [ 116.581580] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1477 (nix-grpc-daemon) on client request.5352worker2 # [ 116.583184] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5353lb # [ 116.590124] niks3-server[1032]: 2026/09/20 09:34:37 INFO lead: released remote=192.168.1.4:483505354client # [ 116.635909] nix[1210]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5355worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds)5356client: must succeed: sleep 5.05357worker1 # [ 116.610713] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:36Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5358client # [ 116.643033] nix[1210]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5359worker2 # [ 116.628650] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5360worker2 # [ 116.630287] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5361worker2 # [ 116.631530] systemd[1]: nix-grpc-daemon.service: Consumed 535ms CPU time over 5.538s wall clock time, 33.9M memory peak, 12.4K incoming IP traffic, 16.1K outgoing IP traffic.5362worker2 # [ 116.647280] nix-daemon[836]: reaped child process 1537, status = succeeded5363worker2 # [ 116.648624] nix-daemon[836]: reaped child process 1571, status = succeeded5364worker2 # [ 116.654537] nix-daemon[1573]: unexpected Nix daemon error: error: interrupted by the user5365worker2 # [ 116.662534] nix-daemon[836]: reaped child process 1573, status = failed with exit code 15366worker1 # [ 116.810627] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:36Z level=info event=scheduler_connected addr=lb:500515367worker2 # [ 116.816408] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5368worker2 # [ 116.830064] systemd[1]: Starting Nix worker-protocol over gRPC...5369worker2 # [ 117.042303] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5370worker2 # [ 117.044633] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15371worker2 # [ 117.052308] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5372worker2 # [ 117.054056] systemd[1]: Started Nix worker-protocol over gRPC.5373worker2 # [ 117.066086] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=info event=scheduler_take_over5374lb # [ 117.057058] niks3-server[1032]: 2026/09/20 09:34:37 INFO lead: acquired remote=192.168.1.4:484185375worker2 # [ 117.082444] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05376worker2 # [ 117.099055] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=info event=scheduler_connected addr=lb:500515377worker2 # [ 117.100956] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05378worker2 # [ 117.126513] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05379worker2 # [ 117.129352] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15380worker1 # [ 117.172200] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506105381worker1 # [ 117.195088] nix-grpc-daemon[1143]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5)5382worker1 # [ 117.288189] nix-grpc-daemon[1143]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 103 ms (attempt 2/5)5383worker1 # [ 117.391542] nix-grpc-daemon[1143]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 335 ms (attempt 3/5)5384worker1 # [ 117.735569] nix-grpc-daemon[1143]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 323 ms (attempt 4/5)5385worker1 # [ 118.058349] nix-grpc-daemon[1143]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5386worker1 # [ 118.081968] nix-grpc-daemon[1143]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5387worker1 # [ 118.120754] nix-daemon[836]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)5388worker1 # [ 118.139125] nix-daemon[836]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)5389client # [ 118.163966] nix[1210]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5390lb # [ 120.921538] envoy[913]: conn peer=[2001:db8:1::4]:54964 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=990 tx=434 ms=52835391client: (finished: must succeed: sleep 5.0, in 5.07 seconds)5392worker1 # [ 121.962496] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:41Z level=info event=niks3_push_started pid=12965393worker1 # [ 121.981880] nix-daemon[836]: reaped child process 1272, status = succeeded5394client: waiting for success: ! systemctl is-active mid5395worker1 # [ 122.336571] nix-daemon[836]: accepted connection from pid 1309, user nix-grpc-daemon (trusted)5396worker1 # [ 122.356224] nix-daemon[836]: reaped child process 1312, status = succeeded5397lb # [ 122.362063] niks3-server[1032]: 2026/09/20 09:34:42 INFO Received uploads request method=POST path=/api/pending_closures5398worker1 # [ 122.380452] nix-grpc-daemon[1296]: time=2026-09-20T09:34:41.998Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5399worker1 # [ 122.381932] nix-grpc-daemon[1296]: time=2026-09-20T09:34:41.998Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5400lb # [ 122.399961] niks3-server[1032]: 2026/09/20 09:34:42 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5401lb # [ 122.419151] niks3-server[1032]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5402lb # [ 122.431710] niks3-server[1032]: 2026/09/20 09:34:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5403worker1 # [ 122.446926] nix-grpc-daemon[1296]: time=2026-09-20T09:34:42.064Z level=INFO msg="Uploading 1 narinfos"5404lb # [ 122.442031] niks3-server[1032]: 2026/09/20 09:34:43 INFO Signed narinfos id=36 count=15405lb # [ 122.451098] niks3-server[1032]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5406lb # [ 122.461336] niks3-server[1032]: 2026/09/20 09:34:43 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5407lb # [ 122.472313] niks3-server[1032]: 2026/09/20 09:34:43 INFO Completed upload id=365408worker1 # [ 122.478219] nix-grpc-daemon[1296]: time=2026-09-20T09:34:42.097Z level=INFO msg="Upload complete. (311ms)"5409worker1 # [ 122.488535] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50610 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15410lb # [ 122.493440] niks3-server[1032]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo5411worker1 # [ 122.506464] nix-daemon[836]: reaped child process 1270, status = succeeded5412client # [ 122.557268] systemd[1]: mid.service: Deactivated successfully.5413client # [ 122.561573] systemd[1]: mid.service: Consumed 164ms CPU time over 9.975s wall clock time, 37.2M memory peak, 9.8K incoming IP traffic, 10.6K outgoing IP traffic.5414client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5415client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5416client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5417(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.70 seconds)5418subtest: interrupting the client stops the build on the worker5419client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5420client # [ 123.259717] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5421client # Running as unit: intr.service; invocation ID: ada56286b4424e68b78ee719a57a9bb45422client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5423worker1 # [ 123.455845] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:506105424client # [ 123.488239] nix[1246]: don't know how to build these paths:5425client # [ 123.489353] nix[1246]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5426worker2 # [ 123.482890] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:43Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05427worker2 # [ 123.483220] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:43Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15428worker2 # [ 123.530443] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406965429worker2 # [ 123.545304] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5430worker2 # [ 123.568129] nix-grpc-daemon[1609]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 1/5)5431worker2 # [ 123.649149] nix-grpc-daemon[1609]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 2/5)5432worker2 # [ 123.739781] nix-grpc-daemon[1609]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 291 ms (attempt 3/5)5433worker2 # [ 124.038774] nix-grpc-daemon[1609]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 782 ms (attempt 4/5)5434worker2 # [ 124.822987] nix-grpc-daemon[1609]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5435worker2 # [ 124.845122] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406965436client # [ 124.885228] nix[1246]: copying 1 paths to 'lb:50051'...5437worker2 # [ 124.861641] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406965438client # [ 124.885504] nix[1246]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5439worker2 # [ 124.880695] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5440worker2 # [ 124.909038] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:44Z level=info event=niks3_push_started pid=16855441worker2 # [ 125.293233] nix-daemon[836]: accepted connection from pid 1698, user nix-grpc-daemon (trusted)5442worker2 # [ 125.310730] nix-daemon[836]: reaped child process 1701, status = succeeded5443worker2 # [ 125.484570] nix-daemon[836]: accepted connection from pid 1703, user nix-grpc-daemon (trusted)5444worker2 # [ 125.502782] nix-daemon[836]: reaped child process 1706, status = succeeded5445lb # [ 125.505712] niks3-server[1032]: 2026/09/20 09:34:46 INFO Received uploads request method=POST path=/api/pending_closures5446worker2 # [ 125.530054] nix-grpc-daemon[1685]: time=2026-09-20T09:34:45.151Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5447worker2 # [ 125.531927] nix-grpc-daemon[1685]: time=2026-09-20T09:34:45.151Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5448lb # [ 125.548879] niks3-server[1032]: 2026/09/20 09:34:46 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5449lb # [ 125.562928] niks3-server[1032]: 2026/09/20 09:34:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5450worker2 # [ 125.579708] nix-grpc-daemon[1685]: time=2026-09-20T09:34:45.202Z level=INFO msg="Uploading 1 narinfos"5451lb # [ 125.573690] niks3-server[1032]: 2026/09/20 09:34:46 INFO Signed narinfos id=37 count=15452lb # [ 125.581909] niks3-server[1032]: 2026/09/20 09:34:46 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5453lb # [ 125.594101] niks3-server[1032]: 2026/09/20 09:34:46 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5454lb # [ 125.601007] niks3-server[1032]: 2026/09/20 09:34:46 INFO Completed upload id=375455worker2 # [ 125.609145] nix-grpc-daemon[1685]: time=2026-09-20T09:34:45.232Z level=INFO msg="Upload complete. (484ms)"5456lb # [ 125.603023] niks3-server[1032]: 2026/09/20 09:34:46 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5457worker2 # [ 125.620701] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=0 paths=1 nar_bytes_in=4245458worker2 # [ 125.632209] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406965459worker2 # [ 125.639431] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5460worker2 # [ 125.644803] nix-daemon[836]: reaped child process 1683, status = succeeded5461client # [ 125.678210] nix[1246]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5462worker2 # [ 125.658654] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5463client: must succeed: systemctl kill -s INT intr5464client # [ 126.957659] systemd[1]: intr.service: Sent signal SIGINT to main process 1246 (nix) on client request.5465client # [ 126.966363] nix[1246]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5466client # [ 126.973828] nix[1246]: error: interrupted by the user5467client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5468client # [ 127.006654] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5469client # [ 127.011072] systemd[1]: intr.service: Failed with result 'exit-code'.5470client # [ 127.013356] systemd[1]: intr.service: Consumed 140ms CPU time over 3.749s wall clock time, 39.2M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic.5471worker2 # [ 127.104589] nix-daemon[1710]: unexpected Nix daemon error: error: interrupted by the user5472worker2 # [ 127.108424] nix-daemon[836]: reaped child process 1708, status = succeeded5473worker2 # [ 127.115815] nix-daemon[836]: reaped child process 1710, status = failed with exit code 15474(finished: subtest: interrupting the client stops the build on the worker, in 3.93 seconds)5475subtest: a deploy mid-build drains: the build finishes, the new generation takes over5476client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5477client # [ 127.210515] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5478client # Running as unit: sw.service; invocation ID: 2a3f8155914f4338838b3743a68348ec5479client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5480worker1 # [ 127.422171] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:506105481client # [ 127.455477] nix[1266]: don't know how to build these paths:5482client # [ 127.456753] nix[1266]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5483worker2 # [ 127.442386] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:47Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05484worker2 # [ 127.448513] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:47Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15485worker1 # [ 127.488233] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506105486worker1 # [ 127.504119] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506105487client # [ 127.543793] nix[1266]: copying 1 paths to 'lb:50051'...5488worker1 # [ 127.520066] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:506105489client # [ 127.546408] nix[1266]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5490worker1 # [ 127.533959] nix-daemon[836]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)5491worker1 # [ 127.744699] nix-daemon[836]: accepted connection from pid 1340, user nix-grpc-daemon (trusted)5492worker1 # [ 127.764785] nix-daemon[836]: reaped child process 1343, status = succeeded5493worker1 # [ 127.936635] nix-daemon[836]: accepted connection from pid 1345, user nix-grpc-daemon (trusted)5494worker1 # [ 127.955893] nix-daemon[836]: reaped child process 1348, status = succeeded5495lb # [ 127.962223] niks3-server[1032]: 2026/09/20 09:34:48 INFO Received uploads request method=POST path=/api/pending_closures5496worker1 # [ 127.978943] nix-grpc-daemon[1296]: time=2026-09-20T09:34:47.597Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5497worker1 # [ 127.980550] nix-grpc-daemon[1296]: time=2026-09-20T09:34:47.597Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5498lb # [ 127.989405] niks3-server[1032]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5499worker1 # [ 128.011358] nix-grpc-daemon[1296]: time=2026-09-20T09:34:47.630Z level=INFO msg="Uploading 1 narinfos"5500lb # [ 128.006559] niks3-server[1032]: 2026/09/20 09:34:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5501lb # [ 128.017684] niks3-server[1032]: 2026/09/20 09:34:48 INFO Signed narinfos id=38 count=15502worker1 # [ 128.036830] nix-grpc-daemon[1296]: time=2026-09-20T09:34:47.656Z level=INFO msg="Upload complete. (485ms)"5503lb # [ 128.023560] niks3-server[1032]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5504worker1 # [ 128.042574] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50610 duration_s=0 paths=1 nar_bytes_in=4165505lb # [ 128.035595] niks3-server[1032]: 2026/09/20 09:34:48 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5506lb # [ 128.041191] niks3-server[1032]: 2026/09/20 09:34:48 INFO Completed upload id=385507lb # [ 128.043865] niks3-server[1032]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5508worker1 # [ 128.058145] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506105509worker1 # [ 128.063645] nix-daemon[836]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)5510worker1 # [ 128.068284] nix-daemon[836]: reaped child process 1338, status = succeeded5511client # [ 128.102855] nix[1266]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5512worker1 # [ 128.081297] nix-daemon[836]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)5513worker1: must succeed: systemctl reload nix-grpc-daemon.service5514worker1 # [ 129.905322] systemd[1]: Reloading Nix worker-protocol over gRPC...5515worker1 # [ 129.955924] systemd[1]: Reloaded Nix worker-protocol over gRPC.5516worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds)5517worker1: must succeed: pgrep -f 'read -t [9]0 x'5518worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5519client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25520worker1 # [ 130.274869] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:506105521client # don't know how to build these paths:5522client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5523worker2 # [ 130.284692] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406965524worker2 # [ 130.311241] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:49Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05525worker2 # [ 130.318334] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:49Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15526worker2 # [ 130.362812] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406965527worker2 # [ 130.378005] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406965528client # copying 1 paths to 'lb:50051'...5529worker2 # [ 130.394194] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406965530client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5531worker2 # [ 130.418714] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5532worker2 # [ 130.623274] nix-daemon[836]: accepted connection from pid 1760, user nix-grpc-daemon (trusted)5533worker2 # [ 130.643825] nix-daemon[836]: reaped child process 1763, status = succeeded5534worker2 # [ 130.818921] nix-daemon[836]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)5535worker1 # [ 130.825378] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:50Z level=info event=draining5536worker2 # [ 130.836376] nix-daemon[836]: reaped child process 1768, status = succeeded5537lb # [ 130.842375] niks3-server[1032]: 2026/09/20 09:34:51 INFO Received uploads request method=POST path=/api/pending_closures5538worker2 # [ 130.861019] nix-grpc-daemon[1685]: time=2026-09-20T09:34:50.483Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5539worker2 # [ 130.862508] nix-grpc-daemon[1685]: time=2026-09-20T09:34:50.483Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5540lb # [ 130.870105] niks3-server[1032]: 2026/09/20 09:34:51 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5541worker2 # [ 130.893602] nix-grpc-daemon[1685]: time=2026-09-20T09:34:50.516Z level=INFO msg="Uploading 1 narinfos"5542lb # [ 130.886867] niks3-server[1032]: 2026/09/20 09:34:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5543lb # [ 130.897458] niks3-server[1032]: 2026/09/20 09:34:51 INFO Signed narinfos id=39 count=15544lb # [ 130.902654] niks3-server[1032]: 2026/09/20 09:34:51 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5545lb # [ 130.912869] niks3-server[1032]: 2026/09/20 09:34:51 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5546lb # [ 130.917789] niks3-server[1032]: 2026/09/20 09:34:51 INFO Completed upload id=395547worker2 # [ 130.927237] nix-grpc-daemon[1685]: time=2026-09-20T09:34:50.550Z level=INFO msg="Upload complete. (491ms)"5548lb # [ 130.921049] niks3-server[1032]: 2026/09/20 09:34:51 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5549lb # [ 130.926241] envoy[913]: conn peer=[2001:db8:1::1]:58690 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3841 tx=1661 ms=97105550lb # [ 130.931084] envoy[913]: conn peer=[2001:db8:1::1]:54886 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=756 ms=35065551worker2 # [ 130.936272] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=0 paths=1 nar_bytes_in=5285552worker2 # [ 130.946944] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406965553worker2 # [ 130.953306] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5554worker2 # [ 130.958184] nix-daemon[836]: reaped child process 1758, status = succeeded5555client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5556client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5557worker2 # [ 130.971503] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5558client # farm-a> LOG-farm-a-during-drain5559worker2 # [ 132.217304] nix-daemon[836]: reaped child process 1772, status = succeeded5560worker2 # [ 132.394361] nix-daemon[836]: accepted connection from pid 1787, user nix-grpc-daemon (trusted)5561worker2 # [ 132.411647] nix-daemon[836]: reaped child process 1790, status = succeeded5562lb # [ 132.415721] niks3-server[1032]: 2026/09/20 09:34:52 INFO Received uploads request method=POST path=/api/pending_closures5563worker2 # [ 132.436506] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.057Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5564worker2 # [ 132.438443] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.057Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5565lb # [ 132.462261] niks3-server[1032]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5566lb # [ 132.473513] niks3-server[1032]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5567lb # [ 132.485217] niks3-server[1032]: 2026/09/20 09:34:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5568lb # [ 132.492763] niks3-server[1032]: 2026/09/20 09:34:53 INFO Signed narinfos id=40 count=15569worker2 # [ 132.502980] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.124Z level=INFO msg="Uploading 1 narinfos"5570lb # [ 132.497860] niks3-server[1032]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5571lb # [ 132.508307] niks3-server[1032]: 2026/09/20 09:34:53 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5572lb # [ 132.519161] niks3-server[1032]: 2026/09/20 09:34:53 INFO Completed upload id=405573worker2 # [ 132.528647] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.151Z level=INFO msg="Upload complete. (346ms)"5574lb # [ 132.522727] niks3-server[1032]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5575worker2 # [ 132.546611] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15576worker2 # [ 132.563713] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:52Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05577worker2 # [ 132.567751] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:52Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15578worker2 # [ 132.571861] nix-daemon[836]: reaped child process 1770, status = succeeded5579worker2 # [ 132.597198] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406965580worker2 # [ 132.608194] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406965581worker2 # [ 132.622521] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.245Z level=INFO msg="All 1 paths already cached"5582client # copying 1 paths to 'lb:50051'...5583worker2 # [ 132.633607] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406965584client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5585worker2 # [ 132.656760] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5586worker2 # [ 132.863844] nix-daemon[836]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)5587worker2 # [ 132.883234] nix-daemon[836]: reaped child process 1799, status = succeeded5588worker2 # [ 133.054894] nix-daemon[836]: accepted connection from pid 1801, user nix-grpc-daemon (trusted)5589worker2 # [ 133.072404] nix-daemon[836]: reaped child process 1804, status = succeeded5590lb # [ 133.074185] niks3-server[1032]: 2026/09/20 09:34:53 INFO Received uploads request method=POST path=/api/pending_closures5591worker2 # [ 133.094251] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.717Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5592worker2 # [ 133.095839] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.717Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5593lb # [ 133.107460] niks3-server[1032]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5594worker2 # [ 133.126024] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.749Z level=INFO msg="Uploading 1 narinfos"5595lb # [ 133.120211] niks3-server[1032]: 2026/09/20 09:34:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5596lb # [ 133.130071] niks3-server[1032]: 2026/09/20 09:34:53 INFO Signed narinfos id=41 count=15597lb # [ 133.137445] niks3-server[1032]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5598worker2 # [ 133.151100] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.774Z level=INFO msg="Upload complete. (476ms)"5599lb # [ 133.142255] niks3-server[1032]: 2026/09/20 09:34:53 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5600lb # [ 133.146833] niks3-server[1032]: 2026/09/20 09:34:53 INFO Completed upload id=415601lb # [ 133.150128] niks3-server[1032]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5602worker2 # [ 133.159956] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=0 paths=1 nar_bytes_in=6405603worker2 # [ 133.164410] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406965604worker2 # [ 133.173646] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5605worker2 # [ 133.178126] nix-daemon[836]: reaped child process 1794, status = succeeded5606client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5607worker2 # [ 133.189697] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5608client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5609client # farm-b> LOG-farm-b-during-drain5610worker2 # [ 134.032556] nix-daemon[836]: reaped child process 1808, status = succeeded5611worker2 # [ 134.211362] nix-daemon[836]: accepted connection from pid 1823, user nix-grpc-daemon (trusted)5612worker2 # [ 134.228633] nix-daemon[836]: reaped child process 1826, status = succeeded5613lb # [ 134.234699] niks3-server[1032]: 2026/09/20 09:34:54 INFO Received uploads request method=POST path=/api/pending_closures5614worker2 # [ 134.255899] nix-grpc-daemon[1685]: time=2026-09-20T09:34:53.878Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5615worker2 # [ 134.258336] nix-grpc-daemon[1685]: time=2026-09-20T09:34:53.878Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5616lb # [ 134.293480] niks3-server[1032]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5617worker2 # [ 134.310514] nix-grpc-daemon[1685]: time=2026-09-20T09:34:53.933Z level=INFO msg="Uploading 1 narinfos"5618lb # [ 134.302585] niks3-server[1032]: 2026/09/20 09:34:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5619lb # [ 134.311794] niks3-server[1032]: 2026/09/20 09:34:54 INFO Signed narinfos id=42 count=15620lb # [ 134.317743] niks3-server[1032]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5621lb # [ 134.327540] niks3-server[1032]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5622lb # [ 134.332328] niks3-server[1032]: 2026/09/20 09:34:54 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5623lb # [ 134.336588] niks3-server[1032]: 2026/09/20 09:34:54 INFO Completed upload id=425624worker2 # [ 134.341219] nix-grpc-daemon[1685]: time=2026-09-20T09:34:53.964Z level=INFO msg="Upload complete. (340ms)"5625lb # [ 134.339819] niks3-server[1032]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5626worker2 # [ 134.357461] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15627worker2 # [ 134.376356] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:53Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05628worker2 # [ 134.382222] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:53Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15629worker2 # [ 134.387171] nix-daemon[836]: reaped child process 1806, status = succeeded5630worker2 # [ 134.417841] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406965631worker2 # [ 134.433092] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406965632worker2 # [ 134.447241] nix-grpc-daemon[1685]: time=2026-09-20T09:34:54.070Z level=INFO msg="All 2 paths already cached"5633client # copying 1 paths to 'lb:50051'...5634worker2 # [ 134.457535] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406965635client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5636worker2 # [ 134.480477] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5637worker2 # [ 134.682538] nix-daemon[836]: accepted connection from pid 1832, user nix-grpc-daemon (trusted)5638worker2 # [ 134.700252] nix-daemon[836]: reaped child process 1835, status = succeeded5639worker2 # [ 134.874996] nix-daemon[836]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)5640worker2 # [ 134.892599] nix-daemon[836]: reaped child process 1840, status = succeeded5641lb # [ 134.894579] niks3-server[1032]: 2026/09/20 09:34:55 INFO Received uploads request method=POST path=/api/pending_closures5642worker2 # [ 134.912766] nix-grpc-daemon[1685]: time=2026-09-20T09:34:54.535Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5643worker2 # [ 134.914316] nix-grpc-daemon[1685]: time=2026-09-20T09:34:54.535Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5644lb # [ 134.919790] niks3-server[1032]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5645lb # [ 134.935225] niks3-server[1032]: 2026/09/20 09:34:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5646worker2 # [ 134.951147] nix-grpc-daemon[1685]: time=2026-09-20T09:34:54.574Z level=INFO msg="Uploading 1 narinfos"5647lb # [ 134.947955] niks3-server[1032]: 2026/09/20 09:34:55 INFO Signed narinfos id=43 count=15648lb # [ 134.953812] niks3-server[1032]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5649worker2 # [ 134.970741] nix-grpc-daemon[1685]: time=2026-09-20T09:34:54.594Z level=INFO msg="Upload complete. (472ms)"5650lb # [ 134.963006] niks3-server[1032]: 2026/09/20 09:34:55 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5651lb # [ 134.968477] niks3-server[1032]: 2026/09/20 09:34:55 INFO Completed upload id=435652lb # [ 134.971711] niks3-server[1032]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5653worker2 # [ 134.977860] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=0 paths=1 nar_bytes_in=7685654worker2 # [ 134.990911] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406965655worker2 # [ 134.996615] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5656worker2 # [ 135.001682] nix-daemon[836]: reaped child process 1830, status = succeeded5657client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5658client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5659worker2 # [ 135.014598] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)5660worker2 # [ 136.234470] nix-daemon[836]: reaped child process 1844, status = succeeded5661client # farm-top> LOG-farm-top-during-drain5662worker2 # [ 136.391410] nix-daemon[836]: accepted connection from pid 1859, user nix-grpc-daemon (trusted)5663worker2 # [ 136.411194] nix-daemon[836]: reaped child process 1862, status = succeeded5664lb # [ 136.414802] niks3-server[1032]: 2026/09/20 09:34:56 INFO Received uploads request method=POST path=/api/pending_closures5665worker2 # [ 136.435089] nix-grpc-daemon[1685]: time=2026-09-20T09:34:56.056Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5666worker2 # [ 136.436725] nix-grpc-daemon[1685]: time=2026-09-20T09:34:56.056Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5667lb # [ 136.445238] niks3-server[1032]: 2026/09/20 09:34:57 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5668lb # [ 136.461239] niks3-server[1032]: 2026/09/20 09:34:57 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5669worker2 # [ 136.489102] nix-grpc-daemon[1685]: time=2026-09-20T09:34:56.112Z level=INFO msg="Uploading 1 narinfos"5670lb # [ 136.472980] niks3-server[1032]: 2026/09/20 09:34:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5671lb # [ 136.482929] niks3-server[1032]: 2026/09/20 09:34:57 INFO Signed narinfos id=44 count=15672lb # [ 136.490291] niks3-server[1032]: 2026/09/20 09:34:57 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5673lb # [ 136.499070] niks3-server[1032]: 2026/09/20 09:34:57 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5674worker2 # [ 136.513904] nix-grpc-daemon[1685]: time=2026-09-20T09:34:56.137Z level=INFO msg="Upload complete. (290ms)"5675lb # [ 136.506680] niks3-server[1032]: 2026/09/20 09:34:57 INFO Completed upload id=445676lb # [ 136.510851] niks3-server[1032]: 2026/09/20 09:34:57 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5677worker2 # [ 136.525934] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15678worker2 # [ 136.541248] nix-daemon[836]: reaped child process 1842, status = succeeded5679client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.56 seconds)5680client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5681client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.24 seconds)5682worker1: must succeed: pkill -f 'read -t [9]0 x'5683worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5684client: waiting for success: ! systemctl is-active sw5685worker1 # [ 136.910642] nix-daemon[836]: reaped child process 1352, status = succeeded5686worker1 # [ 137.072122] nix-daemon[836]: accepted connection from pid 1393, user nix-grpc-daemon (trusted)5687worker1 # [ 137.090440] nix-daemon[836]: reaped child process 1396, status = succeeded5688lb # [ 137.094072] niks3-server[1032]: 2026/09/20 09:34:57 INFO Received uploads request method=POST path=/api/pending_closures5689worker1 # [ 137.112408] nix-grpc-daemon[1296]: time=2026-09-20T09:34:56.731Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5690worker1 # [ 137.114013] nix-grpc-daemon[1296]: time=2026-09-20T09:34:56.731Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5691lb # [ 137.131632] niks3-server[1032]: 2026/09/20 09:34:57 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5692lb # [ 137.147150] niks3-server[1032]: 2026/09/20 09:34:57 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5693lb # [ 137.155491] niks3-server[1032]: 2026/09/20 09:34:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5694lb # [ 137.161461] niks3-server[1032]: 2026/09/20 09:34:57 INFO Signed narinfos id=45 count=15695worker1 # [ 137.170023] nix-grpc-daemon[1296]: time=2026-09-20T09:34:56.788Z level=INFO msg="Uploading 1 narinfos"5696lb # [ 137.166303] niks3-server[1032]: 2026/09/20 09:34:57 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5697lb # [ 137.176113] niks3-server[1032]: 2026/09/20 09:34:57 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5698worker1 # [ 137.191516] nix-grpc-daemon[1296]: time=2026-09-20T09:34:56.810Z level=INFO msg="Upload complete. (294ms)"5699lb # [ 137.185184] niks3-server[1032]: 2026/09/20 09:34:57 INFO Completed upload id=455700lb # [ 137.189515] niks3-server[1032]: 2026/09/20 09:34:57 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5701worker1 # [ 137.204983] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50610 duration_s=9 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15702worker1 # [ 137.217106] nix-daemon[836]: reaped child process 1350, status = succeeded5703client # [ 137.271970] systemd[1]: sw.service: Deactivated successfully.5704client # [ 137.277321] systemd[1]: sw.service: Consumed 153ms CPU time over 10.065s wall clock time, 37M memory peak, 8.3K incoming IP traffic, 8.9K outgoing IP traffic.5705worker1 # [ 137.827702] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:57Z level=info event=signal_exit5706client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5707client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5708client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5709worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5710worker2 # [ 139.074312] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:600885711worker2 # [ 139.074660] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:58Z level=info event=worker_gone addr=192.168.1.3:500515712worker1 # [ 139.080931] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:58Z level=info event=scheduler_restarting5713worker1 # [ 139.097679] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:58Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5714worker1 # [ 139.124702] nix-daemon[836]: reaped child process 1248, status = succeeded5715worker1 # [ 139.311938] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5716worker1 # [ 139.315063] systemd[1]: nix-grpc-daemon.service: Consumed 907ms CPU time over 40.718s wall clock time, 33.4M memory peak, 24.2K incoming IP traffic, 35.1K outgoing IP traffic.5717worker1 # [ 139.336477] systemd[1]: Starting Nix worker-protocol over gRPC...5718worker1 # [ 139.535965] nix-grpc-daemon[1410]: ts=2026-09-20T09:34:59Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5719worker1 # [ 139.538413] nix-grpc-daemon[1410]: ts=2026-09-20T09:34:59Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15720worker1 # [ 139.545959] nix-grpc-daemon[1410]: ts=2026-09-20T09:34:59Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5721worker1 # [ 139.547754] systemd[1]: Started Nix worker-protocol over gRPC.5722worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.52 seconds)5723lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5724lb: must succeed: curl -sf localhost:9901/clusters5725worker1 # [ 139.589245] nix-grpc-daemon[1410]: ts=2026-09-20T09:34:59Z level=info event=scheduler_connected addr=lb:500515726worker2 # [ 139.594098] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:59Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05727lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5728lb: must succeed: curl -sf localhost:9901/clusters5729lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5730lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds)5731lb: must succeed: curl -sf localhost:9901/clusters5732lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5733worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5734worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5735(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 13.78 seconds)5736subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5737client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15738lb # [ 140.925101] envoy[913]: conn peer=[2001:db8:1::1]:54904 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9599 tx=3874 ms=62685739lb # [ 140.930311] envoy[913]: conn peer=[2001:db8:1::1]:54902 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2935 tx=1332 ms=97955740lb # [ 140.935750] envoy[913]: conn peer=[2001:db8:1::3]:46348 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3202 tx=1002 ms=402365741worker1 # [ 141.150463] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:365845742worker1 # [ 141.166320] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5743worker1 # [ 141.187348] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365845744worker1 # [ 141.202949] nix-grpc-daemon[1410]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 1/5)5745worker1 # [ 141.223913] nix-grpc-daemon[1410]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 2/5)5746worker1 # [ 141.316692] nix-grpc-daemon[1410]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 126 ms (attempt 3/5)5747worker1 # [ 141.450338] nix-grpc-daemon[1410]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 776 ms (attempt 4/5)5748worker1 # [ 142.237180] nix-grpc-daemon[1410]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5749worker2 # [ 142.290865] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:01Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05750worker2 # [ 142.296924] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:01Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15751worker2 # [ 142.302942] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:01Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05752worker2 # [ 142.308247] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:01Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05753worker1 # [ 142.336603] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365845754worker1 # [ 142.353861] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365845755worker1 # [ 142.368830] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365845756worker1 # [ 142.384361] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5757worker1 # [ 142.413772] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:02Z level=info event=niks3_push_started pid=14665758worker1 # [ 142.801935] nix-daemon[836]: accepted connection from pid 1479, user nix-grpc-daemon (trusted)5759worker1 # [ 142.819734] nix-daemon[836]: reaped child process 1482, status = succeeded5760worker1 # [ 142.996625] nix-daemon[836]: accepted connection from pid 1484, user nix-grpc-daemon (trusted)5761worker1 # [ 143.016551] nix-daemon[836]: reaped child process 1487, status = succeeded5762lb # [ 143.021552] niks3-server[1032]: 2026/09/20 09:35:03 INFO Received uploads request method=POST path=/api/pending_closures5763worker1 # [ 143.039650] nix-grpc-daemon[1466]: time=2026-09-20T09:35:02.657Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5764worker1 # [ 143.041553] nix-grpc-daemon[1466]: time=2026-09-20T09:35:02.657Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5765lb # [ 143.058732] niks3-server[1032]: 2026/09/20 09:35:03 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5766worker1 # [ 143.086393] nix-grpc-daemon[1466]: time=2026-09-20T09:35:02.704Z level=INFO msg="Uploading 1 narinfos"5767lb # [ 143.072568] niks3-server[1032]: 2026/09/20 09:35:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5768lb # [ 143.083063] niks3-server[1032]: 2026/09/20 09:35:03 INFO Signed narinfos id=46 count=15769lb # [ 143.091018] niks3-server[1032]: 2026/09/20 09:35:03 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5770lb # [ 143.099993] niks3-server[1032]: 2026/09/20 09:35:03 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5771worker1 # [ 143.113534] nix-grpc-daemon[1466]: time=2026-09-20T09:35:02.732Z level=INFO msg="Upload complete. (483ms)"5772lb # [ 143.107655] niks3-server[1032]: 2026/09/20 09:35:03 INFO Completed upload id=465773lb # [ 143.111591] niks3-server[1032]: 2026/09/20 09:35:03 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5774worker1 # [ 143.120278] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=5125775worker1 # [ 143.136485] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365845776worker1 # [ 143.142850] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5777worker1 # [ 143.147897] nix-daemon[836]: reaped child process 1464, status = succeeded5778worker1 # [ 143.161831] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5779worker1 # [ 144.196879] nix-daemon[836]: reaped child process 1491, status = succeeded5780worker1 # [ 144.368058] nix-daemon[836]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)5781worker1 # [ 144.385091] nix-daemon[836]: reaped child process 1509, status = succeeded5782lb # [ 144.391768] niks3-server[1032]: 2026/09/20 09:35:04 INFO Received uploads request method=POST path=/api/pending_closures5783worker1 # [ 144.412183] nix-grpc-daemon[1466]: time=2026-09-20T09:35:04.028Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5784worker1 # [ 144.413646] nix-grpc-daemon[1466]: time=2026-09-20T09:35:04.028Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5785lb # [ 144.426454] niks3-server[1032]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5786worker1 # [ 144.453833] nix-grpc-daemon[1466]: time=2026-09-20T09:35:04.073Z level=INFO msg="Uploading 1 narinfos"5787lb # [ 144.445910] niks3-server[1032]: 2026/09/20 09:35:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5788lb # [ 144.461003] niks3-server[1032]: 2026/09/20 09:35:05 INFO Signed narinfos id=47 count=15789lb # [ 144.469138] niks3-server[1032]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5790worker1 # [ 144.490076] nix-grpc-daemon[1466]: time=2026-09-20T09:35:04.109Z level=INFO msg="Upload complete. (318ms)"5791lb # [ 144.482171] niks3-server[1032]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5792lb # [ 144.486328] niks3-server[1032]: 2026/09/20 09:35:05 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5793lb # [ 144.491105] niks3-server[1032]: 2026/09/20 09:35:05 INFO Completed upload id=475794lb # [ 144.494317] niks3-server[1032]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5795worker2 # [ 144.502487] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:04Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15796worker1 # [ 144.499987] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=15797worker2 # [ 144.515990] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:04Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05798worker1 # [ 144.518225] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365845799worker1 # [ 144.524823] nix-daemon[836]: reaped child process 1489, status = succeeded5800worker1 # [ 144.532424] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365845801worker1 # [ 144.544271] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365845802worker1 # [ 144.554908] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5803worker1 # [ 144.741308] nix-daemon[836]: accepted connection from pid 1513, user nix-grpc-daemon (trusted)5804worker1 # [ 144.759355] nix-daemon[836]: reaped child process 1516, status = succeeded5805worker1 # [ 144.937251] nix-daemon[836]: accepted connection from pid 1518, user nix-grpc-daemon (trusted)5806worker1 # [ 144.955228] nix-daemon[836]: reaped child process 1521, status = succeeded5807lb # [ 144.960760] niks3-server[1032]: 2026/09/20 09:35:05 INFO Received uploads request method=POST path=/api/pending_closures5808worker1 # [ 144.977284] nix-grpc-daemon[1466]: time=2026-09-20T09:35:04.596Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5809worker1 # [ 144.978827] nix-grpc-daemon[1466]: time=2026-09-20T09:35:04.596Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5810lb # [ 144.990250] niks3-server[1032]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5811worker1 # [ 145.009701] nix-grpc-daemon[1466]: time=2026-09-20T09:35:04.628Z level=INFO msg="Uploading 1 narinfos"5812lb # [ 145.003582] niks3-server[1032]: 2026/09/20 09:35:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5813lb # [ 145.015467] niks3-server[1032]: 2026/09/20 09:35:05 INFO Signed narinfos id=48 count=15814lb # [ 145.025672] niks3-server[1032]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5815lb # [ 145.030866] niks3-server[1032]: 2026/09/20 09:35:05 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5816worker1 # [ 145.044218] nix-grpc-daemon[1466]: time=2026-09-20T09:35:04.663Z level=INFO msg="Upload complete. (477ms)"5817lb # [ 145.037078] niks3-server[1032]: 2026/09/20 09:35:05 INFO Completed upload id=485818lb # [ 145.041705] niks3-server[1032]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5819worker1 # [ 145.052131] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=5125820worker1 # [ 145.064253] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365845821worker1 # [ 145.070583] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5822worker1 # [ 145.075567] nix-daemon[836]: reaped child process 1511, status = succeeded5823worker1 # [ 145.088651] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5824worker1 # [ 146.327651] nix-daemon[836]: reaped child process 1525, status = succeeded5825worker1 # [ 146.498908] nix-daemon[836]: accepted connection from pid 1540, user nix-grpc-daemon (trusted)5826worker1 # [ 146.517144] nix-daemon[836]: reaped child process 1543, status = succeeded5827lb # [ 146.521666] niks3-server[1032]: 2026/09/20 09:35:07 INFO Received uploads request method=POST path=/api/pending_closures5828worker1 # [ 146.540371] nix-grpc-daemon[1466]: time=2026-09-20T09:35:06.158Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5829worker1 # [ 146.541901] nix-grpc-daemon[1466]: time=2026-09-20T09:35:06.158Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5830lb # [ 146.563308] niks3-server[1032]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5831lb # [ 146.579571] niks3-server[1032]: 2026/09/20 09:35:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5832lb # [ 146.591434] niks3-server[1032]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5833lb # [ 146.598821] niks3-server[1032]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5834worker1 # [ 146.607121] nix-grpc-daemon[1466]: time=2026-09-20T09:35:06.225Z level=INFO msg="Uploading 1 narinfos"5835lb # [ 146.604144] niks3-server[1032]: 2026/09/20 09:35:07 INFO Signed narinfos id=49 count=15836lb # [ 146.614656] niks3-server[1032]: 2026/09/20 09:35:07 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5837lb # [ 146.624313] niks3-server[1032]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5838lb # [ 146.633922] niks3-server[1032]: 2026/09/20 09:35:07 INFO Completed upload id=495839worker1 # [ 146.641946] nix-grpc-daemon[1466]: time=2026-09-20T09:35:06.261Z level=INFO msg="Upload complete. (343ms)"5840worker2 # [ 146.651737] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:06Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15841worker1 # [ 146.653321] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=15842worker2 # [ 146.666424] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:06Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05843worker1 # [ 146.675982] nix-daemon[836]: reaped child process 1523, status = succeeded5844worker1 # [ 146.704494] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365845845worker1 # [ 146.721672] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365845846worker1 # [ 146.736674] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365845847worker1 # [ 146.750638] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5848worker1 # [ 146.961140] nix-daemon[836]: accepted connection from pid 1547, user nix-grpc-daemon (trusted)5849worker1 # [ 146.981552] nix-daemon[836]: reaped child process 1550, status = succeeded5850worker1 # [ 147.155827] nix-daemon[836]: accepted connection from pid 1552, user nix-grpc-daemon (trusted)5851worker1 # [ 147.173048] nix-daemon[836]: reaped child process 1555, status = succeeded5852lb # [ 147.178634] niks3-server[1032]: 2026/09/20 09:35:07 INFO Received uploads request method=POST path=/api/pending_closures5853worker1 # [ 147.198462] nix-grpc-daemon[1466]: time=2026-09-20T09:35:06.817Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5854worker1 # [ 147.199978] nix-grpc-daemon[1466]: time=2026-09-20T09:35:06.817Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5855lb # [ 147.212339] niks3-server[1032]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5856lb # [ 147.224747] niks3-server[1032]: 2026/09/20 09:35:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5857worker1 # [ 147.238823] nix-grpc-daemon[1466]: time=2026-09-20T09:35:06.857Z level=INFO msg="Uploading 1 narinfos"5858lb # [ 147.235040] niks3-server[1032]: 2026/09/20 09:35:07 INFO Signed narinfos id=50 count=15859lb # [ 147.241281] niks3-server[1032]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5860lb # [ 147.248420] niks3-server[1032]: 2026/09/20 09:35:07 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5861lb # [ 147.254185] niks3-server[1032]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5862lb # [ 147.258926] niks3-server[1032]: 2026/09/20 09:35:07 INFO Completed upload id=505863worker1 # [ 147.266833] nix-grpc-daemon[1466]: time=2026-09-20T09:35:06.885Z level=INFO msg="Upload complete. (500ms)"5864worker1 # [ 147.274472] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=5125865worker1 # [ 147.287651] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365845866worker1 # [ 147.294264] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5867worker1 # [ 147.298954] nix-daemon[836]: reaped child process 1545, status = succeeded5868worker1 # [ 147.312596] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5869worker1 # [ 148.155380] nix-daemon[836]: reaped child process 1559, status = succeeded5870worker1 # [ 148.334703] nix-daemon[836]: accepted connection from pid 1574, user nix-grpc-daemon (trusted)5871worker1 # [ 148.352386] nix-daemon[836]: reaped child process 1577, status = succeeded5872lb # [ 148.356992] niks3-server[1032]: 2026/09/20 09:35:08 INFO Received uploads request method=POST path=/api/pending_closures5873worker1 # [ 148.373902] nix-grpc-daemon[1466]: time=2026-09-20T09:35:07.992Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5874worker1 # [ 148.377048] nix-grpc-daemon[1466]: time=2026-09-20T09:35:07.992Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5875lb # [ 148.397135] niks3-server[1032]: 2026/09/20 09:35:08 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5876worker1 # [ 148.415424] nix-grpc-daemon[1466]: time=2026-09-20T09:35:08.034Z level=INFO msg="Uploading 1 narinfos"5877lb # [ 148.409214] niks3-server[1032]: 2026/09/20 09:35:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5878lb # [ 148.422031] niks3-server[1032]: 2026/09/20 09:35:08 INFO Signed narinfos id=51 count=15879lb # [ 148.426495] niks3-server[1032]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5880worker1 # [ 148.440866] nix-grpc-daemon[1466]: time=2026-09-20T09:35:08.060Z level=INFO msg="Upload complete. (317ms)"5881lb # [ 148.433576] niks3-server[1032]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5882lb # [ 148.439824] niks3-server[1032]: 2026/09/20 09:35:09 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5883lb # [ 148.443983] niks3-server[1032]: 2026/09/20 09:35:09 INFO Completed upload id=515884worker2 # [ 148.449882] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:08Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15885lb # [ 148.446050] niks3-server[1032]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5886worker1 # [ 148.452938] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=15887worker2 # [ 148.462778] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:08Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05888worker1 # [ 148.468263] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365845889worker1 # [ 148.474626] nix-daemon[836]: reaped child process 1557, status = succeeded5890worker1 # [ 148.478587] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365845891worker1 # [ 148.486779] nix-grpc-daemon[1466]: time=2026-09-20T09:35:08.105Z level=INFO msg="All 1 paths already cached"5892worker1 # [ 148.493974] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365845893worker1 # [ 148.503981] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5894worker1 # [ 148.694591] nix-daemon[836]: accepted connection from pid 1581, user nix-grpc-daemon (trusted)5895worker1 # [ 148.713783] nix-daemon[836]: reaped child process 1584, status = succeeded5896worker1 # [ 148.890310] nix-daemon[836]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)5897worker1 # [ 148.909232] nix-daemon[836]: reaped child process 1589, status = succeeded5898lb # [ 148.912629] niks3-server[1032]: 2026/09/20 09:35:09 INFO Received uploads request method=POST path=/api/pending_closures5899worker1 # [ 148.929193] nix-grpc-daemon[1466]: time=2026-09-20T09:35:08.548Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5900worker1 # [ 148.930731] nix-grpc-daemon[1466]: time=2026-09-20T09:35:08.548Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5901lb # [ 148.939876] niks3-server[1032]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5902lb # [ 148.953727] niks3-server[1032]: 2026/09/20 09:35:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5903worker1 # [ 148.971186] nix-grpc-daemon[1466]: time=2026-09-20T09:35:08.590Z level=INFO msg="Uploading 1 narinfos"5904lb # [ 148.965666] niks3-server[1032]: 2026/09/20 09:35:09 INFO Signed narinfos id=52 count=15905lb # [ 148.971774] niks3-server[1032]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5906lb # [ 148.980179] niks3-server[1032]: 2026/09/20 09:35:09 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5907worker1 # [ 148.994503] nix-grpc-daemon[1466]: time=2026-09-20T09:35:08.613Z level=INFO msg="Upload complete. (479ms)"5908lb # [ 148.987217] niks3-server[1032]: 2026/09/20 09:35:09 INFO Completed upload id=525909lb # [ 148.990798] niks3-server[1032]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5910worker1 # [ 149.000238] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=6245911worker1 # [ 149.014145] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365845912worker1 # [ 149.019904] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5913worker1 # [ 149.024919] nix-daemon[836]: reaped child process 1579, status = succeeded5914worker1 # [ 149.038678] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5915worker1 # [ 150.064456] nix-daemon[836]: reaped child process 1593, status = succeeded5916worker1 # [ 150.229870] nix-daemon[836]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)5917worker1 # [ 150.249016] nix-daemon[836]: reaped child process 1611, status = succeeded5918lb # [ 150.255246] niks3-server[1032]: 2026/09/20 09:35:10 INFO Received uploads request method=POST path=/api/pending_closures5919worker1 # [ 150.276431] nix-grpc-daemon[1466]: time=2026-09-20T09:35:09.892Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5920worker1 # [ 150.278015] nix-grpc-daemon[1466]: time=2026-09-20T09:35:09.893Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5921lb # [ 150.294555] niks3-server[1032]: 2026/09/20 09:35:10 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5922lb # [ 150.308806] niks3-server[1032]: 2026/09/20 09:35:10 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5923lb # [ 150.322918] niks3-server[1032]: 2026/09/20 09:35:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5924worker1 # [ 150.335972] nix-grpc-daemon[1466]: time=2026-09-20T09:35:09.954Z level=INFO msg="Uploading 1 narinfos"5925lb # [ 150.331424] niks3-server[1032]: 2026/09/20 09:35:10 INFO Signed narinfos id=53 count=15926lb # [ 150.336864] niks3-server[1032]: 2026/09/20 09:35:10 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5927lb # [ 150.343366] niks3-server[1032]: 2026/09/20 09:35:10 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5928lb # [ 150.349530] niks3-server[1032]: 2026/09/20 09:35:10 INFO Completed upload id=535929worker1 # [ 150.357019] nix-grpc-daemon[1466]: time=2026-09-20T09:35:09.976Z level=INFO msg="Upload complete. (308ms)"5930lb # [ 150.351860] niks3-server[1032]: 2026/09/20 09:35:10 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5931worker2 # [ 150.366621] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:09Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15932worker1 # [ 150.371407] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=15933worker2 # [ 150.380571] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:10Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05934worker1 # [ 150.395644] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365845935worker1 # [ 150.399889] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365845936worker1 # [ 150.405002] nix-daemon[836]: reaped child process 1591, status = succeeded5937worker1 # [ 150.410926] nix-grpc-daemon[1466]: time=2026-09-20T09:35:10.030Z level=INFO msg="All 1 paths already cached"5938worker1 # [ 150.418134] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365845939worker1 # [ 150.429141] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5940worker1 # [ 150.629088] nix-daemon[836]: accepted connection from pid 1615, user nix-grpc-daemon (trusted)5941worker1 # [ 150.646588] nix-daemon[836]: reaped child process 1618, status = succeeded5942worker1 # [ 150.819611] nix-daemon[836]: accepted connection from pid 1620, user nix-grpc-daemon (trusted)5943worker1 # [ 150.835898] nix-daemon[836]: reaped child process 1623, status = succeeded5944lb # [ 150.842832] niks3-server[1032]: 2026/09/20 09:35:11 INFO Received uploads request method=POST path=/api/pending_closures5945worker1 # [ 150.859999] nix-grpc-daemon[1466]: time=2026-09-20T09:35:10.478Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5946worker1 # [ 150.861725] nix-grpc-daemon[1466]: time=2026-09-20T09:35:10.478Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5947lb # [ 150.870901] niks3-server[1032]: 2026/09/20 09:35:11 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5948worker1 # [ 150.892281] nix-grpc-daemon[1466]: time=2026-09-20T09:35:10.511Z level=INFO msg="Uploading 1 narinfos"5949lb # [ 150.885292] niks3-server[1032]: 2026/09/20 09:35:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5950lb # [ 150.895989] niks3-server[1032]: 2026/09/20 09:35:11 INFO Signed narinfos id=54 count=15951lb # [ 150.902499] niks3-server[1032]: 2026/09/20 09:35:11 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5952lb # [ 150.910066] niks3-server[1032]: 2026/09/20 09:35:11 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5953lb # [ 150.916295] niks3-server[1032]: 2026/09/20 09:35:11 INFO Completed upload id=545954worker1 # [ 150.924092] nix-grpc-daemon[1466]: time=2026-09-20T09:35:10.543Z level=INFO msg="Upload complete. (481ms)"5955lb # [ 150.919400] niks3-server[1032]: 2026/09/20 09:35:11 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5956worker1 # [ 150.932172] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=6245957worker1 # [ 150.943943] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365845958worker1 # [ 150.949715] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5959worker1 # [ 150.954663] nix-daemon[836]: reaped child process 1613, status = succeeded5960worker1 # [ 150.967640] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5961worker1 # [ 152.215929] nix-daemon[836]: reaped child process 1627, status = succeeded5962worker1 # [ 152.399590] nix-daemon[836]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)5963worker1 # [ 152.420395] nix-daemon[836]: reaped child process 1645, status = succeeded5964lb # [ 152.424758] niks3-server[1032]: 2026/09/20 09:35:13 INFO Received uploads request method=POST path=/api/pending_closures5965worker1 # [ 152.442756] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.061Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5966worker1 # [ 152.447807] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.063Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5967lb # [ 152.466070] niks3-server[1032]: 2026/09/20 09:35:13 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5968lb # [ 152.478216] niks3-server[1032]: 2026/09/20 09:35:13 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5969worker1 # [ 152.498255] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.117Z level=INFO msg="Uploading 1 narinfos"5970lb # [ 152.492345] niks3-server[1032]: 2026/09/20 09:35:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5971lb # [ 152.495757] niks3-server[1032]: 2026/09/20 09:35:13 INFO Signed narinfos id=55 count=15972lb # [ 152.506215] niks3-server[1032]: 2026/09/20 09:35:13 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5973lb # [ 152.511947] niks3-server[1032]: 2026/09/20 09:35:13 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5974lb # [ 152.515785] niks3-server[1032]: 2026/09/20 09:35:13 INFO Completed upload id=555975worker1 # [ 152.523738] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.142Z level=INFO msg="Upload complete. (345ms)"5976lb # [ 152.518258] niks3-server[1032]: 2026/09/20 09:35:13 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5977worker2 # [ 152.533549] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:12Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15978worker1 # [ 152.538092] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=15979worker2 # [ 152.546990] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:12Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05980worker1 # [ 152.561022] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365845981worker1 # [ 152.565383] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365845982worker1 # [ 152.571601] nix-daemon[836]: reaped child process 1625, status = succeeded5983worker1 # [ 152.579910] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.199Z level=INFO msg="All 1 paths already cached"5984worker1 # [ 152.587885] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365845985worker1 # [ 152.599524] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5986worker1 # [ 152.790590] nix-daemon[836]: accepted connection from pid 1649, user nix-grpc-daemon (trusted)5987worker1 # [ 152.812301] nix-daemon[836]: reaped child process 1652, status = succeeded5988worker1 # [ 152.995473] nix-daemon[836]: accepted connection from pid 1654, user nix-grpc-daemon (trusted)5989worker1 # [ 153.014079] nix-daemon[836]: reaped child process 1657, status = succeeded5990lb # [ 153.017284] niks3-server[1032]: 2026/09/20 09:35:13 INFO Received uploads request method=POST path=/api/pending_closures5991worker1 # [ 153.039798] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.658Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5992worker1 # [ 153.041537] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.658Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5993lb # [ 153.054418] niks3-server[1032]: 2026/09/20 09:35:13 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5994worker1 # [ 153.076038] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.695Z level=INFO msg="Uploading 1 narinfos"5995lb # [ 153.071091] niks3-server[1032]: 2026/09/20 09:35:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5996lb # [ 153.081223] niks3-server[1032]: 2026/09/20 09:35:13 INFO Signed narinfos id=56 count=15997lb # [ 153.083767] niks3-server[1032]: 2026/09/20 09:35:13 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5998lb # [ 153.094553] niks3-server[1032]: 2026/09/20 09:35:13 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5999lb # [ 153.099793] niks3-server[1032]: 2026/09/20 09:35:13 INFO Completed upload id=566000worker1 # [ 153.101088] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.720Z level=INFO msg="Upload complete. (489ms)"6001lb # [ 153.103069] niks3-server[1032]: 2026/09/20 09:35:13 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6002worker1 # [ 153.111605] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=6246003worker1 # [ 153.123909] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365846004worker1 # [ 153.130901] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6005worker1 # [ 153.137387] nix-daemon[836]: reaped child process 1647, status = succeeded6006worker1 # [ 153.152199] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6007worker1 # [ 154.590605] nix-daemon[836]: reaped child process 1661, status = succeeded6008worker1 # [ 154.768875] nix-daemon[836]: accepted connection from pid 1676, user nix-grpc-daemon (trusted)6009worker1 # [ 154.790658] nix-daemon[836]: reaped child process 1679, status = succeeded6010lb # [ 154.797514] niks3-server[1032]: 2026/09/20 09:35:15 INFO Received uploads request method=POST path=/api/pending_closures6011worker1 # [ 154.816456] nix-grpc-daemon[1466]: time=2026-09-20T09:35:14.434Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6012worker1 # [ 154.819948] nix-grpc-daemon[1466]: time=2026-09-20T09:35:14.434Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6013lb # [ 154.847951] niks3-server[1032]: 2026/09/20 09:35:15 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6014lb # [ 154.862588] niks3-server[1032]: 2026/09/20 09:35:15 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6015lb # [ 154.874015] niks3-server[1032]: 2026/09/20 09:35:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6016worker1 # [ 154.886867] nix-grpc-daemon[1466]: time=2026-09-20T09:35:14.505Z level=INFO msg="Uploading 1 narinfos"6017lb # [ 154.883257] niks3-server[1032]: 2026/09/20 09:35:15 INFO Signed narinfos id=57 count=16018lb # [ 154.887295] niks3-server[1032]: 2026/09/20 09:35:15 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6019lb # [ 154.892336] niks3-server[1032]: 2026/09/20 09:35:15 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6020lb # [ 154.899598] niks3-server[1032]: 2026/09/20 09:35:15 INFO Completed upload id=576021worker1 # [ 154.908254] nix-grpc-daemon[1466]: time=2026-09-20T09:35:14.526Z level=INFO msg="Upload complete. (343ms)"6022lb # [ 154.902338] niks3-server[1032]: 2026/09/20 09:35:15 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6023worker2 # [ 154.918066] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:14Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16024worker2 # [ 154.932785] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:14Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06025worker1 # [ 154.921394] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=16026worker1 # [ 154.940382] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365846027worker1 # [ 154.952151] nix-daemon[836]: reaped child process 1659, status = succeeded6028worker1 # [ 154.958493] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365846029worker1 # [ 154.973238] nix-grpc-daemon[1466]: time=2026-09-20T09:35:14.592Z level=INFO msg="All 2 paths already cached"6030worker1 # [ 154.982968] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365846031worker1 # [ 154.996243] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6032worker1 # [ 155.200176] nix-daemon[836]: accepted connection from pid 1683, user nix-grpc-daemon (trusted)6033worker1 # [ 155.220356] nix-daemon[836]: reaped child process 1686, status = succeeded6034worker1 # [ 155.417965] nix-daemon[836]: accepted connection from pid 1688, user nix-grpc-daemon (trusted)6035worker1 # [ 155.437832] nix-daemon[836]: reaped child process 1691, status = succeeded6036lb # [ 155.441702] niks3-server[1032]: 2026/09/20 09:35:16 INFO Received uploads request method=POST path=/api/pending_closures6037worker1 # [ 155.459899] nix-grpc-daemon[1466]: time=2026-09-20T09:35:15.078Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6038worker1 # [ 155.461635] nix-grpc-daemon[1466]: time=2026-09-20T09:35:15.078Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6039lb # [ 155.477790] niks3-server[1032]: 2026/09/20 09:35:16 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6040worker1 # [ 155.497918] nix-grpc-daemon[1466]: time=2026-09-20T09:35:15.116Z level=INFO msg="Uploading 1 narinfos"6041lb # [ 155.494604] niks3-server[1032]: 2026/09/20 09:35:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6042lb # [ 155.505016] niks3-server[1032]: 2026/09/20 09:35:16 INFO Signed narinfos id=58 count=16043lb # [ 155.507491] niks3-server[1032]: 2026/09/20 09:35:16 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6044lb # [ 155.515553] niks3-server[1032]: 2026/09/20 09:35:16 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6045lb # [ 155.521781] niks3-server[1032]: 2026/09/20 09:35:16 INFO Completed upload id=586046worker1 # [ 155.529655] nix-grpc-daemon[1466]: time=2026-09-20T09:35:15.148Z level=INFO msg="Upload complete. (519ms)"6047lb # [ 155.524453] niks3-server[1032]: 2026/09/20 09:35:16 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6048worker1 # [ 155.540581] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=7526049worker1 # [ 155.547409] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365846050worker1 # [ 155.561217] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6051worker1 # [ 155.571518] nix-daemon[836]: reaped child process 1681, status = succeeded6052worker1 # [ 155.579002] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6053worker1 # [ 156.608293] nix-daemon[836]: reaped child process 1695, status = succeeded6054worker1 # [ 156.791360] nix-daemon[836]: accepted connection from pid 1710, user nix-grpc-daemon (trusted)6055worker1 # [ 156.818085] nix-daemon[836]: reaped child process 1713, status = succeeded6056lb # [ 156.825303] niks3-server[1032]: 2026/09/20 09:35:17 INFO Received uploads request method=POST path=/api/pending_closures6057worker1 # [ 156.848620] nix-grpc-daemon[1466]: time=2026-09-20T09:35:16.464Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6058worker1 # [ 156.851487] nix-grpc-daemon[1466]: time=2026-09-20T09:35:16.465Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6059lb # [ 156.879296] niks3-server[1032]: 2026/09/20 09:35:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6060worker1 # [ 156.897653] nix-grpc-daemon[1466]: time=2026-09-20T09:35:16.516Z level=INFO msg="Uploading 1 narinfos"6061lb # [ 156.896753] niks3-server[1032]: 2026/09/20 09:35:17 INFO Signed narinfos id=59 count=16062lb # [ 156.907380] niks3-server[1032]: 2026/09/20 09:35:17 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6063lb # [ 156.920404] niks3-server[1032]: 2026/09/20 09:35:17 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6064lb # [ 156.926668] niks3-server[1032]: 2026/09/20 09:35:17 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6065worker1 # [ 156.938737] nix-grpc-daemon[1466]: time=2026-09-20T09:35:16.557Z level=INFO msg="Upload complete. (347ms)"6066lb # [ 156.931553] niks3-server[1032]: 2026/09/20 09:35:17 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6067lb # [ 156.935670] niks3-server[1032]: 2026/09/20 09:35:17 INFO Completed upload id=596068lb # [ 156.939619] niks3-server[1032]: 2026/09/20 09:35:17 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6069worker2 # [ 156.951001] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:16Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16070worker1 # [ 156.954228] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=16071worker1 # [ 156.973311] nix-daemon[836]: reaped child process 1693, status = succeeded6072worker1 # [ 156.997376] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365846073worker1 # [ 157.020980] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365846074worker1 # [ 157.038131] nix-grpc-daemon[1466]: time=2026-09-20T09:35:16.657Z level=INFO msg="All 2 paths already cached"6075worker1 # [ 157.048692] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365846076worker1 # [ 157.064262] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6077worker1 # [ 157.277311] nix-daemon[836]: accepted connection from pid 1717, user nix-grpc-daemon (trusted)6078worker1 # [ 157.295566] nix-daemon[836]: reaped child process 1720, status = succeeded6079worker1 # [ 157.468643] nix-daemon[836]: accepted connection from pid 1722, user nix-grpc-daemon (trusted)6080worker1 # [ 157.486263] nix-daemon[836]: reaped child process 1725, status = succeeded6081lb # [ 157.489871] niks3-server[1032]: 2026/09/20 09:35:18 INFO Received uploads request method=POST path=/api/pending_closures6082worker1 # [ 157.507222] nix-grpc-daemon[1466]: time=2026-09-20T09:35:17.126Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6083worker1 # [ 157.509370] nix-grpc-daemon[1466]: time=2026-09-20T09:35:17.128Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6084lb # [ 157.520996] niks3-server[1032]: 2026/09/20 09:35:18 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6085worker1 # [ 157.542998] nix-grpc-daemon[1466]: time=2026-09-20T09:35:17.162Z level=INFO msg="Uploading 1 narinfos"6086lb # [ 157.535054] niks3-server[1032]: 2026/09/20 09:35:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6087lb # [ 157.546742] niks3-server[1032]: 2026/09/20 09:35:18 INFO Signed narinfos id=60 count=16088lb # [ 157.553028] niks3-server[1032]: 2026/09/20 09:35:18 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6089lb # [ 157.563334] niks3-server[1032]: 2026/09/20 09:35:18 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6090lb # [ 157.572113] niks3-server[1032]: 2026/09/20 09:35:18 INFO Completed upload id=606091worker1 # [ 157.579345] nix-grpc-daemon[1466]: time=2026-09-20T09:35:17.198Z level=INFO msg="Upload complete. (495ms)"6092lb # [ 157.574057] niks3-server[1032]: 2026/09/20 09:35:18 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6093worker1 # [ 157.589051] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=7526094worker1 # [ 157.603495] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365846095worker1 # [ 157.612682] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6096worker1 # [ 157.617886] nix-daemon[836]: reaped child process 1715, status = succeeded6097worker1 # [ 157.632242] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6098worker1 # [ 159.074825] nix-daemon[836]: reaped child process 1729, status = succeeded6099worker1 # [ 159.263015] nix-daemon[836]: accepted connection from pid 1744, user nix-grpc-daemon (trusted)6100worker1 # [ 159.281251] nix-daemon[836]: reaped child process 1747, status = succeeded6101lb # [ 159.285378] niks3-server[1032]: 2026/09/20 09:35:19 INFO Received uploads request method=POST path=/api/pending_closures6102worker1 # [ 159.306146] nix-grpc-daemon[1466]: time=2026-09-20T09:35:18.923Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6103worker1 # [ 159.307785] nix-grpc-daemon[1466]: time=2026-09-20T09:35:18.923Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6104lb # [ 159.327732] niks3-server[1032]: 2026/09/20 09:35:19 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6105lb # [ 159.338968] niks3-server[1032]: 2026/09/20 09:35:19 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6106worker1 # [ 159.357899] nix-grpc-daemon[1466]: time=2026-09-20T09:35:18.976Z level=INFO msg="Uploading 1 narinfos"6107lb # [ 159.349588] niks3-server[1032]: 2026/09/20 09:35:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6108lb # [ 159.357207] niks3-server[1032]: 2026/09/20 09:35:19 INFO Signed narinfos id=61 count=16109lb # [ 159.359732] niks3-server[1032]: 2026/09/20 09:35:19 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6110lb # [ 159.371802] niks3-server[1032]: 2026/09/20 09:35:19 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6111lb # [ 159.377622] niks3-server[1032]: 2026/09/20 09:35:19 INFO Completed upload id=616112worker1 # [ 159.385495] nix-grpc-daemon[1466]: time=2026-09-20T09:35:19.004Z level=INFO msg="Upload complete. (340ms)"6113lb # [ 159.380669] niks3-server[1032]: 2026/09/20 09:35:19 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6114worker2 # [ 159.397164] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:19Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16115worker1 # [ 159.401165] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=16116worker1 # [ 159.416461] nix-daemon[836]: reaped child process 1727, status = succeeded6117worker1 # [ 159.440761] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365846118worker1 # [ 159.457194] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365846119worker1 # [ 159.472615] nix-grpc-daemon[1466]: time=2026-09-20T09:35:19.091Z level=INFO msg="All 2 paths already cached"6120worker1 # [ 159.484500] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365846121worker1 # [ 159.499193] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6122worker1 # [ 159.699966] nix-daemon[836]: accepted connection from pid 1751, user nix-grpc-daemon (trusted)6123worker1 # [ 159.719569] nix-daemon[836]: reaped child process 1754, status = succeeded6124worker1 # [ 159.890837] nix-daemon[836]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)6125worker1 # [ 159.909653] nix-daemon[836]: reaped child process 1759, status = succeeded6126lb # [ 159.915012] niks3-server[1032]: 2026/09/20 09:35:20 INFO Received uploads request method=POST path=/api/pending_closures6127worker1 # [ 159.933792] nix-grpc-daemon[1466]: time=2026-09-20T09:35:19.552Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6128worker1 # [ 159.935341] nix-grpc-daemon[1466]: time=2026-09-20T09:35:19.552Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6129lb # [ 159.948567] niks3-server[1032]: 2026/09/20 09:35:20 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6130worker1 # [ 159.965498] nix-grpc-daemon[1466]: time=2026-09-20T09:35:19.584Z level=INFO msg="Uploading 1 narinfos"6131lb # [ 159.962445] niks3-server[1032]: 2026/09/20 09:35:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6132lb # [ 159.972974] niks3-server[1032]: 2026/09/20 09:35:20 INFO Signed narinfos id=62 count=16133lb # [ 159.976873] niks3-server[1032]: 2026/09/20 09:35:20 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6134lb # [ 159.984325] niks3-server[1032]: 2026/09/20 09:35:20 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6135lb # [ 159.988883] niks3-server[1032]: 2026/09/20 09:35:20 INFO Completed upload id=626136worker1 # [ 159.995930] nix-grpc-daemon[1466]: time=2026-09-20T09:35:19.615Z level=INFO msg="Upload complete. (478ms)"6137lb # [ 159.991456] niks3-server[1032]: 2026/09/20 09:35:20 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6138worker1 # [ 160.007148] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=7526139worker1 # [ 160.019483] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365846140worker1 # [ 160.026177] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6141worker1 # [ 160.030715] nix-daemon[836]: reaped child process 1749, status = succeeded6142worker1 # [ 160.044139] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6143worker1 # [ 161.693772] nix-daemon[836]: reaped child process 1763, status = succeeded6144worker1 # [ 161.868108] nix-daemon[836]: accepted connection from pid 1778, user nix-grpc-daemon (trusted)6145worker1 # [ 161.885007] nix-daemon[836]: reaped child process 1781, status = succeeded6146lb # [ 161.893307] niks3-server[1032]: 2026/09/20 09:35:22 INFO Received uploads request method=POST path=/api/pending_closures6147worker1 # [ 161.912487] nix-grpc-daemon[1466]: time=2026-09-20T09:35:21.530Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6148worker1 # [ 161.914406] nix-grpc-daemon[1466]: time=2026-09-20T09:35:21.530Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6149lb # [ 161.939480] niks3-server[1032]: 2026/09/20 09:35:22 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6150worker1 # [ 161.959107] nix-grpc-daemon[1466]: time=2026-09-20T09:35:21.577Z level=INFO msg="Uploading 1 narinfos"6151lb # [ 161.953824] niks3-server[1032]: 2026/09/20 09:35:22 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6152lb # [ 161.963196] niks3-server[1032]: 2026/09/20 09:35:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6153lb # [ 161.968918] niks3-server[1032]: 2026/09/20 09:35:22 INFO Signed narinfos id=63 count=16154lb # [ 161.974762] niks3-server[1032]: 2026/09/20 09:35:22 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6155lb # [ 161.978804] niks3-server[1032]: 2026/09/20 09:35:22 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6156lb # [ 161.983052] niks3-server[1032]: 2026/09/20 09:35:22 INFO Completed upload id=636157worker1 # [ 161.990482] nix-grpc-daemon[1466]: time=2026-09-20T09:35:21.609Z level=INFO msg="Upload complete. (333ms)"6158lb # [ 161.985733] niks3-server[1032]: 2026/09/20 09:35:22 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6159worker1 # [ 162.002616] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16160worker1 # [ 162.023164] nix-daemon[836]: reaped child process 1761, status = succeeded6161client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 21.19 seconds)6162worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6163worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.09 seconds)6164client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16165worker1 # [ 162.424409] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:365846166worker2 # [ 162.431180] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406966167worker2 # [ 162.458231] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:22Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06168lb # [ 170.928535] envoy[913]: conn peer=[2001:db8:1::1]:45972 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27161 tx=10811 ms=208746169client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.34 seconds)6170(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 51.62 seconds)6171subtest: low disk drains a worker and builds go to the other6172worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6173worker1 # [ 193.577757] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:53Z level=info event=unhealthy reason=min_free6174worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.23 seconds)6175worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6176worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.05 seconds)6177client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26178worker1 # [ 194.081877] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:365846179client # don't know how to build these paths:6180client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6181worker1 # [ 194.094883] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365846182worker2 # [ 194.136982] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:53Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06183worker2 # [ 194.146132] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:53Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16184worker2 # [ 194.156384] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406966185worker2 # [ 194.174601] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406966186client # copying 1 paths to 'lb:50051'...6187client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6188worker2 # [ 194.195746] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406966189worker2 # [ 194.219466] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)6190worker2 # [ 194.462687] nix-daemon[836]: accepted connection from pid 1889, user nix-grpc-daemon (trusted)6191worker2 # [ 194.483859] nix-daemon[836]: reaped child process 1892, status = succeeded6192worker2 # [ 194.670049] nix-daemon[836]: accepted connection from pid 1894, user nix-grpc-daemon (trusted)6193worker2 # [ 194.690399] nix-daemon[836]: reaped child process 1897, status = succeeded6194lb # [ 194.697324] niks3-server[1032]: 2026/09/20 09:35:55 INFO Received uploads request method=POST path=/api/pending_closures6195worker2 # [ 194.721557] nix-grpc-daemon[1685]: time=2026-09-20T09:35:54.343Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6196worker2 # [ 194.723067] nix-grpc-daemon[1685]: time=2026-09-20T09:35:54.343Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6197lb # [ 194.745699] niks3-server[1032]: 2026/09/20 09:35:55 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6198lb # [ 194.765182] niks3-server[1032]: 2026/09/20 09:35:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6199worker2 # [ 194.783500] nix-grpc-daemon[1685]: time=2026-09-20T09:35:54.406Z level=INFO msg="Uploading 1 narinfos"6200lb # [ 194.778693] niks3-server[1032]: 2026/09/20 09:35:55 INFO Signed narinfos id=64 count=16201lb # [ 194.783113] niks3-server[1032]: 2026/09/20 09:35:55 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6202lb # [ 194.799935] niks3-server[1032]: 2026/09/20 09:35:55 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6203lb # [ 194.812112] niks3-server[1032]: 2026/09/20 09:35:55 INFO Completed upload id=646204worker2 # [ 194.821450] nix-grpc-daemon[1685]: time=2026-09-20T09:35:54.444Z level=INFO msg="Upload complete. (581ms)"6205lb # [ 194.818938] niks3-server[1032]: 2026/09/20 09:35:55 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6206worker2 # [ 194.832461] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=0 paths=1 nar_bytes_in=5126207worker2 # [ 194.849618] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406966208worker2 # [ 194.863744] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)6209worker2 # [ 194.871213] nix-daemon[836]: reaped child process 1887, status = succeeded6210client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6211client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6212worker2 # [ 194.887840] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)6213client # farm-a> LOG-farm-a-drain6214worker2 # [ 196.130789] nix-daemon[836]: reaped child process 1901, status = succeeded6215worker2 # [ 196.297982] nix-daemon[836]: accepted connection from pid 1916, user nix-grpc-daemon (trusted)6216worker2 # [ 196.317434] nix-daemon[836]: reaped child process 1919, status = succeeded6217lb # [ 196.322204] niks3-server[1032]: 2026/09/20 09:35:56 INFO Received uploads request method=POST path=/api/pending_closures6218worker2 # [ 196.354526] nix-grpc-daemon[1685]: time=2026-09-20T09:35:55.976Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6219worker2 # [ 196.358907] nix-grpc-daemon[1685]: time=2026-09-20T09:35:55.977Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6220lb # [ 196.375432] niks3-server[1032]: 2026/09/20 09:35:56 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6221lb # [ 196.401681] niks3-server[1032]: 2026/09/20 09:35:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6222lb # [ 196.411305] niks3-server[1032]: 2026/09/20 09:35:56 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6223lb # [ 196.415173] niks3-server[1032]: 2026/09/20 09:35:56 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6224worker2 # [ 196.424229] nix-grpc-daemon[1685]: time=2026-09-20T09:35:56.046Z level=INFO msg="Uploading 1 narinfos"6225lb # [ 196.419341] niks3-server[1032]: 2026/09/20 09:35:56 INFO Signed narinfos id=65 count=16226lb # [ 196.426958] niks3-server[1032]: 2026/09/20 09:35:57 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6227lb # [ 196.433694] niks3-server[1032]: 2026/09/20 09:35:57 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6228lb # [ 196.436835] niks3-server[1032]: 2026/09/20 09:35:57 INFO Completed upload id=656229worker2 # [ 196.446349] nix-grpc-daemon[1685]: time=2026-09-20T09:35:56.069Z level=INFO msg="Upload complete. (345ms)"6230worker2 # [ 196.465218] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16231worker2 # [ 196.484416] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:56Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06232worker2 # [ 196.489306] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:56Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16233worker2 # [ 196.494455] nix-daemon[836]: reaped child process 1899, status = succeeded6234worker2 # [ 196.515079] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406966235worker2 # [ 196.535754] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406966236worker2 # [ 196.552965] nix-grpc-daemon[1685]: time=2026-09-20T09:35:56.176Z level=INFO msg="All 1 paths already cached"6237client # copying 1 paths to 'lb:50051'...6238client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6239worker2 # [ 196.564624] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406966240worker2 # [ 196.585125] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)6241worker2 # [ 196.828963] nix-daemon[836]: accepted connection from pid 1925, user nix-grpc-daemon (trusted)6242worker2 # [ 196.853903] nix-daemon[836]: reaped child process 1928, status = succeeded6243worker2 # [ 197.044114] nix-daemon[836]: accepted connection from pid 1930, user nix-grpc-daemon (trusted)6244worker2 # [ 197.061519] nix-daemon[836]: reaped child process 1933, status = succeeded6245lb # [ 197.065441] niks3-server[1032]: 2026/09/20 09:35:57 INFO Received uploads request method=POST path=/api/pending_closures6246worker2 # [ 197.090602] nix-grpc-daemon[1685]: time=2026-09-20T09:35:56.713Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6247worker2 # [ 197.092287] nix-grpc-daemon[1685]: time=2026-09-20T09:35:56.713Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6248lb # [ 197.109607] niks3-server[1032]: 2026/09/20 09:35:57 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6249worker2 # [ 197.135783] nix-grpc-daemon[1685]: time=2026-09-20T09:35:56.758Z level=INFO msg="Uploading 1 narinfos"6250lb # [ 197.126509] niks3-server[1032]: 2026/09/20 09:35:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6251lb # [ 197.139357] niks3-server[1032]: 2026/09/20 09:35:57 INFO Signed narinfos id=66 count=16252lb # [ 197.147330] niks3-server[1032]: 2026/09/20 09:35:57 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6253lb # [ 197.158345] niks3-server[1032]: 2026/09/20 09:35:57 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6254lb # [ 197.166635] niks3-server[1032]: 2026/09/20 09:35:57 INFO Completed upload id=666255worker2 # [ 197.175305] nix-grpc-daemon[1685]: time=2026-09-20T09:35:56.798Z level=INFO msg="Upload complete. (565ms)"6256lb # [ 197.169852] niks3-server[1032]: 2026/09/20 09:35:57 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6257worker2 # [ 197.189725] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=0 paths=1 nar_bytes_in=6326258worker2 # [ 197.203965] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406966259worker2 # [ 197.222107] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)6260worker2 # [ 197.229205] nix-daemon[836]: reaped child process 1923, status = succeeded6261client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6262worker2 # [ 197.243809] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)6263client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6264client # farm-b> LOG-farm-b-drain6265worker2 # [ 198.093382] nix-daemon[836]: reaped child process 1937, status = succeeded6266worker2 # [ 198.346631] nix-daemon[836]: accepted connection from pid 1952, user nix-grpc-daemon (trusted)6267worker2 # [ 198.375170] nix-daemon[836]: reaped child process 1955, status = succeeded6268lb # [ 198.382999] niks3-server[1032]: 2026/09/20 09:35:58 INFO Received uploads request method=POST path=/api/pending_closures6269worker2 # [ 198.408446] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.027Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6270worker2 # [ 198.410100] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.028Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6271lb # [ 198.445088] niks3-server[1032]: 2026/09/20 09:35:59 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6272lb # [ 198.458316] niks3-server[1032]: 2026/09/20 09:35:59 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6273lb # [ 198.468194] niks3-server[1032]: 2026/09/20 09:35:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6274worker2 # [ 198.482647] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.105Z level=INFO msg="Uploading 1 narinfos"6275lb # [ 198.477102] niks3-server[1032]: 2026/09/20 09:35:59 INFO Signed narinfos id=67 count=16276lb # [ 198.479220] niks3-server[1032]: 2026/09/20 09:35:59 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6277lb # [ 198.486955] niks3-server[1032]: 2026/09/20 09:35:59 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6278lb # [ 198.493667] niks3-server[1032]: 2026/09/20 09:35:59 INFO Completed upload id=676279worker2 # [ 198.502395] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.125Z level=INFO msg="Upload complete. (443ms)"6280lb # [ 198.495942] niks3-server[1032]: 2026/09/20 09:35:59 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6281worker2 # [ 198.524260] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16282worker2 # [ 198.536470] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:58Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06283worker2 # [ 198.543379] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:58Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16284worker2 # [ 198.547773] nix-daemon[836]: reaped child process 1935, status = succeeded6285worker2 # [ 198.566087] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406966286worker2 # [ 198.581327] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406966287worker2 # [ 198.595253] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.218Z level=INFO msg="All 2 paths already cached"6288client # copying 1 paths to 'lb:50051'...6289worker2 # [ 198.604443] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406966290client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6291worker2 # [ 198.620763] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)6292worker2 # [ 198.819301] nix-daemon[836]: accepted connection from pid 1961, user nix-grpc-daemon (trusted)6293worker2 # [ 198.836153] nix-daemon[836]: reaped child process 1964, status = succeeded6294worker2 # [ 199.005633] nix-daemon[836]: accepted connection from pid 1966, user nix-grpc-daemon (trusted)6295worker2 # [ 199.021338] nix-daemon[836]: reaped child process 1969, status = succeeded6296lb # [ 199.023310] niks3-server[1032]: 2026/09/20 09:35:59 INFO Received uploads request method=POST path=/api/pending_closures6297worker2 # [ 199.041457] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.664Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6298worker2 # [ 199.042947] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.664Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6299lb # [ 199.048250] niks3-server[1032]: 2026/09/20 09:35:59 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6300worker2 # [ 199.071903] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.695Z level=INFO msg="Uploading 1 narinfos"6301lb # [ 199.062678] niks3-server[1032]: 2026/09/20 09:35:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6302lb # [ 199.074847] niks3-server[1032]: 2026/09/20 09:35:59 INFO Signed narinfos id=68 count=16303lb # [ 199.082657] niks3-server[1032]: 2026/09/20 09:35:59 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6304lb # [ 199.091243] niks3-server[1032]: 2026/09/20 09:35:59 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6305lb # [ 199.097892] niks3-server[1032]: 2026/09/20 09:35:59 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6306lb # [ 199.103781] niks3-server[1032]: 2026/09/20 09:35:59 INFO Completed upload id=686307worker2 # [ 199.113182] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.736Z level=INFO msg="Upload complete. (476ms)"6308worker2 # [ 199.120869] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=0 paths=1 nar_bytes_in=7606309worker2 # [ 199.135019] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406966310worker2 # [ 199.141288] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)6311worker2 # [ 199.146130] nix-daemon[836]: reaped child process 1959, status = succeeded6312client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6313client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6314worker2 # [ 199.160791] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted)6315worker2 # [ 200.582732] nix-daemon[836]: reaped child process 1973, status = succeeded6316client # farm-top> LOG-farm-top-drain6317worker2 # [ 200.736916] nix-daemon[836]: accepted connection from pid 1988, user nix-grpc-daemon (trusted)6318worker2 # [ 200.754410] nix-daemon[836]: reaped child process 1991, status = succeeded6319lb # [ 200.763350] niks3-server[1032]: 2026/09/20 09:36:01 INFO Received uploads request method=POST path=/api/pending_closures6320worker2 # [ 200.783862] nix-grpc-daemon[1685]: time=2026-09-20T09:36:00.405Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6321worker2 # [ 200.785552] nix-grpc-daemon[1685]: time=2026-09-20T09:36:00.405Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6322lb # [ 200.792915] niks3-server[1032]: 2026/09/20 09:36:01 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6323lb # [ 200.812400] niks3-server[1032]: 2026/09/20 09:36:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6324worker2 # [ 200.842341] nix-grpc-daemon[1685]: time=2026-09-20T09:36:00.465Z level=INFO msg="Uploading 1 narinfos"6325lb # [ 200.826670] niks3-server[1032]: 2026/09/20 09:36:01 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6326lb # [ 200.836646] niks3-server[1032]: 2026/09/20 09:36:01 INFO Signed narinfos id=69 count=16327lb # [ 200.841226] niks3-server[1032]: 2026/09/20 09:36:01 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6328lb # [ 200.847919] niks3-server[1032]: 2026/09/20 09:36:01 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6329lb # [ 200.852657] niks3-server[1032]: 2026/09/20 09:36:01 INFO Completed upload id=696330worker2 # [ 200.862103] nix-grpc-daemon[1685]: time=2026-09-20T09:36:00.485Z level=INFO msg="Upload complete. (290ms)"6331lb # [ 200.854851] niks3-server[1032]: 2026/09/20 09:36:01 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6332worker2 # [ 200.877112] nix-grpc-daemon[1609]: ts=2026-09-20T09:36:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16333worker2 # [ 200.890620] nix-daemon[836]: reaped child process 1971, status = succeeded6334client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 7.14 seconds)6335client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6336lb # [ 200.931584] envoy[913]: conn peer=[2001:db8:1::1]:52364 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=300646337lb # [ 200.936745] envoy[913]: conn peer=[2001:db8:1::1]:39344 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9480 tx=3864 ms=68056338client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.24 seconds)6339worker1: must succeed: rm /nix/.rw-store/fill6340worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6341worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6342worker1 # [ 201.583660] nix-grpc-daemon[1410]: ts=2026-09-20T09:36:01Z level=info event=healthy reason=min_free6343worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6344(finished: subtest: low disk drains a worker and builds go to the other, in 10.04 seconds)6345(finished: run the VM test script, in 203.46 seconds)6346test script finished in 203.76s6347cleanup6348kill QemuMachine (pid 49)6349client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6350kill QemuMachine (pid 50)6351lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6352kill QemuMachine (pid 52)6353worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6354kill QemuMachine (pid 51)6355worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6356(finished: cleanup, in 1.07 seconds)6357additionally exposed symbols:6358 client, lb, worker1, worker2,6359 vlan1,6360 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh