vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #230
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker1 # Disk image does not exist, creating the virtualisation disk image...13worker1 # Formatting '/build/vm-state-worker1/tmp.dXpwt498JV', fmt=raw size=107374182414worker2 # Disk image does not exist, creating the virtualisation disk image...15worker1: QEMU running (pid 52)16worker1 # mke2fs 1.47.4 (6-Mar-2025)17client: QEMU running (pid 49)18lb # Disk image does not exist, creating the virtualisation disk image...19lb: QEMU running (pid 50)20worker1 # Discarding device blocks: 0/262144 done21client # Disk image does not exist, creating the virtualisation disk image...22worker2: QEMU running (pid 51)23worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes24client # Formatting '/build/vm-state-client/tmp.AdQ7qE8Lb9', fmt=raw size=107374182425lb # Formatting '/build/vm-state-lb/tmp.hwGE79bpIa', fmt=raw size=107374182426(finished: start all VMs, in 0.51 seconds)27client # mke2fs 1.47.4 (6-Mar-2025)28lb # mke2fs 1.47.4 (6-Mar-2025)29client: waiting for unit network-addresses-eth1.service30client # Discarding device blocks: 0/262144 done31lb # Discarding device blocks: 0/262144 done32client: waiting for the VM to finish booting33client # Creating filesystem with 262144 4k blocks and 65536 inodes34lb # Creating filesystem with 262144 4k blocks and 65536 inodes35worker1 # Filesystem UUID: 9c9302c7-fe62-44fc-af33-6f232b06fb7936worker2 # Formatting '/build/vm-state-worker2/tmp.HJtbpMa1RB', fmt=raw size=107374182437client # Filesystem UUID: f6787985-d969-4b70-8afd-a98abe1dac9838lb # Filesystem UUID: e4baf084-bc08-4eae-b2e1-9cd10434d8f639worker1 # Superblock backups stored on blocks:40worker2 # mke2fs 1.47.4 (6-Mar-2025)41client # Superblock backups stored on blocks:42lb # Superblock backups stored on blocks:43worker1 # 32768, 98304, 163840, 22937644worker2 # Discarding device blocks: 0/262144 done45client # 32768, 98304, 163840, 22937646lb # 32768, 98304, 163840, 22937647worker1 # 48worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes49client # 50lb # 51worker1 # Allocating group tables: 0/8 done52worker2 # Filesystem UUID: b404e6eb-db26-4671-8f89-fcdcbb0a723f53client # Allocating group tables: 0/8 done54lb # Allocating group tables: 0/8 done55worker1 # Writing inode tables: 0/8 done56worker2 # Superblock backups stored on blocks:57client # Writing inode tables: 0/8 done58lb # Writing inode tables: 0/8 done59worker1 # Creating journal (8192 blocks): done60worker2 # 32768, 98304, 163840, 22937661client # Creating journal (8192 blocks): done62lb # Creating journal (8192 blocks): done63worker1 # Writing superblocks and filesystem accounting information: 0/8 done64worker2 # 65client # Writing superblocks and filesystem accounting information: 0/8 done66lb # Writing superblocks and filesystem accounting information: 0/8 done67worker1 # 68worker2 # Allocating group tables: 0/8 done69client # 70lb # 71worker1 # Virtualisation disk image created.72worker2 # Writing inode tables: 0/8 done73client # Virtualisation disk image created.74worker2 # Creating journal (8192 blocks): done75lb # Virtualisation disk image created.76worker2 # Writing superblocks and filesystem accounting information: 0/8 done77worker2 # 78worker2 # Virtualisation disk image created.79worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681worker1 # [ 0.000000] KASLR enabled82worker1 # [ 0.000000] random: crng init done83worker1 # [ 0.000000] Machine model: linux,dummy-virt84worker1 # [ 0.000000] efi: UEFI not found.85worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88worker1 # [ 0.000000] Zone ranges:89worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90worker1 # [ 0.000000] DMA32 empty91worker1 # [ 0.000000] Normal empty92worker1 # [ 0.000000] Device empty93worker1 # [ 0.000000] Movable zone start for each node94worker1 # [ 0.000000] Early memory node ranges95worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098worker1 # [ 0.000000] psci: probing for conduit method from DT.99worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.100worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101worker1 # [ 0.000000] psci: Trusted OS migration not required102worker1 # [ 0.000000] psci: SMC Calling Convention v1.1103worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105worker1 # [ 0.000000] Detected PIPT I-cache on CPU0106worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface108worker1 # [ 0.000000] CPU features: detected: Spectre-v4109worker1 # [ 0.000000] CPU features: detected: Spectre-BHB110worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112worker1 # [ 0.000000] alternatives: applying boot alternatives113worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/fzfq56s94qxiq0x2s5a28kmkj3mqarpp-nixos-system-worker1-test/init regInfo=/nix/store/ajmr8qy9jc8xr1vmwvv006yl2ijnzqq9-closure-info/registration console=ttyAMA0,115200n8 console=tty0114worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/ajmr8qy9jc8xr1vmwvv006yl2ijnzqq9-closure-info/registration", will be passed to user space.115worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]119worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB120worker1 # [ 0.000000] software IO TLB: area num 1.121worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026122worker2 # [ 0.000000] KASLR enabled123worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB124worker2 # [ 0.000000] random: crng init done125worker2 # [ 0.000000] Machine model: linux,dummy-virt126worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)127worker2 # [ 0.000000] efi: UEFI not found.128worker1 # [ 0.000000] Fallback order for Node 0: 0129worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT130worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216131worker1 # [ 0.000000] Policy zone: DMA132worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]133worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off134worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]135worker2 # [ 0.000000] Zone ranges:136worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1137worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]138worker1 # [ 0.000000] allocated 3145728 bytes of page_ext139worker2 # [ 0.000000] DMA32 empty140worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages141worker2 # [ 0.000000] Normal empty142worker2 # [ 0.000000] Device empty143worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups144worker2 # [ 0.000000] Movable zone start for each node145worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.146worker2 # [ 0.000000] Early memory node ranges147worker1 # [ 0.000000] rcu: RCU event tracing is enabled.148worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]149worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.150worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]151worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.152worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000153worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.154worker2 # [ 0.000000] psci: probing for conduit method from DT.155worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.156worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.157worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.158worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs159worker2 # [ 0.000000] psci: Trusted OS migration not required160worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1161worker2 # [ 0.000000] psci: SMC Calling Convention v1.1162worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.163worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)164worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.165client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]166worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296167worker2 # [ 0.000000] Detected PIPT I-cache on CPU0168worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.169client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026170worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0171worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)172client # [ 0.000000] KASLR enabled173worker1 # [ 0.000000] GICv3: 256 SPIs implemented174client # [ 0.000000] random: crng init done175worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface176worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented177worker2 # [ 0.000000] CPU features: detected: Spectre-v4178client # [ 0.000000] Machine model: linux,dummy-virt179client # [ 0.000000] efi: UEFI not found.180worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq181worker2 # [ 0.000000] CPU features: detected: Spectre-BHB182worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI183client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT184worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38185lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]186worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0187client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]188worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23189worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000190worker2 # [ 0.000000] alternatives: applying boot alternatives191client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]192worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]193lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026194client # [ 0.000000] Zone ranges:195lb # [ 0.000000] KASLR enabled196lb # [ 0.000000] random: crng init done197client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]198worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)199client # [ 0.000000] DMA32 empty200lb # [ 0.000000] Machine model: linux,dummy-virt201client # [ 0.000000] Normal empty202lb # [ 0.000000] efi: UEFI not found.203client # [ 0.000000] Device empty204worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)205client # [ 0.000000] Movable zone start for each node206lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT207client # [ 0.000000] Early memory node ranges208worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000209lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]210worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/l6zbr10ad1h0flsrhx39zr17z1sjrdbr-nixos-system-worker2-test/init regInfo=/nix/store/q94xgaj0w4ihp8ir4g1shsv12wk3lqiv-closure-info/registration console=ttyAMA0,115200n8 console=tty0211client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]212worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000213lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]214client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]215lb # [ 0.000000] Zone ranges:216worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.217client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000218lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]219worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/q94xgaj0w4ihp8ir4g1shsv12wk3lqiv-closure-info/registration", will be passed to user space.220lb # [ 0.000000] DMA32 empty221client # [ 0.000000] psci: probing for conduit method from DT.222lb # [ 0.000000] Normal empty223worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns224worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes225client # [ 0.000000] psci: PSCIv1.3 detected in firmware.226lb # [ 0.000000] Device empty227lb # [ 0.000000] Movable zone start for each node228worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).229client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs230worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)231lb # [ 0.000000] Early memory node ranges232client # [ 0.000000] psci: Trusted OS migration not required233lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]234client # [ 0.000000] psci: SMC Calling Convention v1.1235worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)236worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns237lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]238worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB239client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)240worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns241worker2 # [ 0.000000] software IO TLB: area num 1.242lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000243worker1 # [ 0.000038] arm-pv: using stolen time PV244client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296245lb # [ 0.000000] psci: probing for conduit method from DT.246worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB247client # [ 0.000000] Detected PIPT I-cache on CPU0248lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.249worker1 # [ 0.000687] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)250worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)251lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs252client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)253worker1 # [ 0.000863] Console: colour dummy device 80x25254worker2 # [ 0.000000] Fallback order for Node 0: 0255lb # [ 0.000000] psci: Trusted OS migration not required256client # [ 0.000000] CPU features: detected: GICv3 CPU interface257worker1 # [ 0.000871] printk: legacy console [tty0] enabled258lb # [ 0.000000] psci: SMC Calling Convention v1.1259worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216260client # [ 0.000000] CPU features: detected: Spectre-v4261worker2 # [ 0.000000] Policy zone: DMA262client # [ 0.000000] CPU features: detected: Spectre-BHB263worker1 # [ 0.001104] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)264lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)265worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off266client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38267worker1 # [ 0.001111] pid_max: default: 32768 minimum: 301268lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296269worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1270client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23271worker1 # [ 0.001200] LSM: initializing lsm=capability,landlock,yama,bpf,ima272lb # [ 0.000000] Detected PIPT I-cache on CPU0273worker2 # [ 0.000000] allocated 3145728 bytes of page_ext274worker1 # [ 0.001426] landlock: Up and running.275client # [ 0.000000] alternatives: applying boot alternatives276worker1 # [ 0.001429] Yama: becoming mindful.277worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages278lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)279worker1 # [ 0.002262] LSM support for eBPF active280worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups281lb # [ 0.000000] CPU features: detected: GICv3 CPU interface282worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.283worker1 # [ 0.002433] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)284lb # [ 0.000000] CPU features: detected: Spectre-v4285worker2 # [ 0.000000] rcu: RCU event tracing is enabled.286lb # [ 0.000000] CPU features: detected: Spectre-BHB287worker1 # [ 0.002471] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)288worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.289lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38290worker1 # [ 0.003663] cacheinfo: Unable to detect cache hierarchy for CPU 0291worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.292client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rh6m2zj85qm755mc0pgdfrhyf6vajb8c-nixos-system-client-test/init regInfo=/nix/store/bgjli5zjp71q0gkjhzg6ksqiwq6bv5wn-closure-info/registration console=ttyAMA0,115200n8 console=tty0293lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23294worker1 # [ 0.004450] rcu: Hierarchical SRCU implementation.295worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.296lb # [ 0.000000] alternatives: applying boot alternatives297worker1 # [ 0.004454] rcu: Max phase no-delay instances is 1000.298worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.299worker1 # [ 0.005677] fsl-mc MSI: its@8080000 domain created300client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/bgjli5zjp71q0gkjhzg6ksqiwq6bv5wn-closure-info/registration", will be passed to user space.301worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.302worker1 # [ 0.005770] EFI services will not be available.303worker1 # [ 0.005847] smp: Bringing up secondary CPUs ...304client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes305worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1306worker1 # [ 0.005857] smp: Brought up 1 node, 1 CPU307worker1 # [ 0.005861] SMP: Total of 1 processors activated.308client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)309worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.310worker1 # [ 0.005866] CPU: All CPU(s) started at EL1311lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test/init regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration console=ttyAMA0,115200n8 console=tty0312client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)313worker1 # [ 0.005878] CPU features: detected: Branch Target Identification314worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.315client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB316worker1 # [ 0.005883] CPU features: detected: ARMv8.4 Translation Table Level317client # [ 0.000000] software IO TLB: area num 1.318worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.319lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration", will be passed to user space.320client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB321worker1 # [ 0.005887] CPU features: detected: Instruction cache invalidation not required for I/D coherence322worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0323lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes324worker2 # [ 0.000000] GICv3: 256 SPIs implemented325client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)326worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented327worker1 # [ 0.005890] CPU features: detected: Data cache clean to the PoU not required for I/D coherence328lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)329client # [ 0.000000] Fallback order for Node 0: 0330worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq331worker1 # [ 0.005894] CPU features: detected: Common not Private translations332client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216333lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)334worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI335worker1 # [ 0.005897] CPU features: detected: CRC32 instructions336client # [ 0.000000] Policy zone: DMA337worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0338lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB339client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off340worker1 # [ 0.005900] CPU features: detected: Data cache clean to Point of Deep Persistence341lb # [ 0.000000] software IO TLB: area num 1.342worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000343client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1344worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]345lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB346worker1 # [ 0.005903] CPU features: detected: Data cache clean to Point of Persistence347client # [ 0.000000] allocated 3145728 bytes of page_ext348worker1 # [ 0.005907] CPU features: detected: Data independent timing control (DIT)349worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)350client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages351lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)352worker1 # [ 0.005910] CPU features: detected: E0PD353lb # [ 0.000000] Fallback order for Node 0: 0354client # [ 0.000000] ftrace: allocated 294 pages with 4 groups355worker1 # [ 0.005912] CPU features: detected: Enhanced Counter Virtualization356lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216357client # [ 0.000000] rcu: Hierarchical RCU implementation.358worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)359lb # [ 0.000000] Policy zone: DMA360client # [ 0.000000] rcu: RCU event tracing is enabled.361worker1 # [ 0.005915] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)362worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000363lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off364client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.365worker1 # [ 0.005918] CPU features: detected: Enhanced Virtualization Traps366worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000367lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1368client # [ 0.000000] Trampoline variant of Tasks RCU enabled.369worker1 # [ 0.005921] CPU features: detected: Fine Grained Traps370worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.371client # [ 0.000000] Rude variant of Tasks RCU enabled.372lb # [ 0.000000] allocated 3145728 bytes of page_ext373client # [ 0.000000] Tracing variant of Tasks RCU enabled.374lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages375worker1 # [ 0.005925] CPU features: detected: Generic authentication (architected QARMA5 algorithm)376worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns377lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups378worker1 # [ 0.005931] CPU features: detected: RCpc load-acquire (LDAPR)379client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.380lb # [ 0.000000] rcu: Hierarchical RCU implementation.381worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).382worker1 # [ 0.005934] CPU features: detected: LSE atomic instructions383client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1384lb # [ 0.000000] rcu: RCU event tracing is enabled.385worker1 # [ 0.005936] CPU features: detected: Privileged Access Never386lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.387worker1 # [ 0.005939] CPU features: detected: PMUv3388worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns389client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.390lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.391worker1 # [ 0.005942] CPU features: detected: RAS Extension Support392worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns393lb # [ 0.000000] Rude variant of Tasks RCU enabled.394client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.395worker1 # [ 0.005944] CPU features: detected: RASv1p1 Extension Support396worker2 # [ 0.000038] arm-pv: using stolen time PV397lb # [ 0.000000] Tracing variant of Tasks RCU enabled.398worker1 # [ 0.005947] CPU features: detected: Random Number Generator399client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.400lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.401worker1 # [ 0.005950] CPU features: detected: Speculation barrier (SB)402worker2 # [ 0.000667] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)403client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0404worker2 # [ 0.000814] Console: colour dummy device 80x25405lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1406client # [ 0.000000] GICv3: 256 SPIs implemented407worker1 # [ 0.005953] CPU features: detected: Stage-2 Force Write-Back408worker2 # [ 0.000823] printk: legacy console [tty0] enabled409client # [ 0.000000] GICv3: 0 Extended SPIs implemented410worker1 # [ 0.005956] CPU features: detected: TLB range maintenance instructions411client # [ 0.000000] Root IRQ handler: gic_handle_irq412lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.413worker1 # [ 0.005960] CPU features: detected: Speculative Store Bypassing Safe (SSBS)414worker2 # [ 0.001042] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)415client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI416lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.417worker2 # [ 0.001049] pid_max: default: 32768 minimum: 301418worker1 # [ 0.006002] alternatives: applying system-wide alternatives419client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0420worker2 # [ 0.001122] LSM: initializing lsm=capability,landlock,yama,bpf,ima421client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000422worker1 # [ 0.009096] CPU features: detected: BBM Level 2 without TLB conflict abort423lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.424worker2 # [ 0.001311] landlock: Up and running.425client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]426worker2 # [ 0.001313] Yama: becoming mindful.427lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0428worker2 # [ 0.001886] LSM support for eBPF active429lb # [ 0.000000] GICv3: 256 SPIs implemented430client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)431worker1 # [ 0.009296] Memory: 1406560K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)432lb # [ 0.000000] GICv3: 0 Extended SPIs implemented433worker1 # [ 0.009726] devtmpfs: initialized434worker2 # [ 0.002040] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)435lb # [ 0.000000] Root IRQ handler: gic_handle_irq436client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)437lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI438worker1 # [ 0.011628] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)439worker2 # [ 0.002074] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)440lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0441client # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000442worker2 # [ 0.003250] cacheinfo: Unable to detect cache hierarchy for CPU 0443worker1 # [ 0.011651] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).444lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000445client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000446worker2 # [ 0.004080] rcu: Hierarchical SRCU implementation.447lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]448worker1 # [ 0.011841] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL449worker2 # [ 0.004084] rcu: Max phase no-delay instances is 1000.450client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.451worker1 # [ 0.011846] 0 pages in range for non-PLT usage452worker2 # [ 0.005303] fsl-mc MSI: its@8080000 domain created453worker1 # [ 0.011847] 508288 pages in range for PLT usage454lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)455worker2 # [ 0.005406] EFI services will not be available.456client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns457worker1 # [ 0.011977] pinctrl core: initialized pinctrl subsystem458worker2 # [ 0.005542] smp: Bringing up secondary CPUs ...459worker1 # [ 0.012749] DMI not present or invalid.460client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).461worker2 # [ 0.005551] smp: Brought up 1 node, 1 CPU462lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)463worker1 # [ 0.016700] NET: Registered PF_NETLINK/PF_ROUTE protocol family464worker2 # [ 0.005554] SMP: Total of 1 processors activated.465lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000466worker2 # [ 0.005559] CPU: All CPU(s) started at EL1467client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns468worker1 # [ 0.019011] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations469lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000470worker2 # [ 0.005571] CPU features: detected: Branch Target Identification471client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns472lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.473worker1 # [ 0.019216] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations474worker2 # [ 0.005576] CPU features: detected: ARMv8.4 Translation Table Level475client # [ 0.000034] arm-pv: using stolen time PV476worker1 # [ 0.019424] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations477lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns478worker2 # [ 0.005580] CPU features: detected: Instruction cache invalidation not required for I/D coherence479client # [ 0.000501] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)480worker1 # [ 0.019452] audit: initializing netlink subsys (disabled)481lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).482client # [ 0.000675] Console: colour dummy device 80x25483worker2 # [ 0.005583] CPU features: detected: Data cache clean to the PoU not required for I/D coherence484worker1 # [ 0.020094] thermal_sys: Registered thermal governor 'fair_share'485client # [ 0.000683] printk: legacy console [tty0] enabled486worker2 # [ 0.005587] CPU features: detected: Common not Private translations487worker1 # [ 0.020096] thermal_sys: Registered thermal governor 'bang_bang'488lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns489worker2 # [ 0.005590] CPU features: detected: CRC32 instructions490client # [ 0.000901] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)491lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns492client # [ 0.000908] pid_max: default: 32768 minimum: 301493worker2 # [ 0.005593] CPU features: detected: Data cache clean to Point of Deep Persistence494lb # [ 0.000034] arm-pv: using stolen time PV495worker1 # [ 0.020099] thermal_sys: Registered thermal governor 'step_wise'496client # [ 0.000987] LSM: initializing lsm=capability,landlock,yama,bpf,ima497worker1 # [ 0.020105] thermal_sys: Registered thermal governor 'user_space'498worker2 # [ 0.005596] CPU features: detected: Data cache clean to Point of Persistence499client # [ 0.001134] landlock: Up and running.500lb # [ 0.000460] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)501client # [ 0.001137] Yama: becoming mindful.502worker1 # [ 0.020108] thermal_sys: Registered thermal governor 'power_allocator'503worker2 # [ 0.005600] CPU features: detected: Data independent timing control (DIT)504lb # [ 0.000633] Console: colour dummy device 80x25505client # [ 0.001621] LSM support for eBPF active506worker2 # [ 0.005603] CPU features: detected: E0PD507lb # [ 0.000641] printk: legacy console [tty0] enabled508worker1 # [ 0.020142] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1509client # [ 0.001775] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)510worker2 # [ 0.005605] CPU features: detected: Enhanced Counter Virtualization511worker1 # [ 0.020151] cpuidle: using governor ladder512worker1 # [ 0.020157] cpuidle: using governor menu513lb # [ 0.000838] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)514worker2 # [ 0.005608] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)515client # [ 0.001809] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)516lb # [ 0.000845] pid_max: default: 32768 minimum: 301517worker1 # [ 0.020353] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.518worker2 # [ 0.005611] CPU features: detected: Enhanced Virtualization Traps519client # [ 0.002974] cacheinfo: Unable to detect cache hierarchy for CPU 0520lb # [ 0.000923] LSM: initializing lsm=capability,landlock,yama,bpf,ima521worker1 # [ 0.020370] ASID allocator initialised with 65536 entries522client # [ 0.003717] rcu: Hierarchical SRCU implementation.523worker2 # [ 0.005614] CPU features: detected: Fine Grained Traps524lb # [ 0.001066] landlock: Up and running.525worker1 # [ 0.021672] Serial: AMBA PL011 UART driver526client # [ 0.003721] rcu: Max phase no-delay instances is 1000.527lb # [ 0.001071] Yama: becoming mindful.528worker2 # [ 0.005618] CPU features: detected: Generic authentication (architected QARMA5 algorithm)529lb # [ 0.001576] LSM support for eBPF active530client # [ 0.004912] fsl-mc MSI: its@8080000 domain created531worker1 # [ 0.027160] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1532worker2 # [ 0.005622] CPU features: detected: RCpc load-acquire (LDAPR)533client # [ 0.005006] EFI services will not be available.534worker1 # [ 0.027323] printk: console [ttyAMA0] enabled535lb # [ 0.001710] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)536client # [ 0.005094] smp: Bringing up secondary CPUs ...537worker2 # [ 0.005625] CPU features: detected: LSE atomic instructions538client # [ 0.005103] smp: Brought up 1 node, 1 CPU539lb # [ 0.001741] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)540worker2 # [ 0.005628] CPU features: detected: Privileged Access Never541client # [ 0.005106] SMP: Total of 1 processors activated.542worker2 # [ 0.005631] CPU features: detected: PMUv3543lb # [ 0.002977] cacheinfo: Unable to detect cache hierarchy for CPU 0544client # [ 0.005121] CPU: All CPU(s) started at EL1545worker2 # [ 0.005633] CPU features: detected: RAS Extension Support546lb # [ 0.003702] rcu: Hierarchical SRCU implementation.547client # [ 0.005132] CPU features: detected: Branch Target Identification548lb # [ 0.003706] rcu: Max phase no-delay instances is 1000.549worker2 # [ 0.005636] CPU features: detected: RASv1p1 Extension Support550client # [ 0.005136] CPU features: detected: ARMv8.4 Translation Table Level551lb # [ 0.004914] fsl-mc MSI: its@8080000 domain created552worker2 # [ 0.005639] CPU features: detected: Random Number Generator553lb # [ 0.005013] EFI services will not be available.554worker2 # [ 0.005641] CPU features: detected: Speculation barrier (SB)555client # [ 0.005139] CPU features: detected: Instruction cache invalidation not required for I/D coherence556lb # [ 0.005092] smp: Bringing up secondary CPUs ...557worker2 # [ 0.005643] CPU features: detected: Stage-2 Force Write-Back558lb # [ 0.005102] smp: Brought up 1 node, 1 CPU559client # [ 0.005143] CPU features: detected: Data cache clean to the PoU not required for I/D coherence560lb # [ 0.005106] SMP: Total of 1 processors activated.561worker2 # [ 0.005646] CPU features: detected: TLB range maintenance instructions562lb # [ 0.005112] CPU: All CPU(s) started at EL1563client # [ 0.005147] CPU features: detected: Common not Private translations564worker2 # [ 0.005650] CPU features: detected: Speculative Store Bypassing Safe (SSBS)565lb # [ 0.005123] CPU features: detected: Branch Target Identification566client # [ 0.005150] CPU features: detected: CRC32 instructions567worker2 # [ 0.005690] alternatives: applying system-wide alternatives568lb # [ 0.005128] CPU features: detected: ARMv8.4 Translation Table Level569client # [ 0.005153] CPU features: detected: Data cache clean to Point of Deep Persistence570worker2 # [ 0.008786] CPU features: detected: BBM Level 2 without TLB conflict abort571client # [ 0.005157] CPU features: detected: Data cache clean to Point of Persistence572lb # [ 0.005131] CPU features: detected: Instruction cache invalidation not required for I/D coherence573client # [ 0.005160] CPU features: detected: Data independent timing control (DIT)574lb # [ 0.005135] CPU features: detected: Data cache clean to the PoU not required for I/D coherence575client # [ 0.005163] CPU features: detected: E0PD576worker1 # [ 0.151379] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages577worker2 # [ 0.008961] Memory: 1406556K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)578worker2 # [ 0.009388] devtmpfs: initialized579lb # [ 0.005138] CPU features: detected: Common not Private translations580worker1 # [ 0.151398] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page581client # [ 0.005165] CPU features: detected: Enhanced Counter Virtualization582lb # [ 0.005141] CPU features: detected: CRC32 instructions583worker2 # [ 0.011240] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)584client # [ 0.005168] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)585worker1 # [ 0.151403] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages586lb # [ 0.005144] CPU features: detected: Data cache clean to Point of Deep Persistence587worker2 # [ 0.011262] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).588worker1 # [ 0.151407] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page589client # [ 0.005172] CPU features: detected: Enhanced Virtualization Traps590client # [ 0.005175] CPU features: detected: Fine Grained Traps591worker2 # [ 0.011465] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL592worker1 # [ 0.151412] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages593worker2 # [ 0.011469] 0 pages in range for non-PLT usage594lb # [ 0.005148] CPU features: detected: Data cache clean to Point of Persistence595client # [ 0.005179] CPU features: detected: Generic authentication (architected QARMA5 algorithm)596worker1 # [ 0.151416] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page597worker2 # [ 0.011470] 508288 pages in range for PLT usage598lb # [ 0.005151] CPU features: detected: Data independent timing control (DIT)599client # [ 0.005183] CPU features: detected: RCpc load-acquire (LDAPR)600worker2 # [ 0.011583] pinctrl core: initialized pinctrl subsystem601worker1 # [ 0.151420] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages602lb # [ 0.005154] CPU features: detected: E0PD603worker2 # [ 0.012381] DMI not present or invalid.604client # [ 0.005186] CPU features: detected: LSE atomic instructions605worker1 # [ 0.151425] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page606lb # [ 0.005157] CPU features: detected: Enhanced Counter Virtualization607client # [ 0.005189] CPU features: detected: Privileged Access Never608worker2 # [ 0.015893] NET: Registered PF_NETLINK/PF_ROUTE protocol family609client # [ 0.005192] CPU features: detected: PMUv3610lb # [ 0.005160] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)611worker2 # [ 0.018173] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations612client # [ 0.005194] CPU features: detected: RAS Extension Support613lb # [ 0.005163] CPU features: detected: Enhanced Virtualization Traps614worker2 # [ 0.018365] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations615worker1 # [ 0.158824] fbcon: Taking over console616client # [ 0.005197] CPU features: detected: RASv1p1 Extension Support617lb # [ 0.005166] CPU features: detected: Fine Grained Traps618worker1 # [ 0.158841] ACPI: Interpreter disabled.619client # [ 0.005200] CPU features: detected: Random Number Generator620worker2 # [ 0.018578] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations621lb # [ 0.005170] CPU features: detected: Generic authentication (architected QARMA5 algorithm)622client # [ 0.005202] CPU features: detected: Speculation barrier (SB)623worker1 # [ 0.160778] iommu: Default domain type: Translated624worker2 # [ 0.018599] audit: initializing netlink subsys (disabled)625lb # [ 0.005175] CPU features: detected: RCpc load-acquire (LDAPR)626client # [ 0.005205] CPU features: detected: Stage-2 Force Write-Back627worker1 # [ 0.160789] iommu: DMA domain TLB invalidation policy: strict mode628worker2 # [ 0.019196] thermal_sys: Registered thermal governor 'fair_share'629lb # [ 0.005178] CPU features: detected: LSE atomic instructions630client # [ 0.005208] CPU features: detected: TLB range maintenance instructions631worker2 # [ 0.019198] thermal_sys: Registered thermal governor 'bang_bang'632worker1 # [ 0.162439] SCSI subsystem initialized633lb # [ 0.005181] CPU features: detected: Privileged Access Never634lb # [ 0.005183] CPU features: detected: PMUv3635client # [ 0.005213] CPU features: detected: Speculative Store Bypassing Safe (SSBS)636lb # [ 0.005186] CPU features: detected: RAS Extension Support637client # [ 0.005254] alternatives: applying system-wide alternatives638worker2 # [ 0.019202] thermal_sys: Registered thermal governor 'step_wise'639lb # [ 0.005189] CPU features: detected: RASv1p1 Extension Support640client # [ 0.008248] CPU features: detected: BBM Level 2 without TLB conflict abort641worker2 # [ 0.019207] thermal_sys: Registered thermal governor 'user_space'642lb # [ 0.005191] CPU features: detected: Random Number Generator643worker2 # [ 0.019210] thermal_sys: Registered thermal governor 'power_allocator'644lb # [ 0.005194] CPU features: detected: Speculation barrier (SB)645client # [ 0.008441] Memory: 1406556K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)646worker2 # [ 0.019236] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1647lb # [ 0.005197] CPU features: detected: Stage-2 Force Write-Back648client # [ 0.008885] devtmpfs: initialized649worker2 # [ 0.019244] cpuidle: using governor ladder650lb # [ 0.005200] CPU features: detected: TLB range maintenance instructions651worker2 # [ 0.019250] cpuidle: using governor menu652client # [ 0.011011] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)653lb # [ 0.005205] CPU features: detected: Speculative Store Bypassing Safe (SSBS)654worker2 # [ 0.019484] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.655worker1 # [ 0.167703] usbcore: registered new interface driver usbfs656lb # [ 0.005242] alternatives: applying system-wide alternatives657worker2 # [ 0.019500] ASID allocator initialised with 65536 entries658worker1 # [ 0.167736] usbcore: registered new interface driver hub659worker2 # [ 0.020704] Serial: AMBA PL011 UART driver660client # [ 0.011035] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).661lb # [ 0.008240] CPU features: detected: BBM Level 2 without TLB conflict abort662worker1 # [ 0.167762] usbcore: registered new device driver usb663client # [ 0.011239] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL664worker2 # [ 0.025967] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1665worker1 # [ 0.168083] pps_core: LinuxPPS API ver. 1 registered666client # [ 0.011243] 0 pages in range for non-PLT usage667worker2 # [ 0.026097] printk: console [ttyAMA0] enabled668client # [ 0.011244] 508288 pages in range for PLT usage669lb # [ 0.008437] Memory: 1406528K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)670worker1 # [ 0.168089] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>671lb # [ 0.008852] devtmpfs: initialized672client # [ 0.011360] pinctrl core: initialized pinctrl subsystem673worker1 # [ 0.168100] PTP clock support registered674client # [ 0.012123] DMI not present or invalid.675worker1 # [ 0.168152] EDAC MC: Ver: 3.0.0676lb # [ 0.010758] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)677client # [ 0.015597] NET: Registered PF_NETLINK/PF_ROUTE protocol family678worker1 # [ 0.172700] scmi_core: SCMI protocol bus registered679lb # [ 0.010782] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).680client # [ 0.017854] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations681lb # [ 0.010986] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL682worker1 # [ 0.173703] FPGA manager framework683client # [ 0.018047] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations684lb # [ 0.010993] 0 pages in range for non-PLT usage685worker1 # [ 0.174744] vgaarb: loaded686lb # [ 0.010994] 508288 pages in range for PLT usage687client # [ 0.018245] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations688lb # [ 0.011094] pinctrl core: initialized pinctrl subsystem689worker1 # [ 0.175381] clocksource: Switched to clocksource arch_sys_counter690client # [ 0.018266] audit: initializing netlink subsys (disabled)691lb # [ 0.011884] DMI not present or invalid.692client # [ 0.018874] thermal_sys: Registered thermal governor 'fair_share'693lb # [ 0.015047] NET: Registered PF_NETLINK/PF_ROUTE protocol family694client # [ 0.018876] thermal_sys: Registered thermal governor 'bang_bang'695lb # [ 0.017329] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations696client # [ 0.018880] thermal_sys: Registered thermal governor 'step_wise'697lb # [ 0.017519] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations698client # [ 0.018886] thermal_sys: Registered thermal governor 'user_space'699worker1 # [ 0.179311] VFS: Disk quotas dquot_6.6.0700lb # [ 0.017717] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations701client # [ 0.018888] thermal_sys: Registered thermal governor 'power_allocator'702lb # [ 0.017741] audit: initializing netlink subsys (disabled)703worker1 # [ 0.179353] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)704worker2 # [ 0.148430] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages705client # [ 0.018920] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1706lb # [ 0.018373] thermal_sys: Registered thermal governor 'fair_share'707worker2 # [ 0.148450] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page708client # [ 0.018928] cpuidle: using governor ladder709lb # [ 0.018374] thermal_sys: Registered thermal governor 'bang_bang'710client # [ 0.018934] cpuidle: using governor menu711worker2 # [ 0.148455] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages712lb # [ 0.018379] thermal_sys: Registered thermal governor 'step_wise'713client # [ 0.019147] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.714worker2 # [ 0.148460] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page715lb # [ 0.018384] thermal_sys: Registered thermal governor 'user_space'716client # [ 0.019164] ASID allocator initialised with 65536 entries717worker1 # [ 0.183150] netfs: FS-Cache loaded718worker2 # [ 0.148464] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages719client # [ 0.020460] Serial: AMBA PL011 UART driver720worker1 # [ 0.183280] pnp: PnP ACPI: disabled721lb # [ 0.018387] thermal_sys: Registered thermal governor 'power_allocator'722worker2 # [ 0.148468] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page723client # [ 0.025763] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1724lb # [ 0.018418] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1725worker2 # [ 0.148472] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages726client # [ 0.025927] printk: console [ttyAMA0] enabled727lb # [ 0.018430] cpuidle: using governor ladder728lb # [ 0.018438] cpuidle: using governor menu729worker2 # [ 0.148477] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page730lb # [ 0.018637] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.731lb # [ 0.018652] ASID allocator initialised with 65536 entries732worker1 # [ 0.187336] NET: Registered PF_INET protocol family733lb # [ 0.020162] Serial: AMBA PL011 UART driver734worker2 # [ 0.155996] fbcon: Taking over console735worker2 # [ 0.156014] ACPI: Interpreter disabled.736lb # [ 0.025555] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1737lb # [ 0.025693] printk: console [ttyAMA0] enabled738worker1 # [ 0.188283] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)739client # [ 0.147067] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages740client # [ 0.147104] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page741client # [ 0.147109] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages742worker2 # [ 0.164968] iommu: Default domain type: Translated743client # [ 0.147114] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page744worker2 # [ 0.164979] iommu: DMA domain TLB invalidation policy: strict mode745worker2 # [ 0.165346] SCSI subsystem initialized746client # [ 0.147118] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages747lb # [ 0.146251] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages748client # [ 0.147123] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page749worker2 # [ 0.167431] usbcore: registered new interface driver usbfs750lb # [ 0.146269] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page751client # [ 0.147127] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages752worker2 # [ 0.167456] usbcore: registered new interface driver hub753lb # [ 0.146274] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages754client # [ 0.147131] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page755worker2 # [ 0.167484] usbcore: registered new device driver usb756lb # [ 0.146279] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page757worker2 # [ 0.167746] pps_core: LinuxPPS API ver. 1 registered758lb # [ 0.146283] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages759worker2 # [ 0.167752] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>760lb # [ 0.146287] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page761worker2 # [ 0.167762] PTP clock support registered762client # [ 0.154705] fbcon: Taking over console763worker2 # [ 0.167810] EDAC MC: Ver: 3.0.0764lb # [ 0.146292] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages765client # [ 0.154720] ACPI: Interpreter disabled.766lb # [ 0.146296] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page767client # [ 0.156595] iommu: Default domain type: Translated768worker2 # [ 0.172561] scmi_core: SCMI protocol bus registered769client # [ 0.156606] iommu: DMA domain TLB invalidation policy: strict mode770worker2 # [ 0.173533] FPGA manager framework771worker2 # [ 0.174471] vgaarb: loaded772client # [ 0.158235] SCSI subsystem initialized773lb # [ 0.153805] fbcon: Taking over console774lb # [ 0.153821] ACPI: Interpreter disabled.775worker2 # [ 0.175149] clocksource: Switched to clocksource arch_sys_counter776lb # [ 0.155801] iommu: Default domain type: Translated777worker2 # [ 0.175795] VFS: Disk quotas dquot_6.6.0778lb # [ 0.155812] iommu: DMA domain TLB invalidation policy: strict mode779worker2 # [ 0.175829] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)780lb # [ 0.157523] SCSI subsystem initialized781worker2 # [ 0.180452] netfs: FS-Cache loaded782worker2 # [ 0.180580] pnp: PnP ACPI: disabled783client # [ 0.166219] usbcore: registered new interface driver usbfs784client # [ 0.166254] usbcore: registered new interface driver hub785lb # [ 0.162700] usbcore: registered new interface driver usbfs786client # [ 0.166274] usbcore: registered new device driver usb787lb # [ 0.162742] usbcore: registered new interface driver hub788client # [ 0.166556] pps_core: LinuxPPS API ver. 1 registered789lb # [ 0.162761] usbcore: registered new device driver usb790lb # [ 0.163055] pps_core: LinuxPPS API ver. 1 registered791client # [ 0.166562] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>792client # [ 0.166572] PTP clock support registered793lb # [ 0.163061] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>794client # [ 0.166631] EDAC MC: Ver: 3.0.0795worker2 # [ 0.184712] NET: Registered PF_INET protocol family796lb # [ 0.163071] PTP clock support registered797lb # [ 0.163129] EDAC MC: Ver: 3.0.0798client # [ 0.171451] scmi_core: SCMI protocol bus registered799worker2 # [ 0.184986] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)800lb # [ 0.167896] scmi_core: SCMI protocol bus registered801client # [ 0.172443] FPGA manager framework802client # [ 0.173447] vgaarb: loaded803lb # [ 0.168892] FPGA manager framework804lb # [ 0.169836] vgaarb: loaded805client # [ 0.174106] clocksource: Switched to clocksource arch_sys_counter806lb # [ 0.170504] clocksource: Switched to clocksource arch_sys_counter807client # [ 0.174736] VFS: Disk quotas dquot_6.6.0808client # [ 0.174768] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)809client # [ 0.177156] netfs: FS-Cache loaded810client # [ 0.177275] pnp: PnP ACPI: disabled811worker1 # [ 0.218285] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)812worker1 # [ 0.218343] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)813lb # [ 0.176925] VFS: Disk quotas dquot_6.6.0814lb # [ 0.176980] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)815worker1 # [ 0.218378] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)816lb # [ 0.178731] netfs: FS-Cache loaded817worker1 # [ 0.218462] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)818lb # [ 0.178857] pnp: PnP ACPI: disabled819worker1 # [ 0.218622] TCP: Hash tables configured (established 16384 bind 16384)820worker1 # [ 0.218716] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)821worker1 # [ 0.218758] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)822client # [ 0.183534] NET: Registered PF_INET protocol family823worker1 # [ 0.218794] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)824client # [ 0.183814] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)825worker1 # [ 0.218887] NET: Registered PF_UNIX/PF_LOCAL protocol family826worker1 # [ 0.218972] NET: Registered PF_XDP protocol family827worker1 # [ 0.218993] PCI: CLS 0 bytes, default 64828worker1 # [ 0.219279] Trying to unpack rootfs image as initramfs...829lb # [ 0.182889] NET: Registered PF_INET protocol family830lb # [ 0.183175] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)831worker1 # [ 0.237462] kvm [1]: HYP mode not available832worker2 # [ 0.215428] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833worker2 # [ 0.215483] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834worker2 # [ 0.215513] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835worker2 # [ 0.215599] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)836worker2 # [ 0.215744] TCP: Hash tables configured (established 16384 bind 16384)837worker2 # [ 0.215839] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)838worker2 # [ 0.215876] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)839worker2 # [ 0.215913] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)840worker2 # [ 0.216004] NET: Registered PF_UNIX/PF_LOCAL protocol family841client # [ 0.213961] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)842worker2 # [ 0.216089] NET: Registered PF_XDP protocol family843client # [ 0.214013] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)844worker2 # [ 0.216109] PCI: CLS 0 bytes, default 64845worker2 # [ 0.216375] Trying to unpack rootfs image as initramfs...846client # [ 0.214045] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)847client # [ 0.217375] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)848worker2 # [ 0.239209] kvm [1]: HYP mode not available849client # [ 0.217524] TCP: Hash tables configured (established 16384 bind 16384)850lb # [ 0.213380] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)851client # [ 0.217614] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)852lb # [ 0.213438] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)853client # [ 0.217652] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)854lb # [ 0.213477] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)855client # [ 0.217699] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)856lb # [ 0.213564] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)857client # [ 0.217805] NET: Registered PF_UNIX/PF_LOCAL protocol family858lb # [ 0.213711] TCP: Hash tables configured (established 16384 bind 16384)859client # [ 0.217828] NET: Registered PF_XDP protocol family860client # [ 0.217848] PCI: CLS 0 bytes, default 64861lb # [ 0.213813] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)862client # [ 0.218092] Trying to unpack rootfs image as initramfs...863lb # [ 0.213854] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)864lb # [ 0.213891] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)865lb # [ 0.213993] NET: Registered PF_UNIX/PF_LOCAL protocol family866lb # [ 0.214043] NET: Registered PF_XDP protocol family867client # [ 0.233082] kvm [1]: HYP mode not available868lb # [ 0.214070] PCI: CLS 0 bytes, default 64869lb # [ 0.214326] Trying to unpack rootfs image as initramfs...870lb # [ 0.232490] kvm [1]: HYP mode not available871worker1 # [ 0.350619] Initialise system trusted keyrings872worker1 # [ 0.351443] workingset: timestamp_bits=42 max_order=19 bucket_order=0873worker1 # [ 0.352822] squashfs: version 4.0 (2009/01/31) Phillip Lougher874worker1 # [ 0.353600] 9p: Installing v9fs 9p2000 file system support875worker1 # [ 0.377544] Key type asymmetric registered876worker1 # [ 0.377586] Asymmetric key parser 'x509' registered877worker1 # [ 0.377665] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)878worker2 # [ 0.351839] Initialise system trusted keyrings879worker1 # [ 0.383450] io scheduler mq-deadline registered880worker1 # [ 0.383470] io scheduler kyber registered881client # [ 0.342723] Initialise system trusted keyrings882worker2 # [ 0.359249] workingset: timestamp_bits=42 max_order=19 bucket_order=0883client # [ 0.343515] workingset: timestamp_bits=42 max_order=19 bucket_order=0884worker2 # [ 0.360823] squashfs: version 4.0 (2009/01/31) Phillip Lougher885client # [ 0.344868] squashfs: version 4.0 (2009/01/31) Phillip Lougher886client # [ 0.345653] 9p: Installing v9fs 9p2000 file system support887worker2 # [ 0.361623] 9p: Installing v9fs 9p2000 file system support888lb # [ 0.344397] Initialise system trusted keyrings889worker1 # [ 0.395556] pl061_gpio 9030000.pl061: PL061 GPIO chip registered890lb # [ 0.345148] workingset: timestamp_bits=42 max_order=19 bucket_order=0891lb # [ 0.346394] squashfs: version 4.0 (2009/01/31) Phillip Lougher892worker1 # [ 0.397051] ledtrig-cpu: registered to indicate activity on CPUs893worker1 # [ 0.397452] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:894worker1 # [ 0.397471] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000895lb # [ 0.347279] 9p: Installing v9fs 9p2000 file system support896worker1 # [ 0.397483] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000897worker1 # [ 0.397492] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000898worker1 # [ 0.397514] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits899worker1 # [ 0.397540] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]900worker1 # [ 0.397635] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00901worker1 # [ 0.397645] pci_bus 0000:00: root bus resource [bus 00-ff]902worker1 # [ 0.397652] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]903worker1 # [ 0.397657] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]904worker2 # [ 0.382344] Key type asymmetric registered905worker1 # [ 0.397663] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]906worker2 # [ 0.382378] Asymmetric key parser 'x509' registered907worker1 # [ 0.397750] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint908worker2 # [ 0.382466] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)909worker1 # [ 0.398195] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint910worker1 # [ 0.398386] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]911worker1 # [ 0.398404] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]912worker1 # [ 0.398435] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]913worker1 # [ 0.398453] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]914lb # [ 0.367381] Key type asymmetric registered915lb # [ 0.367411] Asymmetric key parser 'x509' registered916worker1 # [ 0.398943] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint917worker1 # [ 0.399133] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]918lb # [ 0.367493] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)919worker1 # [ 0.399149] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]920client # [ 0.374365] Key type asymmetric registered921worker1 # [ 0.399180] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]922client # [ 0.374395] Asymmetric key parser 'x509' registered923worker2 # [ 0.391236] io scheduler mq-deadline registered924worker2 # [ 0.391259] io scheduler kyber registered925worker1 # [ 0.399673] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint926client # [ 0.374479] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)927worker1 # [ 0.399859] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]928client # [ 0.376726] io scheduler mq-deadline registered929worker1 # [ 0.399875] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]930client # [ 0.376737] io scheduler kyber registered931worker1 # [ 0.399905] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]932worker1 # [ 0.400357] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint933lb # [ 0.374570] io scheduler mq-deadline registered934lb # [ 0.374596] io scheduler kyber registered935worker1 # [ 0.400548] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]936worker1 # [ 0.400564] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]937worker2 # [ 0.396562] pl061_gpio 9030000.pl061: PL061 GPIO chip registered938worker1 # [ 0.400596] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]939worker1 # [ 0.401054] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint940worker1 # [ 0.401238] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]941worker2 # [ 0.397908] ledtrig-cpu: registered to indicate activity on CPUs942worker1 # [ 0.401255] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]943worker2 # [ 0.398317] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:944worker1 # [ 0.401285] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]945worker2 # [ 0.398335] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000946worker1 # [ 0.401748] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint947worker2 # [ 0.398347] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000948worker1 # [ 0.401936] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]949worker1 # [ 0.401952] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]950client # [ 0.386253] pl061_gpio 9030000.pl061: PL061 GPIO chip registered951worker2 # [ 0.398356] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000952worker1 # [ 0.401982] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]953worker2 # [ 0.398376] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits954worker1 # [ 0.402441] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint955worker2 # [ 0.398398] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]956worker1 # [ 0.402641] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]957client # [ 0.387755] ledtrig-cpu: registered to indicate activity on CPUs958worker1 # [ 0.402658] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]959worker2 # [ 0.398482] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00960worker2 # [ 0.398492] pci_bus 0000:00: root bus resource [bus 00-ff]961worker1 # [ 0.402688] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]962client # [ 0.388194] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:963worker2 # [ 0.398498] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]964worker1 # [ 0.402705] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]965lb # [ 0.386693] pl061_gpio 9030000.pl061: PL061 GPIO chip registered966client # [ 0.388215] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000967worker2 # [ 0.398512] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]968worker1 # [ 0.403210] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint969client # [ 0.388227] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000970worker2 # [ 0.398518] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]971client # [ 0.388235] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000972worker2 # [ 0.398585] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint973lb # [ 0.388172] ledtrig-cpu: registered to indicate activity on CPUs974client # [ 0.388255] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits975worker2 # [ 0.399033] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint976lb # [ 0.388597] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:977client # [ 0.388281] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]978lb # [ 0.388618] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000979client # [ 0.388359] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00980lb # [ 0.388632] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000981client # [ 0.388378] pci_bus 0000:00: root bus resource [bus 00-ff]982worker2 # [ 0.412470] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]983client # [ 0.388385] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]984lb # [ 0.388640] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000985worker2 # [ 0.412490] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]986client # [ 0.388390] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]987worker1 # [ 0.443455] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]988lb # [ 0.388667] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits989worker2 # [ 0.412522] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]990client # [ 0.388395] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]991worker1 # [ 0.443496] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]992worker2 # [ 0.412538] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]993lb # [ 0.388693] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]994client # [ 0.388492] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint995worker1 # [ 0.444010] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint996worker2 # [ 0.413015] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint997lb # [ 0.388775] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00998worker1 # [ 0.444206] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]999client # [ 0.388936] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1000worker2 # [ 0.413200] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1001lb # [ 0.388784] pci_bus 0000:00: root bus resource [bus 00-ff]1002client # [ 0.389124] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1003worker1 # [ 0.444237] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1004worker2 # [ 0.413217] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1005lb # [ 0.388790] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1006client # [ 0.389141] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1007lb # [ 0.388795] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1008worker2 # [ 0.413246] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1009worker1 # [ 0.444635] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1010client # [ 0.389170] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1011worker1 # [ 0.444818] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1012lb # [ 0.388801] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1013worker2 # [ 0.413706] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1014client # [ 0.389186] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1015worker2 # [ 0.413889] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1016worker1 # [ 0.445065] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1017lb # [ 0.388896] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1018client # [ 0.389657] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1019worker2 # [ 0.413905] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1020worker1 # [ 0.445355] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1021lb # [ 0.389342] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1022client # [ 0.389846] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1023worker1 # [ 0.445374] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1024worker2 # [ 0.413935] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1025lb # [ 0.389535] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1026client # [ 0.389862] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1027worker1 # [ 0.445404] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1028worker2 # [ 0.414394] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1029lb # [ 0.389552] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1030client # [ 0.389892] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1031worker2 # [ 0.414578] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1032worker1 # [ 0.445897] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1033lb # [ 0.389581] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1034worker1 # [ 0.446082] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1035worker2 # [ 0.414594] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1036lb # [ 0.389597] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1037worker1 # [ 0.446099] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1038worker2 # [ 0.414627] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1039client # [ 0.409551] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1040lb # [ 0.390067] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1041client # [ 0.409741] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1042worker1 # [ 0.446128] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1043worker2 # [ 0.415091] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1044lb # [ 0.390260] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1045client # [ 0.409757] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1046worker1 # [ 0.446749] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1047lb # [ 0.390276] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1048client # [ 0.409788] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1049worker1 # [ 0.446760] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1050lb # [ 0.390305] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1051worker1 # [ 0.446767] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1052worker1 # [ 0.446814] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1053lb # [ 0.409569] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1054lb # [ 0.409766] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1055worker1 # [ 0.446863] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1056lb # [ 0.409783] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1057worker1 # [ 0.446911] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1058lb # [ 0.409813] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1059worker1 # [ 0.446960] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1060lb # [ 0.410269] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1061worker1 # [ 0.447009] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1062lb # [ 0.410457] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1063lb # [ 0.410473] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1064worker1 # [ 0.447058] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1065worker1 # [ 0.447107] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1066worker1 # [ 0.447155] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1067worker1 # [ 0.447204] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1068worker2 # [ 0.435348] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1069worker2 # [ 0.435376] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1070worker1 # [ 0.447279] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1071worker2 # [ 0.435407] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1072worker1 # [ 0.447327] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1073worker2 # [ 0.435907] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1074worker1 # [ 0.447350] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1075worker2 # [ 0.436093] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1076client # [ 0.418315] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1077worker1 # [ 0.447372] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1078worker2 # [ 0.436110] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1079client # [ 0.418515] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1080client # [ 0.418531] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1081worker2 # [ 0.436140] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1082client # [ 0.418565] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1083worker2 # [ 0.436599] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1084worker2 # [ 0.436788] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1085client # [ 0.419062] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1086worker2 # [ 0.436805] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1087client # [ 0.419262] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1088client # [ 0.419278] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1089worker2 # [ 0.436834] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1090worker2 # [ 0.436852] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1091client # [ 0.419308] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1092worker2 # [ 0.437331] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1093client # [ 0.419763] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1094client # [ 0.419946] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1095worker2 # [ 0.437523] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1096client # [ 0.419961] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1097worker2 # [ 0.437554] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1098lb # [ 0.422534] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1099client # [ 0.419991] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1100worker1 # [ 0.479438] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1101worker2 # [ 0.438024] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1102lb # [ 0.423069] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1103client # [ 0.420448] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1104worker1 # [ 0.479470] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1105worker2 # [ 0.438215] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1106lb # [ 0.423263] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1107client # [ 0.420634] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1108worker1 # [ 0.479494] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1109worker2 # [ 0.438245] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1110lb # [ 0.423279] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1111client # [ 0.420649] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1112worker1 # [ 0.479517] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1113lb # [ 0.423308] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1114worker2 # [ 0.438643] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1115client # [ 0.420679] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1116worker1 # [ 0.479544] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1117worker2 # [ 0.438828] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1118lb # [ 0.423763] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1119client # [ 0.420695] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1120worker1 # [ 0.479570] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1121worker2 # [ 0.439079] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1122client # [ 0.421186] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1123worker1 # [ 0.479593] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1124client # [ 0.421377] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1125lb # [ 0.423952] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1126worker1 # [ 0.479617] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1127lb # [ 0.423967] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1128client # [ 0.421407] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1129worker1 # [ 0.479641] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1130lb # [ 0.423997] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1131worker1 # [ 0.479664] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1132client # [ 0.421867] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1133worker2 # [ 0.456929] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1134worker1 # [ 0.479686] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1135client # [ 0.422057] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1136worker2 # [ 0.456950] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1137lb # [ 0.424455] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1138lb # [ 0.424645] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1139client # [ 0.422087] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1140worker1 # [ 0.479708] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1141worker2 # [ 0.456980] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1142lb # [ 0.424661] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1143worker1 # [ 0.479729] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1144client # [ 0.422496] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1145worker2 # [ 0.457474] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1146lb # [ 0.424691] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1147worker1 # [ 0.479760] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1148client # [ 0.422682] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1149worker2 # [ 0.457657] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1150lb # [ 0.424707] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1151worker1 # [ 0.479783] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1152worker2 # [ 0.457673] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1153client # [ 0.422944] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1154worker1 # [ 0.479806] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1155lb # [ 0.425215] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1156worker2 # [ 0.457703] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1157client # [ 0.423269] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1158worker1 # [ 0.479828] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1159lb # [ 0.425411] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1160client # [ 0.423286] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1161worker2 # [ 0.458297] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1162worker1 # [ 0.479852] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1163lb # [ 0.425441] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1164client # [ 0.423316] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1165worker2 # [ 0.458308] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1166worker1 # [ 0.479883] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1167lb # [ 0.425910] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1168worker1 # [ 0.479893] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1169worker2 # [ 0.458314] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1170client # [ 0.423787] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1171lb # [ 0.426099] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1172client # [ 0.423970] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1173worker1 # [ 0.479898] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1174worker2 # [ 0.458360] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1175lb # [ 0.426129] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1176client # [ 0.423986] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1177worker1 # [ 0.481099] pci 0000:00:0a.0: enabling device (0000 -> 0002)1178worker2 # [ 0.458407] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1179client # [ 0.424016] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1180lb # [ 0.426544] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1181lb # [ 0.426738] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1182client # [ 0.424592] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1183worker2 # [ 0.458456] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1184client # [ 0.424603] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1185lb # [ 0.426990] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1186worker2 # [ 0.458504] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1187lb # [ 0.427286] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1188client # [ 0.424609] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1189worker2 # [ 0.458551] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1190lb # [ 0.427304] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1191client # [ 0.424653] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1192worker2 # [ 0.458599] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1193lb # [ 0.427333] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1194client # [ 0.424699] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1195worker2 # [ 0.458648] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1196lb # [ 0.427812] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1197lb # [ 0.428004] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1198client # [ 0.424746] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1199worker2 # [ 0.458695] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1200lb # [ 0.428020] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1201client # [ 0.424792] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1202worker2 # [ 0.458745] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1203lb # [ 0.428050] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1204client # [ 0.424839] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1205worker2 # [ 0.458822] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1206lb # [ 0.428640] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1207client # [ 0.424886] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1208worker2 # [ 0.458869] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1209lb # [ 0.428651] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1210worker2 # [ 0.458891] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1211client # [ 0.424934] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1212lb # [ 0.428657] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1213worker2 # [ 0.458913] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1214client # [ 0.424981] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1215lb # [ 0.428704] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1216worker2 # [ 0.458935] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1217client # [ 0.425028] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1218lb # [ 0.428753] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1219worker2 # [ 0.458961] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1220client # [ 0.425099] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1221lb # [ 0.428802] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1222worker2 # [ 0.458984] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1223client # [ 0.425146] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1224lb # [ 0.428850] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1225worker2 # [ 0.459006] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1226client # [ 0.425168] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1227worker2 # [ 0.459028] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1228lb # [ 0.428899] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1229client # [ 0.425190] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1230worker2 # [ 0.459052] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1231lb # [ 0.428947] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1232client # [ 0.425212] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1233worker2 # [ 0.459075] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1234client # [ 0.425238] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1235lb # [ 0.428995] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1236worker2 # [ 0.459100] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1237client # [ 0.425259] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1238lb # [ 0.429044] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1239worker2 # [ 0.459123] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1240client # [ 0.425282] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1241lb # [ 0.429093] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1242worker2 # [ 0.459144] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1243client # [ 0.425303] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1244lb # [ 0.429157] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1245client # [ 0.425325] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1246lb # [ 0.429205] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1247client # [ 0.425347] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1248lb # [ 0.429228] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1249client # [ 0.425370] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1250lb # [ 0.429250] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1251client # [ 0.425393] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1252lb # [ 0.429272] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1253client # [ 0.425415] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1254lb # [ 0.429297] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1255client # [ 0.425436] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1256lb # [ 0.429320] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1257client # [ 0.425457] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1258lb # [ 0.429343] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1259client # [ 0.425479] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1260lb # [ 0.429365] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1261client # [ 0.425500] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1262client # [ 0.425522] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1263lb # [ 0.429388] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1264client # [ 0.425544] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1265lb # [ 0.429413] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1266client # [ 0.425565] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1267lb # [ 0.429440] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1268worker1 # [ 0.526700] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1269client # [ 0.425588] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1270lb # [ 0.429463] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1271client # [ 0.425614] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1272lb # [ 0.429484] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1273client # [ 0.425624] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1274worker2 # [ 0.495302] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1275lb # [ 0.429506] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1276client # [ 0.425628] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1277worker2 # [ 0.495354] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1278lb # [ 0.429528] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1279worker1 # [ 0.530018] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1280worker2 # [ 0.495378] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1281lb # [ 0.429549] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1282worker2 # [ 0.495402] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1283lb # [ 0.429571] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1284worker2 # [ 0.495426] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1285lb # [ 0.429592] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1286worker2 # [ 0.495449] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1287lb # [ 0.429614] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1288worker2 # [ 0.495473] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1289lb # [ 0.429637] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1290worker2 # [ 0.495498] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1291lb # [ 0.429659] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1292worker2 # [ 0.495535] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1293lb # [ 0.429686] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1294lb # [ 0.429696] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1295worker2 # [ 0.495545] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1296lb # [ 0.429700] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1297worker2 # [ 0.495549] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1298worker2 # [ 0.496758] pci 0000:00:0a.0: enabling device (0000 -> 0002)1299client # [ 0.490880] pci 0000:00:0a.0: enabling device (0000 -> 0002)1300worker1 # [ 0.536668] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1301lb # [ 0.490954] pci 0000:00:0a.0: enabling device (0000 -> 0002)1302worker1 # [ 0.548138] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1303worker1 # [ 0.550206] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1304worker2 # [ 0.526641] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1305client # [ 0.512167] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1306worker1 # [ 0.561682] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1307lb # [ 0.512537] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1308worker1 # [ 0.565186] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1309worker1 # [ 0.567352] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1310worker2 # [ 0.536687] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1311client # [ 0.522385] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1312worker2 # [ 0.541377] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1313lb # [ 0.522808] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1314worker1 # [ 0.577531] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1315client # [ 0.530729] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1316client # [ 0.532824] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1317worker2 # [ 0.547413] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1318worker2 # [ 0.549599] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1319lb # [ 0.530771] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1320lb # [ 0.532899] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1321worker1 # [ 0.583633] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1322worker1 # [ 0.586890] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1323client # [ 0.544633] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1324worker2 # [ 0.559813] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1325worker2 # [ 0.562072] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1326lb # [ 0.543139] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1327lb # [ 0.545536] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1328client # [ 0.550677] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1329client # [ 0.553152] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1330worker1 # [ 0.604706] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1331worker2 # [ 0.573828] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1332worker1 # [ 0.607357] msm_serial: driver initialized1333lb # [ 0.556566] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1334worker1 # [ 0.608113] SuperH (H)SCI(F) driver initialized1335worker1 # [ 0.608174] STM32 USART driver initialized1336client # [ 0.563686] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1337client # [ 0.566013] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1338worker2 # [ 0.584177] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1339lb # [ 0.559845] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1340lb # [ 0.562024] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1341lb # [ 0.564108] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1342worker2 # [ 0.588643] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1343worker2 # [ 0.591066] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1344client # [ 0.577176] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1345client # [ 0.580694] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1346lb # [ 0.582825] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1347lb # [ 0.589203] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1348client # [ 0.595411] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1349worker2 # [ 0.612526] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1350worker1 # [ 0.644050] loop: module loaded1351lb # [ 0.591723] msm_serial: driver initialized1352worker1 # [ 0.644259] virtio_blk virtio5: 1/0/0 default/read/poll queues1353lb # [ 0.591883] SuperH (H)SCI(F) driver initialized1354lb # [ 0.591939] STM32 USART driver initialized1355worker1 # [ 0.645065] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1356client # [ 0.598199] msm_serial: driver initialized1357client # [ 0.598393] SuperH (H)SCI(F) driver initialized1358worker2 # [ 0.615431] msm_serial: driver initialized1359client # [ 0.598448] STM32 USART driver initialized1360worker2 # [ 0.615582] SuperH (H)SCI(F) driver initialized1361worker2 # [ 0.615638] STM32 USART driver initialized1362worker1 # [ 0.652098] megasas: 07.734.00.00-rc11363worker1 # [ 0.652825] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1364worker1 # [ 0.654904] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001365worker1 # [ 0.654931] Intel/Sharp Extended Query Table at 0x00311366worker1 # [ 0.664706] Using buffer write method1367worker1 # [ 0.664800] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1368worker1 # [ 0.666638] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001369worker1 # [ 0.666675] Intel/Sharp Extended Query Table at 0x00311370worker1 # [ 0.678388] Using buffer write method1371worker1 # [ 0.678426] Concatenating MTD devices:1372worker1 # [ 0.678429] (0): "0.flash"1373worker1 # [ 0.678434] (1): "0.flash"1374worker1 # [ 0.678437] into device "0.flash"1375client # [ 0.633331] loop: module loaded1376client # [ 0.633544] virtio_blk virtio5: 1/0/0 default/read/poll queues1377lb # [ 0.629704] loop: module loaded1378lb # [ 0.629897] virtio_blk virtio5: 1/0/0 default/read/poll queues1379client # [ 0.635486] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1380lb # [ 0.631826] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1381worker2 # [ 0.652905] loop: module loaded1382worker2 # [ 0.653847] virtio_blk virtio5: 1/0/0 default/read/poll queues1383worker2 # [ 0.654607] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1384client # [ 0.638717] megasas: 07.734.00.00-rc11385client # [ 0.639485] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1386lb # [ 0.642641] megasas: 07.734.00.00-rc11387lb # [ 0.643527] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1388client # [ 0.651308] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001389lb # [ 0.645859] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001390client # [ 0.651341] Intel/Sharp Extended Query Table at 0x00311391client # [ 0.653015] Using buffer write method1392lb # [ 0.645886] Intel/Sharp Extended Query Table at 0x00311393lb # [ 0.647575] Using buffer write method1394client # [ 0.653083] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1395worker2 # [ 0.667952] megasas: 07.734.00.00-rc11396lb # [ 0.647638] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1397worker2 # [ 0.668722] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1398lb # [ 0.649412] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001399worker2 # [ 0.671196] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001400lb # [ 0.649441] Intel/Sharp Extended Query Table at 0x00311401worker2 # [ 0.671222] Intel/Sharp Extended Query Table at 0x00311402worker2 # [ 0.672912] Using buffer write method1403worker2 # [ 0.672989] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1404worker2 # [ 0.674850] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001405worker2 # [ 0.674883] Intel/Sharp Extended Query Table at 0x00311406lb # [ 0.663151] Using buffer write method1407lb # [ 0.663189] Concatenating MTD devices:1408lb # [ 0.663194] (0): "0.flash"1409lb # [ 0.663197] (1): "0.flash"1410lb # [ 0.663201] into device "0.flash"1411client # [ 0.668772] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001412client # [ 0.668817] Intel/Sharp Extended Query Table at 0x00311413worker2 # [ 0.692911] Using buffer write method1414worker2 # [ 0.692955] Concatenating MTD devices:1415worker2 # [ 0.692959] (0): "0.flash"1416worker2 # [ 0.692963] (1): "0.flash"1417worker2 # [ 0.692967] into device "0.flash"1418client # [ 0.678754] Using buffer write method1419client # [ 0.678793] Concatenating MTD devices:1420client # [ 0.678797] (0): "0.flash"1421client # [ 0.678801] (1): "0.flash"1422client # [ 0.678804] into device "0.flash"1423worker1 # [ 0.942379] Freeing initrd memory: 26148K1424worker1 # [ 0.948658] tun: Universal TUN/TAP device driver, 1.61425worker1 # [ 0.952584] thunder_xcv, ver 1.01426worker1 # [ 0.952632] thunder_bgx, ver 1.01427worker1 # [ 0.952656] nicpf, ver 1.01428worker1 # [ 0.953244] e1000: Intel(R) PRO/1000 Network Driver1429worker1 # [ 0.953252] e1000: Copyright (c) 1999-2006 Intel Corporation.1430worker1 # [ 0.953277] e1000e: Intel(R) PRO/1000 Network Driver1431worker1 # [ 0.953286] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1432worker1 # [ 0.953316] igb: Intel(R) Gigabit Ethernet Network Driver1433worker1 # [ 0.953322] igb: Copyright (c) 2007-2014 Intel Corporation.1434worker1 # [ 0.953349] igbvf: Intel(R) Gigabit Virtual Function Network Driver1435worker1 # [ 0.953355] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1436worker1 # [ 0.953490] sky2: driver version 1.301437worker1 # [ 0.955150] usbcore: registered new interface driver usb-storage1438worker1 # [ 0.955231] usbcore: registered new interface driver usbserial_generic1439worker1 # [ 0.955247] usbserial: USB Serial support registered for generic1440worker1 # [ 0.956173] ehci-pci 0000:00:0a.0: EHCI Host Controller1441worker1 # [ 0.956199] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11442worker1 # [ 0.956446] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001443worker1 # [ 0.968310] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001444worker1 # [ 0.968707] hub 1-0:1.0: USB hub found1445worker1 # [ 0.968729] hub 1-0:1.0: 6 ports detected1446worker1 # [ 0.971428] hv_vmbus: registering driver hyperv_keyboard1447worker1 # [ 0.973084] rtc-pl031 9010000.pl031: registered as rtc01448lb # [ 0.922416] Freeing initrd memory: 26140K1449worker1 # [ 0.973120] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:07:27 UTC (1789891647)1450worker1 # [ 0.973441] i2c_dev: i2c /dev entries driver1451worker1 # [ 0.978623] sdhci: Secure Digital Host Controller Interface driver1452worker1 # [ 0.978637] sdhci: Copyright(c) Pierre Ossman1453lb # [ 0.928737] tun: Universal TUN/TAP device driver, 1.61454worker1 # [ 0.978924] Synopsys Designware Multimedia Card Interface Driver1455worker1 # [ 0.979332] sdhci-pltfm: SDHCI platform and OF driver helper1456client # [ 0.932475] Freeing initrd memory: 26160K1457worker2 # [ 0.950785] Freeing initrd memory: 26148K1458worker1 # [ 0.983976] hid: raw HID events driver (C) Jiri Kosina1459worker1 # [ 0.984279] usbcore: registered new interface driver usbhid1460lb # [ 0.933014] thunder_xcv, ver 1.01461client # [ 0.938753] tun: Universal TUN/TAP device driver, 1.61462worker1 # [ 0.984287] usbhid: USB HID core driver1463lb # [ 0.933065] thunder_bgx, ver 1.01464lb # [ 0.933088] nicpf, ver 1.01465lb # [ 0.933644] e1000: Intel(R) PRO/1000 Network Driver1466worker1 # [ 0.987233] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1467lb # [ 0.933651] e1000: Copyright (c) 1999-2006 Intel Corporation.1468lb # [ 0.933674] e1000e: Intel(R) PRO/1000 Network Driver1469lb # [ 0.933685] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1470worker2 # [ 0.958124] tun: Universal TUN/TAP device driver, 1.61471lb # [ 0.933714] igb: Intel(R) Gigabit Ethernet Network Driver1472worker1 # [ 0.989979] drop_monitor: Initializing network drop monitor service1473lb # [ 0.933719] igb: Copyright (c) 2007-2014 Intel Corporation.1474worker1 # [ 0.990137] NET: Registered PF_INET6 protocol family1475lb # [ 0.933742] igbvf: Intel(R) Gigabit Virtual Function Network Driver1476worker1 # [ 0.992368] Segment Routing with IPv61477lb # [ 0.933750] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1478worker1 # [ 0.992389] In-situ OAM (IOAM) with IPv61479lb # [ 0.933891] sky2: driver version 1.301480worker1 # [ 0.992433] NET: Registered PF_PACKET protocol family1481client # [ 0.942500] thunder_xcv, ver 1.01482client # [ 0.942540] thunder_bgx, ver 1.01483client # [ 0.942569] nicpf, ver 1.01484worker2 # [ 0.961970] thunder_xcv, ver 1.01485worker2 # [ 0.962020] thunder_bgx, ver 1.01486client # [ 0.943135] e1000: Intel(R) PRO/1000 Network Driver1487worker2 # [ 0.962044] nicpf, ver 1.01488worker1 # [ 0.994118] 9pnet: Installing 9P2000 support1489lb # [ 0.943179] ehci-pci 0000:00:0a.0: EHCI Host Controller1490client # [ 0.943142] e1000: Copyright (c) 1999-2006 Intel Corporation.1491worker2 # [ 0.962655] e1000: Intel(R) PRO/1000 Network Driver1492client # [ 0.943168] e1000e: Intel(R) PRO/1000 Network Driver1493lb # [ 0.943231] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11494worker2 # [ 0.962665] e1000: Copyright (c) 1999-2006 Intel Corporation.1495client # [ 0.943177] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1496lb # [ 0.943400] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001497worker2 # [ 0.962691] e1000e: Intel(R) PRO/1000 Network Driver1498client # [ 0.943208] igb: Intel(R) Gigabit Ethernet Network Driver1499worker2 # [ 0.962699] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1500client # [ 0.943214] igb: Copyright (c) 2007-2014 Intel Corporation.1501worker2 # [ 0.962729] igb: Intel(R) Gigabit Ethernet Network Driver1502lb # [ 0.945901] usbcore: registered new interface driver usb-storage1503client # [ 0.943238] igbvf: Intel(R) Gigabit Virtual Function Network Driver1504worker2 # [ 0.962735] igb: Copyright (c) 2007-2014 Intel Corporation.1505lb # [ 0.946032] usbcore: registered new interface driver usbserial_generic1506worker1 # [ 0.996969] Key type dns_resolver registered1507client # [ 0.943244] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1508worker2 # [ 0.962759] igbvf: Intel(R) Gigabit Virtual Function Network Driver1509lb # [ 0.946046] usbserial: USB Serial support registered for generic1510client # [ 0.943380] sky2: driver version 1.301511worker2 # [ 0.962764] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1512client # [ 0.945011] usbcore: registered new interface driver usb-storage1513worker2 # [ 0.962905] sky2: driver version 1.301514lb # [ 0.948867] hv_vmbus: registering driver hyperv_keyboard1515client # [ 0.945158] usbcore: registered new interface driver usbserial_generic1516client # [ 0.945173] usbserial: USB Serial support registered for generic1517lb # [ 0.950438] rtc-pl031 9010000.pl031: registered as rtc01518client # [ 0.945768] hv_vmbus: registering driver hyperv_keyboard1519lb # [ 0.950468] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:07:27 UTC (1789891647)1520client # [ 0.957096] ehci-pci 0000:00:0a.0: EHCI Host Controller1521lb # [ 0.952566] i2c_dev: i2c /dev entries driver1522client # [ 0.957127] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11523worker2 # [ 0.971798] usbcore: registered new interface driver usb-storage1524client # [ 0.957434] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001525worker2 # [ 0.971886] usbcore: registered new interface driver usbserial_generic1526worker1 # [ 1.003702] registered taskstats version 11527worker2 # [ 0.971901] usbserial: USB Serial support registered for generic1528worker1 # [ 1.003886] Loading compiled-in X.509 certificates1529worker2 # [ 0.972515] hv_vmbus: registering driver hyperv_keyboard1530client # [ 0.960097] rtc-pl031 9010000.pl031: registered as rtc01531worker2 # [ 0.974350] ehci-pci 0000:00:0a.0: EHCI Host Controller1532worker2 # [ 0.974380] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11533client # [ 0.960127] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:07:27 UTC (1789891647)1534client # [ 0.960482] i2c_dev: i2c /dev entries driver1535lb # [ 0.955993] sdhci: Secure Digital Host Controller Interface driver1536worker2 # [ 0.974556] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001537lb # [ 0.956007] sdhci: Copyright(c) Pierre Ossman1538lb # [ 0.956286] Synopsys Designware Multimedia Card Interface Driver1539lb # [ 0.956678] sdhci-pltfm: SDHCI platform and OF driver helper1540worker2 # [ 0.980178] rtc-pl031 9010000.pl031: registered as rtc01541lb # [ 0.958481] hid: raw HID events driver (C) Jiri Kosina1542worker1 # [ 1.012762] Demotion targets for Node 0: null1543worker1 # [ 1.012879] Key type .fscrypt registered1544worker2 # [ 0.980212] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:07:27 UTC (1789891647)1545lb # [ 0.958547] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001546worker1 # [ 1.012886] Key type fscrypt-provisioning registered1547worker2 # [ 0.980578] i2c_dev: i2c /dev entries driver1548client # [ 0.965583] sdhci: Secure Digital Host Controller Interface driver1549worker1 # [ 1.012984] ima: No TPM chip found, activating TPM-bypass!1550client # [ 0.965596] sdhci: Copyright(c) Pierre Ossman1551worker1 # [ 1.013003] ima: Allocated hash algorithm: sha11552client # [ 0.965866] Synopsys Designware Multimedia Card Interface Driver1553worker2 # [ 0.983657] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001554lb # [ 0.962902] usbcore: registered new interface driver usbhid1555worker1 # [ 1.013024] ima: No architecture policies found1556client # [ 0.966143] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001557lb # [ 0.962911] usbhid: USB HID core driver1558worker2 # [ 0.983979] hub 1-0:1.0: USB hub found1559client # [ 0.966483] hub 1-0:1.0: USB hub found1560worker2 # [ 0.984001] hub 1-0:1.0: 6 ports detected1561lb # [ 0.965389] hub 1-0:1.0: USB hub found1562client # [ 0.966501] hub 1-0:1.0: 6 ports detected1563worker1 # [ 1.017090] input: gpio-keys as /devices/platform/gpio-keys/input/input01564lb # [ 0.965858] hub 1-0:1.0: 6 ports detected1565lb # [ 0.966858] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1566client # [ 0.970647] sdhci-pltfm: SDHCI platform and OF driver helper1567lb # [ 0.968443] drop_monitor: Initializing network drop monitor service1568client # [ 0.972476] hid: raw HID events driver (C) Jiri Kosina1569lb # [ 0.968587] NET: Registered PF_INET6 protocol family1570worker2 # [ 0.988189] sdhci: Secure Digital Host Controller Interface driver1571client # [ 0.972737] usbcore: registered new interface driver usbhid1572client # [ 0.972744] usbhid: USB HID core driver1573worker2 # [ 0.988198] sdhci: Copyright(c) Pierre Ossman1574lb # [ 0.971626] Segment Routing with IPv61575worker2 # [ 0.988468] Synopsys Designware Multimedia Card Interface Driver1576lb # [ 0.971657] In-situ OAM (IOAM) with IPv61577lb # [ 0.971687] NET: Registered PF_PACKET protocol family1578worker2 # [ 0.988843] sdhci-pltfm: SDHCI platform and OF driver helper1579worker2 # [ 0.990662] hid: raw HID events driver (C) Jiri Kosina1580worker2 # [ 0.990902] usbcore: registered new interface driver usbhid1581client # [ 0.976423] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1582lb # [ 0.973356] 9pnet: Installing 9P2000 support1583worker2 # [ 0.990909] usbhid: USB HID core driver1584client # [ 0.977957] drop_monitor: Initializing network drop monitor service1585client # [ 0.978094] NET: Registered PF_INET6 protocol family1586client # [ 0.981151] Segment Routing with IPv61587client # [ 0.981182] In-situ OAM (IOAM) with IPv61588client # [ 0.981212] NET: Registered PF_PACKET protocol family1589lb # [ 0.976116] Key type dns_resolver registered1590worker2 # [ 0.996660] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1591worker2 # [ 0.998230] drop_monitor: Initializing network drop monitor service1592worker2 # [ 0.998388] NET: Registered PF_INET6 protocol family1593worker2 # [ 1.001524] Segment Routing with IPv61594worker2 # [ 1.001545] In-situ OAM (IOAM) with IPv61595client # [ 0.982900] 9pnet: Installing 9P2000 support1596worker2 # [ 1.001589] NET: Registered PF_PACKET protocol family1597client # [ 0.985057] Key type dns_resolver registered1598worker1 # [ 1.035644] clk: Disabling unused clocks1599lb # [ 0.982591] registered taskstats version 11600worker1 # [ 1.035672] PM: genpd: Disabling unused power domains1601worker2 # [ 1.003295] 9pnet: Installing 9P2000 support1602lb # [ 0.982797] Loading compiled-in X.509 certificates1603worker2 # [ 1.005876] Key type dns_resolver registered1604worker1 # [ 1.040026] Freeing unused kernel memory: 4736K1605worker1 # [ 1.040210] Run /init as init process1606client # [ 0.992247] registered taskstats version 11607client # [ 0.992418] Loading compiled-in X.509 certificates1608lb # [ 0.991633] Demotion targets for Node 0: null1609lb # [ 0.991756] Key type .fscrypt registered1610lb # [ 0.991762] Key type fscrypt-provisioning registered1611lb # [ 0.991855] ima: No TPM chip found, activating TPM-bypass!1612lb # [ 0.991874] ima: Allocated hash algorithm: sha11613worker2 # [ 1.013262] registered taskstats version 11614lb # [ 0.991896] ima: No architecture policies found1615worker2 # [ 1.013414] Loading compiled-in X.509 certificates1616lb # [ 0.996219] input: gpio-keys as /devices/platform/gpio-keys/input/input01617client # [ 1.001101] Demotion targets for Node 0: null1618client # [ 1.001210] Key type .fscrypt registered1619client # [ 1.001216] Key type fscrypt-provisioning registered1620client # [ 1.001306] ima: No TPM chip found, activating TPM-bypass!1621client # [ 1.001328] ima: Allocated hash algorithm: sha11622client # [ 1.001350] ima: No architecture policies found1623client # [ 1.005546] input: gpio-keys as /devices/platform/gpio-keys/input/input01624worker2 # [ 1.022023] Demotion targets for Node 0: null1625worker2 # [ 1.022141] Key type .fscrypt registered1626worker2 # [ 1.022148] Key type fscrypt-provisioning registered1627worker2 # [ 1.022252] ima: No TPM chip found, activating TPM-bypass!1628worker2 # [ 1.022272] ima: Allocated hash algorithm: sha11629worker2 # [ 1.022293] ima: No architecture policies found1630worker1 # [ 1.057712] systemd[1]: Successfully made /usr/ read-only.1631worker2 # [ 1.026439] input: gpio-keys as /devices/platform/gpio-keys/input/input01632lb # [ 1.014061] clk: Disabling unused clocks1633lb # [ 1.014098] PM: genpd: Disabling unused power domains1634lb # [ 1.018361] Freeing unused kernel memory: 4736K1635lb # [ 1.019153] Run /init as init process1636client # [ 1.023397] clk: Disabling unused clocks1637client # [ 1.023431] PM: genpd: Disabling unused power domains1638client # [ 1.027757] Freeing unused kernel memory: 4736K1639client # [ 1.027975] Run /init as init process1640worker2 # [ 1.045370] clk: Disabling unused clocks1641worker2 # [ 1.045421] PM: genpd: Disabling unused power domains1642worker2 # [ 1.049783] Freeing unused kernel memory: 4736K1643worker2 # [ 1.049996] Run /init as init process1644lb # [ 1.032902] systemd[1]: Successfully made /usr/ read-only.1645client # [ 1.044424] systemd[1]: Successfully made /usr/ read-only.1646worker2 # [ 1.065562] systemd[1]: Successfully made /usr/ read-only.1647worker1 # [ 1.215481] usb 1-1: new high-speed USB device number 2 using ehci-pci1648client # [ 1.214197] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker2 # [ 1.231244] usb 1-1: new high-speed USB device number 2 using ehci-pci1650lb # [ 1.214628] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker1 # [ 1.369817] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652worker1 # [ 1.392457] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1653worker1 # [ 1.396580] systemd[1]: Detected virtualization qemu.1654worker1 # [ 1.397335] systemd[1]: Detected architecture arm64.1655worker1 # [ 1.397966] systemd[1]: Running in initrd.1656worker1 # [ 1.398987] systemd[1]: Initializing machine ID from random generator.1657worker1 # [ 1.400105] systemd[1]: Hostname set to <worker1>.1658worker2 # [ 1.381179] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11659lb # [ 1.364532] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11660client # [ 1.368705] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11661lb # [ 1.367756] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1662lb # [ 1.367791] systemd[1]: Detected virtualization qemu.1663lb # [ 1.367835] systemd[1]: Detected architecture arm64.1664lb # [ 1.367848] systemd[1]: Running in initrd.1665lb # [ 1.368372] systemd[1]: Initializing machine ID from random generator.1666lb # [ 1.368518] systemd[1]: Hostname set to <lb>.1667client # [ 1.379300] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1668client # [ 1.392226] systemd[1]: Detected virtualization qemu.1669worker2 # [ 1.400493] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1670client # [ 1.392361] systemd[1]: Detected architecture arm64.1671worker2 # [ 1.412905] systemd[1]: Detected virtualization qemu.1672client # [ 1.392390] systemd[1]: Running in initrd.1673worker2 # [ 1.414953] systemd[1]: Detected architecture arm64.1674client # [ 1.393528] systemd[1]: Initializing machine ID from random generator.1675worker2 # [ 1.418344] systemd[1]: Running in initrd.1676client # [ 1.393829] systemd[1]: Hostname set to <client>.1677worker1 # [ 1.451621] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01678worker2 # [ 1.421017] systemd[1]: Initializing machine ID from random generator.1679worker2 # [ 1.424032] systemd[1]: Hostname set to <worker2>.1680lb # [ 1.446769] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681client # [ 1.450522] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682worker2 # [ 1.471582] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker1 # [ 1.571472] usb 1-2: new high-speed USB device number 3 using ehci-pci1684lb # [ 1.566565] usb 1-2: new high-speed USB device number 3 using ehci-pci1685client # [ 1.574169] usb 1-2: new high-speed USB device number 3 using ehci-pci1686worker2 # [ 1.595202] usb 1-2: new high-speed USB device number 3 using ehci-pci1687worker1 # [ 1.675069] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688worker1 # [ 1.730110] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21689worker1 # [ 1.733370] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01690worker2 # [ 1.738209] systemd[1]: bpf-restrict-fs: LSM BPF program attached1691lb # [ 1.716668] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21692worker1 # [ 1.774401] systemd[1]: Queued start job for default target Initrd Default Target.1693lb # [ 1.722455] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01694client # [ 1.730038] systemd[1]: bpf-restrict-fs: LSM BPF program attached1695worker1 # [ 1.786879] systemd[1]: Created slice Slice /system/modprobe.1696worker2 # [ 1.751828] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21697worker1 # [ 1.788203] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1698worker1 # [ 1.789570] systemd[1]: Expecting device /dev/disk/by-label/nixos...1699worker1 # [ 1.790699] systemd[1]: Reached target Path Units.1700worker1 # [ 1.791770] systemd[1]: Reached target Slice Units.1701worker1 # [ 1.792632] systemd[1]: Reached target Swaps.1702worker2 # [ 1.757645] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01703worker1 # [ 1.793413] systemd[1]: Reached target Timer Units.1704client # [ 1.741793] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21705worker1 # [ 1.794471] systemd[1]: Listening on D-Bus System Message Bus Socket.1706worker1 # [ 1.795802] systemd[1]: Listening on Journal Socket (/dev/log).1707worker1 # [ 1.795961] systemd[1]: Listening on Journal Sockets.1708client # [ 1.747800] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01709worker1 # [ 1.796104] systemd[1]: Listening on udev Control Socket.1710worker1 # [ 1.796222] systemd[1]: Listening on udev Kernel Socket.1711worker1 # [ 1.796247] systemd[1]: Reached target Socket Units.1712worker1 # [ 1.802387] systemd[1]: Starting Create List of Static Device Nodes...1713worker1 # [ 1.811578] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1714worker1 # [ 1.811685] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1715worker1 # [ 1.819666] systemd[1]: Mounting Kernel Configuration File System...1716lb # [ 1.775272] systemd[1]: bpf-restrict-fs: LSM BPF program attached1717worker1 # [ 1.850063] systemd[1]: Starting Journal Service...1718worker1 # [ 1.856691] systemd[1]: Starting Load Kernel Modules...1719worker1 # [ 1.857586] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1720worker1 # [ 1.868929] systemd[1]: Starting Coldplug All udev Devices...1721worker2 # [ 1.857857] systemd[1]: Queued start job for default target Initrd Default Target.1722worker1 # [ 1.887575] systemd[1]: Finished Create List of Static Device Nodes.1723client # [ 1.842775] systemd[1]: Queued start job for default target Initrd Default Target.1724worker1 # [ 1.888500] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1725worker1 # [ 1.888807] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1726worker1 # [ 1.889042] systemd[1]: Mounted Kernel Configuration File System.1727client # [ 1.852611] systemd[1]: Created slice Slice /system/modprobe.1728client # [ 1.853746] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1729client # [ 1.855105] systemd[1]: Expecting device /dev/disk/by-label/nixos...1730worker2 # [ 1.870916] systemd[1]: Created slice Slice /system/modprobe.1731client # [ 1.856121] systemd[1]: Reached target Path Units.1732client # [ 1.856875] systemd[1]: Reached target Slice Units.1733worker2 # [ 1.872603] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1734client # [ 1.857661] systemd[1]: Reached target Swaps.1735client # [ 1.858421] systemd[1]: Reached target Timer Units.1736worker2 # [ 1.874205] systemd[1]: Expecting device /dev/disk/by-label/nixos...1737worker2 # [ 1.875582] systemd[1]: Reached target Path Units.1738client # [ 1.859397] systemd[1]: Listening on D-Bus System Message Bus Socket.1739worker2 # [ 1.876566] systemd[1]: Reached target Slice Units.1740client # [ 1.860532] systemd[1]: Listening on Journal Socket (/dev/log).1741worker2 # [ 1.877574] systemd[1]: Reached target Swaps.1742worker2 # [ 1.878477] systemd[1]: Reached target Timer Units.1743client # [ 1.861680] systemd[1]: Listening on Journal Sockets.1744worker2 # [ 1.879768] systemd[1]: Listening on D-Bus System Message Bus Socket.1745worker1 # [ 1.907824] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1746client # [ 1.864243] systemd[1]: Listening on udev Control Socket.1747worker2 # [ 1.881247] systemd[1]: Listening on Journal Socket (/dev/log).1748client # [ 1.865376] systemd[1]: Listening on udev Kernel Socket.1749client # [ 1.866400] systemd[1]: Reached target Socket Units.1750worker2 # [ 1.882609] systemd[1]: Listening on Journal Sockets.1751worker2 # [ 1.883927] systemd[1]: Listening on udev Control Socket.1752lb # [ 1.864044] systemd[1]: Queued start job for default target Initrd Default Target.1753worker2 # [ 1.885165] systemd[1]: Listening on udev Kernel Socket.1754client # [ 1.869240] systemd[1]: Starting Create List of Static Device Nodes...1755worker2 # [ 1.886307] systemd[1]: Reached target Socket Units.1756worker2 # [ 1.889256] systemd[1]: Starting Create List of Static Device Nodes...1757lb # [ 1.872565] systemd[1]: Created slice Slice /system/modprobe.1758lb # [ 1.873598] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1759lb # [ 1.874795] systemd[1]: Expecting device /dev/disk/by-label/nixos...1760lb # [ 1.875685] systemd[1]: Reached target Path Units.1761client # [ 1.878350] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1762lb # [ 1.876374] systemd[1]: Reached target Slice Units.1763lb # [ 1.877084] systemd[1]: Reached target Swaps.1764lb # [ 1.877714] systemd[1]: Reached target Timer Units.1765client # [ 1.878473] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1766lb # [ 1.878639] systemd[1]: Listening on D-Bus System Message Bus Socket.1767worker2 # [ 1.899425] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1768lb # [ 1.879726] systemd[1]: Listening on Journal Socket (/dev/log).1769lb # [ 1.880680] systemd[1]: Listening on Journal Sockets.1770worker2 # [ 1.900782] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1771lb # [ 1.881524] systemd[1]: Listening on udev Control Socket.1772lb # [ 1.882480] systemd[1]: Listening on udev Kernel Socket.1773lb # [ 1.883282] systemd[1]: Reached target Socket Units.1774lb # [ 1.885417] systemd[1]: Starting Create List of Static Device Nodes...1775worker2 # [ 1.907473] systemd[1]: Mounting Kernel Configuration File System...1776client # [ 1.892117] systemd[1]: Mounting Kernel Configuration File System...1777lb # [ 1.892115] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1778lb # [ 1.893113] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1779worker1 # [ 1.941538] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1780worker1 # [ 1.943893] systemd-journald[73]: Collecting audit messages is disabled.1781lb # [ 1.902620] systemd[1]: Mounting Kernel Configuration File System...1782client # [ 1.909709] systemd[1]: Starting Journal Service...1783worker1 # [ 1.959493] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1784worker1 # [ 1.962422] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1785lb # [ 1.916835] systemd[1]: Starting Journal Service...1786client # [ 1.922379] systemd[1]: Starting Load Kernel Modules...1787worker1 # [ 1.968973] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01788worker1 # [ 1.969233] [drm] features: -virgl +edid -resource_blob -host_visible1789client # [ 1.923465] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1790worker1 # [ 1.969243] [drm] features: -context_init1791worker1 # [ 1.969991] [drm] number of scanouts: 11792worker1 # [ 1.970009] [drm] number of cap sets: 01793worker2 # [ 1.943455] systemd[1]: Starting Journal Service...1794worker2 # [ 1.951519] systemd[1]: Starting Load Kernel Modules...1795worker2 # [ 1.952556] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1796worker1 # [ 1.979821] systemd[1]: Starting Create Static Device Nodes in /dev...1797client # [ 1.938355] systemd[1]: Starting Coldplug All udev Devices...1798lb # [ 1.934738] systemd[1]: Starting Load Kernel Modules...1799lb # [ 1.934862] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1800client # [ 1.942258] systemd[1]: Finished Create List of Static Device Nodes.1801worker2 # [ 1.963305] systemd[1]: Starting Coldplug All udev Devices...1802worker1 # [ 1.992414] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1803worker1 # [ 1.992440] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01804lb # [ 1.945087] systemd[1]: Starting Coldplug All udev Devices...1805client # [ 1.951418] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1806worker2 # [ 1.979371] systemd[1]: Finished Create List of Static Device Nodes.1807worker2 # [ 1.980341] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1808worker2 # [ 1.980709] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1809client # [ 1.966708] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1810worker2 # [ 1.980974] systemd[1]: Mounted Kernel Configuration File System.1811lb # [ 1.962656] systemd[1]: Finished Create List of Static Device Nodes.1812lb # [ 1.963835] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1813lb # [ 1.964156] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1814lb # [ 1.964392] systemd[1]: Mounted Kernel Configuration File System.1815client # [ 1.980549] systemd-journald[73]: Collecting audit messages is disabled.1816worker1 # [ 2.024778] Console: switching to colour frame buffer device 160x501817lb # [ 1.978933] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1818worker2 # [ 1.999722] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1819client # [ 1.994417] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1820client # [ 1.994959] systemd[1]: Mounted Kernel Configuration File System.1821client # [ 2.000574] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1822worker1 # [ 2.048109] systemd[1]: Finished Create Static Device Nodes in /dev.1823worker1 # [ 2.048547] systemd[1]: Reached target Preparation for Local File Systems.1824worker1 # [ 2.048580] systemd[1]: Reached target Local File Systems.1825worker1 # [ 2.052714] systemd[1]: Starting Rule-based Manager for Device Events and Files...1826worker2 # [ 2.022648] systemd-journald[73]: Collecting audit messages is disabled.1827client # [ 2.014259] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1828worker1 # [ 2.060212] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1829lb # [ 2.010104] systemd-journald[73]: Collecting audit messages is disabled.1830lb # [ 2.010870] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1831worker2 # [ 2.033007] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1832client # [ 2.018881] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1833client # [ 2.022526] systemd[1]: Starting Create Static Device Nodes in /dev...1834lb # [ 2.018890] systemd[1]: Starting Create Static Device Nodes in /dev...1835client # [ 2.029197] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01836client # [ 2.029453] [drm] features: -virgl +edid -resource_blob -host_visible1837client # [ 2.029462] [drm] features: -context_init1838lb # [ 2.027182] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1839worker1 # [ 2.080074] systemd[1]: Finished Load Kernel Modules.1840worker1 # [ 2.084524] systemd[1]: Starting Apply Kernel Variables...1841lb # [ 2.034694] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1842client # [ 2.043827] [drm] number of scanouts: 11843client # [ 2.043861] [drm] number of cap sets: 01844worker2 # [ 2.055305] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1845client # [ 2.045448] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1846worker2 # [ 2.060258] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01847client # [ 2.045466] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01848worker2 # [ 2.060504] [drm] features: -virgl +edid -resource_blob -host_visible1849worker2 # [ 2.060514] [drm] features: -context_init1850worker2 # [ 2.061252] [drm] number of scanouts: 11851worker2 # [ 2.061270] [drm] number of cap sets: 01852lb # [ 2.043491] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01853lb # [ 2.043736] [drm] features: -virgl +edid -resource_blob -host_visible1854lb # [ 2.043746] [drm] features: -context_init1855lb # [ 2.044468] [drm] number of scanouts: 11856lb # [ 2.044486] [drm] number of cap sets: 01857worker2 # [ 2.068012] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1858worker2 # [ 2.070761] systemd[1]: Starting Create Static Device Nodes in /dev...1859worker2 # [ 2.083658] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1860worker2 # [ 2.083685] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01861lb # [ 2.071011] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1862lb # [ 2.071035] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01863worker1 # [ 2.136288] systemd[1]: Finished Apply Kernel Variables.1864client # [ 2.082594] Console: switching to colour frame buffer device 160x501865worker1 # [ 2.119621] systemd-modules-load[74]: Inserted module 'dm_mod'1866client # [ 2.089618] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1867worker1 # [ 2.140189] systemd[1]: Started Journal Service.1868lb # [ 2.091281] systemd[1]: Finished Create Static Device Nodes in /dev.1869lb # [ 2.091493] systemd[1]: Reached target Preparation for Local File Systems.1870lb # [ 2.091520] systemd[1]: Reached target Local File Systems.1871worker1 # [ 2.128474] systemd-modules-load[74]: Module 'virtio_balloon' is built in1872lb # [ 2.095597] systemd[1]: Starting Rule-based Manager for Device Events and Files...1873client # [ 2.103116] systemd[1]: Finished Create Static Device Nodes in /dev.1874client # [ 2.103420] systemd[1]: Reached target Preparation for Local File Systems.1875worker2 # [ 2.115597] Console: switching to colour frame buffer device 160x501876client # [ 2.103462] systemd[1]: Reached target Local File Systems.1877worker1 # [ 2.136150] systemd-modules-load[74]: Module 'virtio_console' is built in1878worker2 # [ 2.122478] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1879client # [ 2.110590] systemd[1]: Starting Rule-based Manager for Device Events and Files...1880worker1 # [ 2.140345] systemd-modules-load[74]: Inserted module 'virtio_gpu'1881worker1 # [ 2.142890] systemd-modules-load[74]: Module 'virtio_rng' is built in1882worker1 # [ 2.144719] systemd[1]: Starting Create System Files and Directories...1883lb # [ 2.108251] Console: switching to colour frame buffer device 160x501884lb # [ 2.115204] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1885worker2 # [ 2.139941] systemd[1]: Finished Create Static Device Nodes in /dev.1886worker2 # [ 2.140413] systemd[1]: Reached target Preparation for Local File Systems.1887worker2 # [ 2.140458] systemd[1]: Reached target Local File Systems.1888worker2 # [ 2.151754] systemd[1]: Starting Rule-based Manager for Device Events and Files...1889client # [ 2.136159] systemd[1]: Finished Load Kernel Modules.1890worker1 # [ 2.172519] systemd-udevd[79]: Using default interface naming scheme 'v261'.1891client # [ 2.146699] systemd[1]: Starting Apply Kernel Variables...1892lb # [ 2.143537] systemd[1]: Finished Load Kernel Modules.1893worker2 # [ 2.171574] systemd[1]: Finished Load Kernel Modules.1894worker1 # [ 2.184830] systemd[1]: Finished Create System Files and Directories.1895lb # [ 2.158738] systemd[1]: Starting Apply Kernel Variables...1896worker2 # [ 2.188579] systemd[1]: Starting Apply Kernel Variables...1897worker1 # [ 2.206869] systemd[1]: Started Rule-based Manager for Device Events and Files.1898client # [ 2.199243] systemd[1]: Finished Apply Kernel Variables.1899worker2 # [ 2.208488] systemd-modules-load[74]: Inserted module 'dm_mod'1900worker2 # [ 2.224823] systemd[1]: Started Journal Service.1901client # [ 2.197152] systemd-modules-load[74]: Inserted module 'dm_mod'1902client # [ 2.212480] systemd[1]: Started Journal Service.1903client # [ 2.204463] systemd-modules-load[74]: Module 'virtio_balloon' is built in1904client # [ 2.205822] systemd-modules-load[74]: Module 'virtio_console' is built in1905client # [ 2.207072] systemd-modules-load[74]: Inserted module 'virtio_gpu'1906worker2 # [ 2.224268] systemd-modules-load[74]: Module 'virtio_balloon' is built in1907worker2 # [ 2.225564] systemd-modules-load[74]: Module 'virtio_console' is built in1908lb # [ 2.219387] systemd[1]: Finished Apply Kernel Variables.1909worker2 # [ 2.228357] systemd-modules-load[74]: Inserted module 'virtio_gpu'1910lb # [ 2.224323] systemd[1]: Started Journal Service.1911worker2 # [ 2.232418] systemd-modules-load[74]: Module 'virtio_rng' is built in1912client # [ 2.218059] systemd-modules-load[74]: Module 'virtio_rng' is built in1913worker2 # [ 2.238288] systemd[1]: Starting Create System Files and Directories...1914client # [ 2.224392] systemd[1]: Starting Create System Files and Directories...1915lb # [ 2.220540] systemd-modules-load[74]: Inserted module 'dm_mod'1916worker2 # [ 2.240604] systemd[1]: Finished Apply Kernel Variables.1917worker1 # [ 2.272280] systemd[1]: Starting Virtual Console Setup...1918lb # [ 2.225294] systemd-modules-load[74]: Module 'virtio_balloon' is built in1919lb # [ 2.226507] systemd-modules-load[74]: Module 'virtio_console' is built in1920lb # [ 2.227656] systemd-modules-load[74]: Inserted module 'virtio_gpu'1921client # [ 2.232655] systemd-udevd[80]: Using default interface naming scheme 'v261'.1922lb # [ 2.236565] systemd-modules-load[74]: Module 'virtio_rng' is built in1923worker2 # [ 2.257762] systemd-udevd[79]: Using default interface naming scheme 'v261'.1924lb # [ 2.239480] systemd-udevd[80]: Using default interface naming scheme 'v261'.1925lb # [ 2.244502] systemd[1]: Starting Create System Files and Directories...1926worker2 # [ 2.279702] systemd[1]: Finished Create System Files and Directories.1927client # [ 2.274561] systemd[1]: Started Rule-based Manager for Device Events and Files.1928worker1 # [ 2.324513] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1929lb # [ 2.278577] systemd[1]: Finished Create System Files and Directories.1930worker2 # [ 2.299140] systemd[1]: Started Rule-based Manager for Device Events and Files.1931client # [ 2.285050] systemd[1]: Finished Create System Files and Directories.1932worker1 # [ 2.328203] systemd[1]: Finished Virtual Console Setup.1933lb # [ 2.289978] systemd[1]: Started Rule-based Manager for Device Events and Files.1934client # [ 2.352129] systemd[1]: Starting Virtual Console Setup...1935worker2 # [ 2.368337] systemd[1]: Starting Virtual Console Setup...1936lb # [ 2.364224] systemd[1]: Starting Virtual Console Setup...1937client # [ 2.400603] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1938client # [ 2.404536] systemd[1]: Finished Virtual Console Setup.1939worker2 # [ 2.420576] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1940worker2 # [ 2.428219] systemd[1]: Finished Virtual Console Setup.1941lb # [ 2.416610] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1942lb # [ 2.419480] systemd[1]: Finished Virtual Console Setup.1943worker1 # [ 2.985116] systemd[1]: Finished Coldplug All udev Devices.1944worker1 # [ 2.986084] systemd[1]: Reached target System Initialization.1945worker1 # [ 2.986902] systemd[1]: Reached target Basic System.1946client # [ 3.029172] systemd[1]: Finished Coldplug All udev Devices.1947client # [ 3.030540] systemd[1]: Reached target System Initialization.1948client # [ 3.032433] systemd[1]: Reached target Basic System.1949worker2 # [ 3.057273] systemd[1]: Finished Coldplug All udev Devices.1950worker2 # [ 3.058208] systemd[1]: Reached target System Initialization.1951lb # [ 3.038899] systemd[1]: Finished Coldplug All udev Devices.1952worker2 # [ 3.059039] systemd[1]: Reached target Basic System.1953lb # [ 3.040536] systemd[1]: Reached target System Initialization.1954lb # [ 3.041396] systemd[1]: Reached target Basic System.1955worker1 # [ 3.144665] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1956worker1 # [ 3.180389] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1957worker1 # [ 3.184374] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1958client # [ 3.179798] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1959worker2 # [ 3.223319] (udev-worker)[107]: Network interface NamePolicy= disabled on kernel command line.1960client # [ 3.221927] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1961lb # [ 3.219714] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1962client # [ 3.231575] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1963worker1 # [ 3.274803] systemd[1]: Found device /dev/disk/by-label/nixos.1964worker1 # [ 3.279363] systemd[1]: Reached target Initrd Root Device.1965worker1 # [ 3.283646] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1966lb # [ 3.237168] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1967worker2 # [ 3.268831] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1968worker2 # [ 3.276920] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1969lb # [ 3.260125] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1970worker1 # [ 3.332606] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1971worker1 # [ 3.343756] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1972worker1 # [ 3.347335] systemd[1]: Mounting /sysroot...1973worker2 # [ 3.323518] systemd[1]: Found device /dev/disk/by-label/nixos.1974worker2 # [ 3.329773] systemd[1]: Reached target Initrd Root Device.1975worker2 # [ 3.332204] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1976lb # [ 3.312461] systemd[1]: Found device /dev/disk/by-label/nixos.1977lb # [ 3.315399] systemd[1]: Reached target Initrd Root Device.1978client # [ 3.320502] systemd[1]: Found device /dev/disk/by-label/nixos.1979client # [ 3.325548] systemd[1]: Reached target Initrd Root Device.1980lb # [ 3.319671] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1981client # [ 3.328938] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1982worker1 # [ 3.402834] EXT4-fs (vda): mounted filesystem 9c9302c7-fe62-44fc-af33-6f232b06fb79 r/w with ordered data mode. Quota mode: none.1983worker1 # [ 3.389852] systemd[1]: Mounted /sysroot.1984worker1 # [ 3.391864] systemd[1]: Reached target Initrd Root File System.1985worker1 # [ 3.397464] systemd[1]: Starting Mountpoints Configured in the Real Root...1986worker2 # [ 3.388984] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1987client # [ 3.374097] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1988lb # [ 3.376754] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1989client # [ 3.382781] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1990worker2 # [ 3.399372] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1991client # [ 3.384941] systemd[1]: Mounting /sysroot...1992worker1 # [ 3.430748] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload.1993worker2 # [ 3.406749] systemd[1]: Mounting /sysroot...1994lb # [ 3.390036] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1995lb # [ 3.393704] systemd[1]: Mounting /sysroot...1996worker1 # [ 3.440075] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)...1997worker1 # [ 3.444043] systemd[1]: Reloading...1998client # [ 3.437841] EXT4-fs (vda): mounted filesystem f6787985-d969-4b70-8afd-a98abe1dac98 r/w with ordered data mode. Quota mode: none.1999client # [ 3.429890] systemd[1]: Mounted /sysroot.2000client # [ 3.433145] systemd[1]: Reached target Initrd Root File System.
loading 1,492 hidden lines…
3493lb # [ 20.685240] envoy[912]: [2026-09-20 08:07:47.144][912][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3494lb # [ 20.687455] envoy[912]: [2026-09-20 08:07:47.144][912][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83495lb # [ 20.690536] envoy[912]: [2026-09-20 08:07:47.144][912][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3496lb # [ 20.692884] envoy[912]: [2026-09-20 08:07:47.144][912][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3497lb # [ 20.696438] envoy[912]: [2026-09-20 08:07:47.144][912][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3498lb # [ 20.698470] envoy[912]: [2026-09-20 08:07:47.144][912][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3499lb # [ 20.703601] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3500lb # [ 20.740882] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3501lb # [ 20.743434] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3502lb # [ 20.747487] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3503lb # [ 20.749757] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3504lb # [ 20.755758] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3505lb # [ 20.759166] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3506lb # [ 20.762206] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3507lb # [ 20.765006] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3508lb # [ 20.771932] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3509lb # [ 20.775724] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3510lb # [ 20.777883] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3511lb # [ 20.780483] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3512lb # [ 20.787855] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3513lb # [ 20.790054] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3514lb # [ 20.793553] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3515lb # [ 20.795696] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3516lb # [ 20.799606] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3517lb # [ 20.801849] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3518lb # [ 20.803779] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3519lb # [ 20.808975] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23520lb # [ 20.811352] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3521lb # [ 20.814090] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3522lb # [ 20.816333] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3523lb # [ 20.818510] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3524lb # [ 20.821813] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3525lb # [ 20.825236] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3526lb # [ 20.827148] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3527lb # [ 20.830034] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3528lb # [ 20.831876] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3529lb # [ 20.840911] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3530lb # [ 20.843585] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3531lb # [ 20.849503] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3532lb # [ 20.851653] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13533lb # [ 20.854196] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3534lb # [ 20.855876] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3535lb # [ 20.858240] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3536lb # [ 20.861165] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23537lb # [ 20.862886] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3538lb # [ 20.866201] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3539lb # [ 20.871703] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3540lb # [ 20.875723] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3541lb # [ 20.879622] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3542lb # [ 20.882207] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3543lb # [ 20.887250] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3544lb # [ 20.889541] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3545lb # [ 20.891572] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3546lb # [ 20.894170] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3547lb # [ 20.896973] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3548lb # [ 20.899732] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3549lb # [ 20.901968] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3550lb # [ 20.904311] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3551lb # [ 20.918711] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3552lb # [ 20.920617] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3553lb # [ 20.925786] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3554lb # [ 20.930941] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3555lb # [ 20.934974] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3556lb # [ 20.942886] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3557lb # [ 20.944946] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3558lb # [ 20.947833] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3559lb # [ 20.950916] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3560lb # [ 20.954490] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3561lb # [ 20.956601] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3562lb # [ 20.958644] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23563lb # [ 20.961080] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3564lb # [ 20.972478] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3565lb # [ 20.974457] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3566lb # [ 20.977732] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3567lb # [ 20.979833] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3568lb # [ 20.982828] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3569lb # [ 20.988242] envoy[912]: [2026-09-20 08:07:47.145][912][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3570lb # [ 20.995050] envoy[912]: [2026-09-20 08:07:47.195][912][info][main] [source/server/server.cc:531] HTTP header map info:3571lb # [ 20.997220] envoy[912]: [2026-09-20 08:07:47.209][912][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3572lb # [ 21.014239] envoy[912]: [2026-09-20 08:07:47.210][912][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3573lb # [ 21.015952] envoy[912]: [2026-09-20 08:07:47.210][912][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3574lb # [ 21.027218] envoy[912]: [2026-09-20 08:07:47.210][912][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3575lb # [ 21.030969] envoy[912]: [2026-09-20 08:07:47.451][912][info][main] [source/server/server.cc:968] runtime: {}3576lb # [ 21.033297] envoy[912]: [2026-09-20 08:07:47.481][912][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3577lb # [ 21.035651] envoy[912]: [2026-09-20 08:07:47.481][912][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013578lb # [ 21.038177] envoy[912]: [2026-09-20 08:07:47.482][912][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013579lb # [ 21.040852] envoy[912]: [2026-09-20 08:07:47.489][912][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3580lb # [ 21.044184] envoy[912]: [2026-09-20 08:07:47.489][912][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3581lb # [ 21.048272] envoy[912]: [2026-09-20 08:07:47.489][912][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3582lb # [ 21.078563] envoy[912]: [2026-09-20 08:07:47.642][912][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3583worker2 # [ 21.115015] systemd[1]: Starting Nix worker-protocol over gRPC...3584lb # [ 21.099311] envoy[912]: [2026-09-20 08:07:47.663][912][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3585worker1 # [ 21.148397] systemd[1]: Starting Nix worker-protocol over gRPC...3586lb # [ 21.102947] envoy[912]: [2026-09-20 08:07:47.666][912][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3587lb # [ 21.106861] envoy[912]: [2026-09-20 08:07:47.666][912][info][main] [source/server/server.cc:1077] starting main dispatch loop3588worker1 # [ 21.439484] nix-grpc-daemon[774]: ts=2026-09-20T08:07:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3589worker2 # [ 21.412890] nix-grpc-daemon[776]: ts=2026-09-20T08:07:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3590worker1 # [ 21.452457] nix-grpc-daemon[774]: ts=2026-09-20T08:07:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13591worker2 # [ 21.426229] nix-grpc-daemon[776]: ts=2026-09-20T08:07:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13592worker2 # [ 21.474859] nix-grpc-daemon[776]: ts=2026-09-20T08:07:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3593worker1 # [ 21.499579] nix-grpc-daemon[774]: ts=2026-09-20T08:07:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3594worker1 # [ 21.506138] systemd[1]: Started Nix worker-protocol over gRPC.3595worker2 # [ 21.483524] systemd[1]: Started Nix worker-protocol over gRPC.3596worker2 # [ 21.503052] nix-grpc-daemon[776]: ts=2026-09-20T08:07:48Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3597worker1 # [ 21.531138] nix-grpc-daemon[774]: ts=2026-09-20T08:07:48Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3598lb # [ 21.498989] envoy[912]: [2026-09-20 08:07:48.062][912][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3599lb # [ 21.507807] envoy[912]: [2026-09-20 08:07:48.062][912][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3600lb # [ 21.513672] envoy[912]: [2026-09-20 08:07:48.062][912][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3601lb # [ 21.518971] envoy[912]: [2026-09-20 08:07:48.062][912][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3602worker2 # [ 21.704397] nix-grpc-daemon[776]: ts=2026-09-20T08:07:48Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3603worker1 # [ 21.732262] nix-grpc-daemon[774]: ts=2026-09-20T08:07:48Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3604worker2 # [ 22.105103] nix-grpc-daemon[776]: ts=2026-09-20T08:07:48Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3605worker1 # [ 22.133260] nix-grpc-daemon[774]: ts=2026-09-20T08:07:48Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3606lb # [ 22.617426] envoy[912]: conn peer=[2001:db8:1::3]:52754 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=163607worker2 # [ 22.908404] nix-grpc-daemon[776]: ts=2026-09-20T08:07:49Z level=info event=scheduler_connected addr=lb:500513608worker1 # [ 22.936317] nix-grpc-daemon[774]: ts=2026-09-20T08:07:49Z level=info event=scheduler_connected addr=lb:500513609worker1 # [ 22.955696] nix-grpc-daemon[774]: ts=2026-09-20T08:07:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3610worker2 # [ 22.938227] nix-grpc-daemon[776]: ts=2026-09-20T08:07:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3611worker1 # [ 23.157245] nix-grpc-daemon[774]: ts=2026-09-20T08:07:49Z level=info event=scheduler_connected addr=lb:500513612worker1 # [ 23.165347] nix-grpc-daemon[774]: ts=2026-09-20T08:07:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3613worker2 # [ 23.140399] nix-grpc-daemon[776]: ts=2026-09-20T08:07:49Z level=info event=scheduler_connected addr=lb:500513614worker2 # [ 23.148504] nix-grpc-daemon[776]: ts=2026-09-20T08:07:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3615worker1 # [ 23.366253] nix-grpc-daemon[774]: ts=2026-09-20T08:07:49Z level=info event=scheduler_connected addr=lb:500513616worker1 # [ 23.372127] nix-grpc-daemon[774]: ts=2026-09-20T08:07:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3617worker2 # [ 23.349591] nix-grpc-daemon[776]: ts=2026-09-20T08:07:49Z level=info event=scheduler_connected addr=lb:500513618worker2 # [ 23.358823] nix-grpc-daemon[776]: ts=2026-09-20T08:07:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3619worker1 # [ 23.573306] nix-grpc-daemon[774]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500513620worker1 # [ 23.582748] nix-grpc-daemon[774]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3621worker2 # [ 23.558313] nix-grpc-daemon[776]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500513622worker2 # [ 23.566141] nix-grpc-daemon[776]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3623worker1 # [ 23.784347] nix-grpc-daemon[774]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500513624worker1 # [ 23.791787] nix-grpc-daemon[774]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3625worker2 # [ 23.767440] nix-grpc-daemon[776]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500513626worker2 # [ 23.774869] nix-grpc-daemon[776]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3627worker1 # [ 23.997249] nix-grpc-daemon[774]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500513628worker1 # [ 24.001642] nix-grpc-daemon[774]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3629worker2 # [ 23.980116] nix-grpc-daemon[776]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500513630worker2 # [ 23.984270] nix-grpc-daemon[776]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3631worker1 # [ 24.198737] nix-grpc-daemon[774]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500513632worker1 # [ 24.206463] nix-grpc-daemon[774]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3633worker2 # [ 24.180864] nix-grpc-daemon[776]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500513634worker2 # [ 24.187596] nix-grpc-daemon[776]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3635worker1 # [ 24.407538] nix-grpc-daemon[774]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500513636worker1 # [ 24.414326] nix-grpc-daemon[774]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3637worker2 # [ 24.388724] nix-grpc-daemon[776]: ts=2026-09-20T08:07:50Z level=info event=scheduler_connected addr=lb:500513638worker2 # [ 24.395156] nix-grpc-daemon[776]: ts=2026-09-20T08:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3639worker1 # [ 24.615506] nix-grpc-daemon[774]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500513640worker1 # [ 24.621788] nix-grpc-daemon[774]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3641worker2 # [ 24.596217] nix-grpc-daemon[776]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500513642worker2 # [ 24.602635] nix-grpc-daemon[776]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3643worker1 # [ 24.822878] nix-grpc-daemon[774]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500513644worker1 # [ 24.829400] nix-grpc-daemon[774]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3645worker2 # [ 24.803893] nix-grpc-daemon[776]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500513646worker2 # [ 24.810456] nix-grpc-daemon[776]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3647worker1 # [ 25.033259] nix-grpc-daemon[774]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500513648worker1 # [ 25.037372] nix-grpc-daemon[774]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3649worker2 # [ 25.014128] nix-grpc-daemon[776]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500513650worker2 # [ 25.018332] nix-grpc-daemon[776]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3651worker1 # [ 25.234258] nix-grpc-daemon[774]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500513652worker2 # [ 25.214851] nix-grpc-daemon[776]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500513653worker1 # [ 25.240822] nix-grpc-daemon[774]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3654worker2 # [ 25.221380] nix-grpc-daemon[776]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3655worker1 # [ 25.441941] nix-grpc-daemon[774]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500513656worker2 # [ 25.422548] nix-grpc-daemon[776]: ts=2026-09-20T08:07:51Z level=info event=scheduler_connected addr=lb:500513657worker1 # [ 25.448625] nix-grpc-daemon[774]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3658worker2 # [ 25.429239] nix-grpc-daemon[776]: ts=2026-09-20T08:07:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3659worker1 # [ 25.649640] nix-grpc-daemon[774]: ts=2026-09-20T08:07:52Z level=info event=scheduler_connected addr=lb:500513660worker2 # [ 25.630285] nix-grpc-daemon[776]: ts=2026-09-20T08:07:52Z level=info event=scheduler_connected addr=lb:500513661worker1 # [ 25.656786] nix-grpc-daemon[774]: ts=2026-09-20T08:07:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3662worker2 # [ 25.636762] nix-grpc-daemon[776]: ts=2026-09-20T08:07:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3663worker1 # [ 25.858112] nix-grpc-daemon[774]: ts=2026-09-20T08:07:52Z level=info event=scheduler_connected addr=lb:500513664worker2 # [ 25.837887] nix-grpc-daemon[776]: ts=2026-09-20T08:07:52Z level=info event=scheduler_connected addr=lb:500513665worker1 # [ 25.865044] nix-grpc-daemon[774]: ts=2026-09-20T08:07:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3666worker2 # [ 25.844352] nix-grpc-daemon[776]: ts=2026-09-20T08:07:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3667worker1 # [ 26.068264] nix-grpc-daemon[774]: ts=2026-09-20T08:07:52Z level=info event=scheduler_connected addr=lb:500513668worker1 # [ 26.073020] nix-grpc-daemon[774]: ts=2026-09-20T08:07:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3669worker2 # [ 26.048200] nix-grpc-daemon[776]: ts=2026-09-20T08:07:52Z level=info event=scheduler_connected addr=lb:500513670worker2 # [ 26.052307] nix-grpc-daemon[776]: ts=2026-09-20T08:07:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3671worker1 # [ 26.270128] nix-grpc-daemon[774]: ts=2026-09-20T08:07:52Z level=info event=scheduler_connected addr=lb:500513672worker2 # [ 26.249121] nix-grpc-daemon[776]: ts=2026-09-20T08:07:52Z level=info event=scheduler_connected addr=lb:500513673worker1 # [ 26.276697] nix-grpc-daemon[774]: ts=2026-09-20T08:07:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3674worker2 # [ 26.255629] nix-grpc-daemon[776]: ts=2026-09-20T08:07:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3675worker1 # [ 26.477753] nix-grpc-daemon[774]: ts=2026-09-20T08:07:53Z level=info event=scheduler_connected addr=lb:500513676worker2 # [ 26.456703] nix-grpc-daemon[776]: ts=2026-09-20T08:07:52Z level=info event=scheduler_connected addr=lb:500513677worker1 # [ 26.484721] nix-grpc-daemon[774]: ts=2026-09-20T08:07:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3678worker2 # [ 26.463025] nix-grpc-daemon[776]: ts=2026-09-20T08:07:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3679worker1 # [ 26.685756] nix-grpc-daemon[774]: ts=2026-09-20T08:07:53Z level=info event=scheduler_connected addr=lb:500513680worker1 # [ 26.691351] nix-grpc-daemon[774]: ts=2026-09-20T08:07:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3681worker2 # [ 26.664291] nix-grpc-daemon[776]: ts=2026-09-20T08:07:53Z level=info event=scheduler_connected addr=lb:500513682worker2 # [ 26.669936] nix-grpc-daemon[776]: ts=2026-09-20T08:07:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3683worker1 # [ 26.892933] nix-grpc-daemon[774]: ts=2026-09-20T08:07:53Z level=info event=scheduler_connected addr=lb:500513684worker2 # [ 26.871030] nix-grpc-daemon[776]: ts=2026-09-20T08:07:53Z level=info event=scheduler_connected addr=lb:500513685worker1 # [ 26.901013] nix-grpc-daemon[774]: ts=2026-09-20T08:07:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3686worker2 # [ 26.877769] nix-grpc-daemon[776]: ts=2026-09-20T08:07:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3687worker1 # [ 27.105274] nix-grpc-daemon[774]: ts=2026-09-20T08:07:53Z level=info event=scheduler_connected addr=lb:500513688worker2 # [ 27.082021] nix-grpc-daemon[776]: ts=2026-09-20T08:07:53Z level=info event=scheduler_connected addr=lb:500513689worker1 # [ 27.109703] nix-grpc-daemon[774]: ts=2026-09-20T08:07:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3690worker2 # [ 27.086329] nix-grpc-daemon[776]: ts=2026-09-20T08:07:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3691worker1 # [ 27.306105] nix-grpc-daemon[774]: ts=2026-09-20T08:07:53Z level=info event=scheduler_connected addr=lb:500513692worker2 # [ 27.282941] nix-grpc-daemon[776]: ts=2026-09-20T08:07:53Z level=info event=scheduler_connected addr=lb:500513693worker1 # [ 27.313044] nix-grpc-daemon[774]: ts=2026-09-20T08:07:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3694worker2 # [ 27.289836] nix-grpc-daemon[776]: ts=2026-09-20T08:07:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3695worker1 # [ 27.514292] nix-grpc-daemon[774]: ts=2026-09-20T08:07:54Z level=info event=scheduler_connected addr=lb:500513696worker2 # [ 27.491186] nix-grpc-daemon[776]: ts=2026-09-20T08:07:54Z level=info event=scheduler_connected addr=lb:500513697worker1 # [ 27.520897] nix-grpc-daemon[774]: ts=2026-09-20T08:07:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3698worker2 # [ 27.497917] nix-grpc-daemon[776]: ts=2026-09-20T08:07:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3699worker1 # [ 27.721983] nix-grpc-daemon[774]: ts=2026-09-20T08:07:54Z level=info event=scheduler_connected addr=lb:500513700worker2 # [ 27.699120] nix-grpc-daemon[776]: ts=2026-09-20T08:07:54Z level=info event=scheduler_connected addr=lb:500513701worker1 # [ 27.728795] nix-grpc-daemon[774]: ts=2026-09-20T08:07:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3702worker2 # [ 27.705946] nix-grpc-daemon[776]: ts=2026-09-20T08:07:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3703worker1 # [ 27.930083] nix-grpc-daemon[774]: ts=2026-09-20T08:07:54Z level=info event=scheduler_connected addr=lb:500513704worker2 # [ 27.907785] nix-grpc-daemon[776]: ts=2026-09-20T08:07:54Z level=info event=scheduler_connected addr=lb:500513705worker1 # [ 27.936816] nix-grpc-daemon[774]: ts=2026-09-20T08:07:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3706worker2 # [ 27.915543] nix-grpc-daemon[776]: ts=2026-09-20T08:07:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3707worker1 # [ 28.140134] nix-grpc-daemon[774]: ts=2026-09-20T08:07:54Z level=info event=scheduler_connected addr=lb:500513708worker2 # [ 28.119776] nix-grpc-daemon[776]: ts=2026-09-20T08:07:54Z level=info event=scheduler_connected addr=lb:500513709worker1 # [ 28.145327] nix-grpc-daemon[774]: ts=2026-09-20T08:07:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3710worker2 # [ 28.124167] nix-grpc-daemon[776]: ts=2026-09-20T08:07:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3711worker1 # [ 28.346265] nix-grpc-daemon[774]: ts=2026-09-20T08:07:54Z level=info event=scheduler_connected addr=lb:500513712worker2 # [ 28.321094] nix-grpc-daemon[776]: ts=2026-09-20T08:07:54Z level=info event=scheduler_connected addr=lb:500513713worker1 # [ 28.352971] nix-grpc-daemon[774]: ts=2026-09-20T08:07:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3714worker2 # [ 28.327910] nix-grpc-daemon[776]: ts=2026-09-20T08:07:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3715worker1 # [ 28.554113] nix-grpc-daemon[774]: ts=2026-09-20T08:07:55Z level=info event=scheduler_connected addr=lb:500513716worker2 # [ 28.529152] nix-grpc-daemon[776]: ts=2026-09-20T08:07:55Z level=info event=scheduler_connected addr=lb:500513717worker1 # [ 28.560769] nix-grpc-daemon[774]: ts=2026-09-20T08:07:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3718worker2 # [ 28.535969] nix-grpc-daemon[776]: ts=2026-09-20T08:07:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3719worker1 # [ 28.761985] nix-grpc-daemon[774]: ts=2026-09-20T08:07:55Z level=info event=scheduler_connected addr=lb:500513720worker2 # [ 28.737523] nix-grpc-daemon[776]: ts=2026-09-20T08:07:55Z level=info event=scheduler_connected addr=lb:500513721worker1 # [ 28.768615] nix-grpc-daemon[774]: ts=2026-09-20T08:07:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3722worker2 # [ 28.744367] nix-grpc-daemon[776]: ts=2026-09-20T08:07:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3723worker1 # [ 28.969623] nix-grpc-daemon[774]: ts=2026-09-20T08:07:55Z level=info event=scheduler_connected addr=lb:500513724worker2 # [ 28.945536] nix-grpc-daemon[776]: ts=2026-09-20T08:07:55Z level=info event=scheduler_connected addr=lb:500513725worker1 # [ 28.976336] nix-grpc-daemon[774]: ts=2026-09-20T08:07:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3726worker2 # [ 28.952626] nix-grpc-daemon[776]: ts=2026-09-20T08:07:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3727worker1 # [ 29.179556] nix-grpc-daemon[774]: ts=2026-09-20T08:07:55Z level=info event=scheduler_connected addr=lb:500513728worker2 # [ 29.157053] nix-grpc-daemon[776]: ts=2026-09-20T08:07:55Z level=info event=scheduler_connected addr=lb:500513729worker1 # [ 29.185111] nix-grpc-daemon[774]: ts=2026-09-20T08:07:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3730worker2 # [ 29.161243] nix-grpc-daemon[776]: ts=2026-09-20T08:07:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3731worker2 # [ 29.357664] nix-grpc-daemon[776]: ts=2026-09-20T08:07:55Z level=info event=scheduler_connected addr=lb:500513732worker1 # [ 29.386015] nix-grpc-daemon[774]: ts=2026-09-20T08:07:55Z level=info event=scheduler_connected addr=lb:500513733worker1 # [ 29.392061] nix-grpc-daemon[774]: ts=2026-09-20T08:07:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3734worker2 # [ 29.365161] nix-grpc-daemon[776]: ts=2026-09-20T08:07:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3735worker1 # [ 29.592955] nix-grpc-daemon[774]: ts=2026-09-20T08:07:56Z level=info event=scheduler_connected addr=lb:500513736worker2 # [ 29.566208] nix-grpc-daemon[776]: ts=2026-09-20T08:07:56Z level=info event=scheduler_connected addr=lb:500513737worker1 # [ 29.599458] nix-grpc-daemon[774]: ts=2026-09-20T08:07:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3738worker2 # [ 29.573353] nix-grpc-daemon[776]: ts=2026-09-20T08:07:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3739worker1 # [ 29.800507] nix-grpc-daemon[774]: ts=2026-09-20T08:07:56Z level=info event=scheduler_connected addr=lb:500513740worker2 # [ 29.774509] nix-grpc-daemon[776]: ts=2026-09-20T08:07:56Z level=info event=scheduler_connected addr=lb:500513741worker1 # [ 29.807176] nix-grpc-daemon[774]: ts=2026-09-20T08:07:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3742worker2 # [ 29.781266] nix-grpc-daemon[776]: ts=2026-09-20T08:07:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3743worker1 # [ 30.008127] nix-grpc-daemon[774]: ts=2026-09-20T08:07:56Z level=info event=scheduler_connected addr=lb:500513744worker1 # [ 30.013111] nix-grpc-daemon[774]: ts=2026-09-20T08:07:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3745worker2 # [ 29.982918] nix-grpc-daemon[776]: ts=2026-09-20T08:07:56Z level=info event=scheduler_connected addr=lb:500513746worker2 # [ 29.996291] nix-grpc-daemon[776]: ts=2026-09-20T08:07:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3747worker1 # [ 30.217017] nix-grpc-daemon[774]: ts=2026-09-20T08:07:56Z level=info event=scheduler_connected addr=lb:500513748worker2 # [ 30.194944] nix-grpc-daemon[776]: ts=2026-09-20T08:07:56Z level=info event=scheduler_connected addr=lb:500513749worker1 # [ 30.221376] nix-grpc-daemon[774]: ts=2026-09-20T08:07:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3750worker2 # [ 30.199179] nix-grpc-daemon[776]: ts=2026-09-20T08:07:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3751worker1 # [ 30.418142] nix-grpc-daemon[774]: ts=2026-09-20T08:07:56Z level=info event=scheduler_connected addr=lb:500513752worker2 # [ 30.395778] nix-grpc-daemon[776]: ts=2026-09-20T08:07:56Z level=info event=scheduler_connected addr=lb:500513753worker1 # [ 30.425473] nix-grpc-daemon[774]: ts=2026-09-20T08:07:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3754worker2 # [ 30.402314] nix-grpc-daemon[776]: ts=2026-09-20T08:07:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3755worker1 # [ 30.626485] nix-grpc-daemon[774]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:500513756worker2 # [ 30.603501] nix-grpc-daemon[776]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:500513757worker1 # [ 30.633390] nix-grpc-daemon[774]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3758worker2 # [ 30.610325] nix-grpc-daemon[776]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3759worker1 # [ 30.834475] nix-grpc-daemon[774]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:500513760worker2 # [ 30.811797] nix-grpc-daemon[776]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:500513761worker1 # [ 30.841064] nix-grpc-daemon[774]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3762worker2 # [ 30.818387] nix-grpc-daemon[776]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3763worker1 # [ 31.042126] nix-grpc-daemon[774]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:500513764worker2 # [ 31.019816] nix-grpc-daemon[776]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:500513765worker1 # [ 31.048562] nix-grpc-daemon[774]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3766worker2 # [ 31.026399] nix-grpc-daemon[776]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3767worker1 # [ 31.250987] nix-grpc-daemon[774]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:500513768worker2 # [ 31.230877] nix-grpc-daemon[776]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:500513769worker1 # [ 31.257696] nix-grpc-daemon[774]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3770worker2 # [ 31.235196] nix-grpc-daemon[776]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3771worker1 # [ 31.458748] nix-grpc-daemon[774]: ts=2026-09-20T08:07:58Z level=info event=scheduler_connected addr=lb:500513772worker2 # [ 31.431818] nix-grpc-daemon[776]: ts=2026-09-20T08:07:57Z level=info event=scheduler_connected addr=lb:500513773worker2 # [ 31.438772] nix-grpc-daemon[776]: ts=2026-09-20T08:07:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3774worker1 # [ 31.465573] nix-grpc-daemon[774]: ts=2026-09-20T08:07:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3775worker1 # [ 31.666683] nix-grpc-daemon[774]: ts=2026-09-20T08:07:58Z level=info event=scheduler_connected addr=lb:500513776worker2 # [ 31.639917] nix-grpc-daemon[776]: ts=2026-09-20T08:07:58Z level=info event=scheduler_connected addr=lb:500513777worker1 # [ 31.673271] nix-grpc-daemon[774]: ts=2026-09-20T08:07:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3778worker2 # [ 31.646268] nix-grpc-daemon[776]: ts=2026-09-20T08:07:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3779worker1 # [ 31.874445] nix-grpc-daemon[774]: ts=2026-09-20T08:07:58Z level=info event=scheduler_connected addr=lb:500513780worker2 # [ 31.847495] nix-grpc-daemon[776]: ts=2026-09-20T08:07:58Z level=info event=scheduler_connected addr=lb:500513781worker1 # [ 31.881366] nix-grpc-daemon[774]: ts=2026-09-20T08:07:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3782worker2 # [ 31.854416] nix-grpc-daemon[776]: ts=2026-09-20T08:07:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3783worker2 # [ 32.055653] nix-grpc-daemon[776]: ts=2026-09-20T08:07:58Z level=info event=scheduler_connected addr=lb:500513784worker1 # [ 32.082708] nix-grpc-daemon[774]: ts=2026-09-20T08:07:58Z level=info event=scheduler_connected addr=lb:500513785worker1 # [ 32.089722] nix-grpc-daemon[774]: ts=2026-09-20T08:07:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3786worker2 # [ 32.062665] nix-grpc-daemon[776]: ts=2026-09-20T08:07:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3787worker2 # [ 32.265978] nix-grpc-daemon[776]: ts=2026-09-20T08:07:58Z level=info event=scheduler_connected addr=lb:500513788worker1 # [ 32.293165] nix-grpc-daemon[774]: ts=2026-09-20T08:07:58Z level=info event=scheduler_connected addr=lb:500513789worker2 # [ 32.271319] nix-grpc-daemon[776]: ts=2026-09-20T08:07:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3790worker1 # [ 32.298515] nix-grpc-daemon[774]: ts=2026-09-20T08:07:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3791worker1 # [ 32.499449] nix-grpc-daemon[774]: ts=2026-09-20T08:07:59Z level=info event=scheduler_connected addr=lb:500513792worker2 # [ 32.472479] nix-grpc-daemon[776]: ts=2026-09-20T08:07:59Z level=info event=scheduler_connected addr=lb:500513793worker2 # [ 32.479232] nix-grpc-daemon[776]: ts=2026-09-20T08:07:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3794worker1 # [ 32.507055] nix-grpc-daemon[774]: ts=2026-09-20T08:07:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3795worker1 # [ 32.708127] nix-grpc-daemon[774]: ts=2026-09-20T08:07:59Z level=info event=scheduler_connected addr=lb:500513796worker2 # [ 32.680505] nix-grpc-daemon[776]: ts=2026-09-20T08:07:59Z level=info event=scheduler_connected addr=lb:500513797worker1 # [ 32.714529] nix-grpc-daemon[774]: ts=2026-09-20T08:07:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3798worker2 # [ 32.687686] nix-grpc-daemon[776]: ts=2026-09-20T08:07:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3799worker2 # [ 32.889344] nix-grpc-daemon[776]: ts=2026-09-20T08:07:59Z level=info event=scheduler_connected addr=lb:500513800worker1 # [ 32.915738] nix-grpc-daemon[774]: ts=2026-09-20T08:07:59Z level=info event=scheduler_connected addr=lb:500513801worker1 # [ 32.922720] nix-grpc-daemon[774]: ts=2026-09-20T08:07:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3802worker2 # [ 32.895977] nix-grpc-daemon[776]: ts=2026-09-20T08:07:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3803worker1 # [ 33.123694] nix-grpc-daemon[774]: ts=2026-09-20T08:07:59Z level=info event=scheduler_connected addr=lb:500513804worker2 # [ 33.097072] nix-grpc-daemon[776]: ts=2026-09-20T08:07:59Z level=info event=scheduler_connected addr=lb:500513805worker1 # [ 33.130398] nix-grpc-daemon[774]: ts=2026-09-20T08:07:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3806worker2 # [ 33.103437] nix-grpc-daemon[776]: ts=2026-09-20T08:07:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3807worker1 # [ 33.335515] nix-grpc-daemon[774]: ts=2026-09-20T08:07:59Z level=info event=scheduler_connected addr=lb:500513808worker2 # [ 33.309093] nix-grpc-daemon[776]: ts=2026-09-20T08:07:59Z level=info event=scheduler_connected addr=lb:500513809worker1 # [ 33.341747] nix-grpc-daemon[774]: ts=2026-09-20T08:07:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3810worker2 # [ 33.323314] nix-grpc-daemon[776]: ts=2026-09-20T08:07:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3811worker1 # [ 33.535952] nix-grpc-daemon[774]: ts=2026-09-20T08:08:00Z level=info event=scheduler_connected addr=lb:500513812worker2 # [ 33.509125] nix-grpc-daemon[776]: ts=2026-09-20T08:08:00Z level=info event=scheduler_connected addr=lb:500513813worker1 # [ 33.542746] nix-grpc-daemon[774]: ts=2026-09-20T08:08:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3814worker2 # [ 33.515802] nix-grpc-daemon[776]: ts=2026-09-20T08:08:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3815worker1 # [ 33.743972] nix-grpc-daemon[774]: ts=2026-09-20T08:08:00Z level=info event=scheduler_connected addr=lb:500513816worker2 # [ 33.717194] nix-grpc-daemon[776]: ts=2026-09-20T08:08:00Z level=info event=scheduler_connected addr=lb:500513817worker1 # [ 33.750940] nix-grpc-daemon[774]: ts=2026-09-20T08:08:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3818worker2 # [ 33.723941] nix-grpc-daemon[776]: ts=2026-09-20T08:08:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3819worker2 # [ 33.925094] nix-grpc-daemon[776]: ts=2026-09-20T08:08:00Z level=info event=scheduler_connected addr=lb:500513820worker1 # [ 33.952229] nix-grpc-daemon[774]: ts=2026-09-20T08:08:00Z level=info event=scheduler_connected addr=lb:500513821worker2 # [ 33.932356] nix-grpc-daemon[776]: ts=2026-09-20T08:08:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3822worker1 # [ 33.959395] nix-grpc-daemon[774]: ts=2026-09-20T08:08:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3823worker2 # [ 34.133566] nix-grpc-daemon[776]: ts=2026-09-20T08:08:00Z level=info event=scheduler_connected addr=lb:500513824worker1 # [ 34.160674] nix-grpc-daemon[774]: ts=2026-09-20T08:08:00Z level=info event=scheduler_connected addr=lb:500513825worker2 # [ 34.140374] nix-grpc-daemon[776]: ts=2026-09-20T08:08:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3826worker1 # [ 34.167353] nix-grpc-daemon[774]: ts=2026-09-20T08:08:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3827worker2 # [ 34.343658] nix-grpc-daemon[776]: ts=2026-09-20T08:08:00Z level=info event=scheduler_connected addr=lb:500513828worker1 # [ 34.370980] nix-grpc-daemon[774]: ts=2026-09-20T08:08:00Z level=info event=scheduler_connected addr=lb:500513829worker2 # [ 34.349186] nix-grpc-daemon[776]: ts=2026-09-20T08:08:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3830worker1 # [ 34.376502] nix-grpc-daemon[774]: ts=2026-09-20T08:08:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3831worker2 # [ 34.550239] nix-grpc-daemon[776]: ts=2026-09-20T08:08:01Z level=info event=scheduler_connected addr=lb:500513832worker1 # [ 34.577554] nix-grpc-daemon[774]: ts=2026-09-20T08:08:01Z level=info event=scheduler_connected addr=lb:500513833worker2 # [ 34.557637] nix-grpc-daemon[776]: ts=2026-09-20T08:08:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3834worker1 # [ 34.584915] nix-grpc-daemon[774]: ts=2026-09-20T08:08:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3835worker2 # [ 34.758654] nix-grpc-daemon[776]: ts=2026-09-20T08:08:01Z level=info event=scheduler_connected addr=lb:500513836worker1 # [ 34.786152] nix-grpc-daemon[774]: ts=2026-09-20T08:08:01Z level=info event=scheduler_connected addr=lb:500513837worker2 # [ 34.765827] nix-grpc-daemon[776]: ts=2026-09-20T08:08:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3838worker1 # [ 34.792965] nix-grpc-daemon[774]: ts=2026-09-20T08:08:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3839worker2 # [ 34.967104] nix-grpc-daemon[776]: ts=2026-09-20T08:08:01Z level=info event=scheduler_connected addr=lb:500513840worker1 # [ 34.994274] nix-grpc-daemon[774]: ts=2026-09-20T08:08:01Z level=info event=scheduler_connected addr=lb:500513841worker2 # [ 34.974235] nix-grpc-daemon[776]: ts=2026-09-20T08:08:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3842worker1 # [ 35.001388] nix-grpc-daemon[774]: ts=2026-09-20T08:08:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3843worker2 # [ 35.175283] nix-grpc-daemon[776]: ts=2026-09-20T08:08:01Z level=info event=scheduler_connected addr=lb:500513844worker1 # [ 35.202527] nix-grpc-daemon[774]: ts=2026-09-20T08:08:01Z level=info event=scheduler_connected addr=lb:500513845worker1 # [ 35.209299] nix-grpc-daemon[774]: ts=2026-09-20T08:08:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3846worker2 # [ 35.182242] nix-grpc-daemon[776]: ts=2026-09-20T08:08:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3847worker2 # [ 35.384832] nix-grpc-daemon[776]: ts=2026-09-20T08:08:01Z level=info event=scheduler_connected addr=lb:500513848worker1 # [ 35.412748] nix-grpc-daemon[774]: ts=2026-09-20T08:08:01Z level=info event=scheduler_connected addr=lb:500513849worker2 # [ 35.390652] nix-grpc-daemon[776]: ts=2026-09-20T08:08:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3850worker1 # [ 35.418110] nix-grpc-daemon[774]: ts=2026-09-20T08:08:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3851worker2 # [ 35.591043] nix-grpc-daemon[776]: ts=2026-09-20T08:08:02Z level=info event=scheduler_connected addr=lb:500513852worker1 # [ 35.618831] nix-grpc-daemon[774]: ts=2026-09-20T08:08:02Z level=info event=scheduler_connected addr=lb:500513853worker2 # [ 35.597818] nix-grpc-daemon[776]: ts=2026-09-20T08:08:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3854worker1 # [ 35.624926] nix-grpc-daemon[774]: ts=2026-09-20T08:08:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3855worker1 # [ 35.825743] nix-grpc-daemon[774]: ts=2026-09-20T08:08:02Z level=info event=scheduler_connected addr=lb:500513856worker2 # [ 35.799114] nix-grpc-daemon[776]: ts=2026-09-20T08:08:02Z level=info event=scheduler_connected addr=lb:500513857worker2 # [ 35.805342] nix-grpc-daemon[776]: ts=2026-09-20T08:08:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3858worker1 # [ 35.832643] nix-grpc-daemon[774]: ts=2026-09-20T08:08:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3859worker1 # [ 36.033538] nix-grpc-daemon[774]: ts=2026-09-20T08:08:02Z level=info event=scheduler_connected addr=lb:500513860worker2 # [ 36.006446] nix-grpc-daemon[776]: ts=2026-09-20T08:08:02Z level=info event=scheduler_connected addr=lb:500513861worker1 # [ 36.040452] nix-grpc-daemon[774]: ts=2026-09-20T08:08:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3862worker2 # [ 36.013500] nix-grpc-daemon[776]: ts=2026-09-20T08:08:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3863worker1 # [ 36.241615] nix-grpc-daemon[774]: ts=2026-09-20T08:08:02Z level=info event=scheduler_connected addr=lb:500513864worker2 # [ 36.214674] nix-grpc-daemon[776]: ts=2026-09-20T08:08:02Z level=info event=scheduler_connected addr=lb:500513865worker1 # [ 36.248809] nix-grpc-daemon[774]: ts=2026-09-20T08:08:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3866worker2 # [ 36.221975] nix-grpc-daemon[776]: ts=2026-09-20T08:08:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3867worker1 # [ 36.451107] nix-grpc-daemon[774]: ts=2026-09-20T08:08:02Z level=info event=scheduler_connected addr=lb:500513868worker2 # [ 36.424529] nix-grpc-daemon[776]: ts=2026-09-20T08:08:02Z level=info event=scheduler_connected addr=lb:500513869worker1 # [ 36.457762] nix-grpc-daemon[774]: ts=2026-09-20T08:08:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3870worker2 # [ 36.430969] nix-grpc-daemon[776]: ts=2026-09-20T08:08:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3871worker1 # [ 36.658697] nix-grpc-daemon[774]: ts=2026-09-20T08:08:03Z level=info event=scheduler_connected addr=lb:500513872worker2 # [ 36.633170] nix-grpc-daemon[776]: ts=2026-09-20T08:08:03Z level=info event=scheduler_connected addr=lb:500513873worker1 # [ 36.666175] nix-grpc-daemon[774]: ts=2026-09-20T08:08:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3874worker2 # [ 36.646470] nix-grpc-daemon[776]: ts=2026-09-20T08:08:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3875worker1 # [ 36.865815] nix-grpc-daemon[774]: ts=2026-09-20T08:08:03Z level=info event=scheduler_connected addr=lb:500513876worker2 # [ 36.843247] nix-grpc-daemon[776]: ts=2026-09-20T08:08:03Z level=info event=scheduler_connected addr=lb:500513877worker1 # [ 36.873577] nix-grpc-daemon[774]: ts=2026-09-20T08:08:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3878worker2 # [ 36.850812] nix-grpc-daemon[776]: ts=2026-09-20T08:08:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3879worker1 # [ 37.074851] nix-grpc-daemon[774]: ts=2026-09-20T08:08:03Z level=info event=scheduler_connected addr=lb:500513880worker2 # [ 37.052258] nix-grpc-daemon[776]: ts=2026-09-20T08:08:03Z level=info event=scheduler_connected addr=lb:500513881worker1 # [ 37.081413] nix-grpc-daemon[774]: ts=2026-09-20T08:08:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3882worker2 # [ 37.059110] nix-grpc-daemon[776]: ts=2026-09-20T08:08:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3883worker1 # [ 37.282637] nix-grpc-daemon[774]: ts=2026-09-20T08:08:03Z level=info event=scheduler_connected addr=lb:500513884worker2 # [ 37.260085] nix-grpc-daemon[776]: ts=2026-09-20T08:08:03Z level=info event=scheduler_connected addr=lb:500513885worker1 # [ 37.289427] nix-grpc-daemon[774]: ts=2026-09-20T08:08:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3886worker2 # [ 37.266841] nix-grpc-daemon[776]: ts=2026-09-20T08:08:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3887worker1 # [ 37.492766] nix-grpc-daemon[774]: ts=2026-09-20T08:08:04Z level=info event=scheduler_connected addr=lb:500513888worker2 # [ 37.470925] nix-grpc-daemon[776]: ts=2026-09-20T08:08:04Z level=info event=scheduler_connected addr=lb:500513889worker1 # [ 37.497776] nix-grpc-daemon[774]: ts=2026-09-20T08:08:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3890worker2 # [ 37.475263] nix-grpc-daemon[776]: ts=2026-09-20T08:08:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3891worker1 # [ 37.694403] nix-grpc-daemon[774]: ts=2026-09-20T08:08:04Z level=info event=scheduler_connected addr=lb:500513892worker2 # [ 37.671493] nix-grpc-daemon[776]: ts=2026-09-20T08:08:04Z level=info event=scheduler_connected addr=lb:500513893worker1 # [ 37.701525] nix-grpc-daemon[774]: ts=2026-09-20T08:08:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3894worker2 # [ 37.678372] nix-grpc-daemon[776]: ts=2026-09-20T08:08:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3895worker1 # [ 37.902557] nix-grpc-daemon[774]: ts=2026-09-20T08:08:04Z level=info event=scheduler_connected addr=lb:500513896worker2 # [ 37.879649] nix-grpc-daemon[776]: ts=2026-09-20T08:08:04Z level=info event=scheduler_connected addr=lb:500513897worker1 # [ 37.909164] nix-grpc-daemon[774]: ts=2026-09-20T08:08:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3898worker2 # [ 37.886476] nix-grpc-daemon[776]: ts=2026-09-20T08:08:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3899worker1 # [ 38.110187] nix-grpc-daemon[774]: ts=2026-09-20T08:08:04Z level=info event=scheduler_connected addr=lb:500513900worker2 # [ 38.087526] nix-grpc-daemon[776]: ts=2026-09-20T08:08:04Z level=info event=scheduler_connected addr=lb:500513901worker1 # [ 38.117377] nix-grpc-daemon[774]: ts=2026-09-20T08:08:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3902worker2 # [ 38.094365] nix-grpc-daemon[776]: ts=2026-09-20T08:08:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3903worker1 # [ 38.318461] nix-grpc-daemon[774]: ts=2026-09-20T08:08:04Z level=info event=scheduler_connected addr=lb:500513904worker2 # [ 38.295653] nix-grpc-daemon[776]: ts=2026-09-20T08:08:04Z level=info event=scheduler_connected addr=lb:500513905worker1 # [ 38.324997] nix-grpc-daemon[774]: ts=2026-09-20T08:08:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3906worker2 # [ 38.302409] nix-grpc-daemon[776]: ts=2026-09-20T08:08:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3907worker1 # [ 38.528187] nix-grpc-daemon[774]: ts=2026-09-20T08:08:05Z level=info event=scheduler_connected addr=lb:500513908worker2 # [ 38.506234] nix-grpc-daemon[776]: ts=2026-09-20T08:08:05Z level=info event=scheduler_connected addr=lb:500513909worker1 # [ 38.533389] nix-grpc-daemon[774]: ts=2026-09-20T08:08:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3910worker2 # [ 38.510473] nix-grpc-daemon[776]: ts=2026-09-20T08:08:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3911worker1 # [ 38.734224] nix-grpc-daemon[774]: ts=2026-09-20T08:08:05Z level=info event=scheduler_connected addr=lb:500513912worker2 # [ 38.707186] nix-grpc-daemon[776]: ts=2026-09-20T08:08:05Z level=info event=scheduler_connected addr=lb:500513913worker1 # [ 38.741280] nix-grpc-daemon[774]: ts=2026-09-20T08:08:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3914worker2 # [ 38.714324] nix-grpc-daemon[776]: ts=2026-09-20T08:08:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3915worker1 # [ 38.748245] nix-grpc-daemon[774]: ts=2026-09-20T08:08:05Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Timeout was reached"3916worker2 # [ 38.722367] nix-grpc-daemon[776]: ts=2026-09-20T08:08:05Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Timeout was reached"3917worker1 # [ 38.942352] nix-grpc-daemon[774]: ts=2026-09-20T08:08:05Z level=info event=scheduler_connected addr=lb:500513918worker2 # [ 38.915400] nix-grpc-daemon[776]: ts=2026-09-20T08:08:05Z level=info event=scheduler_connected addr=lb:500513919worker1 # [ 38.949111] nix-grpc-daemon[774]: ts=2026-09-20T08:08:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3920worker2 # [ 38.922242] nix-grpc-daemon[776]: ts=2026-09-20T08:08:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3921worker1 # [ 39.150218] nix-grpc-daemon[774]: ts=2026-09-20T08:08:05Z level=info event=scheduler_connected addr=lb:500513922worker2 # [ 39.123525] nix-grpc-daemon[776]: ts=2026-09-20T08:08:05Z level=info event=scheduler_connected addr=lb:500513923worker1 # [ 39.157417] nix-grpc-daemon[774]: ts=2026-09-20T08:08:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3924worker2 # [ 39.130515] nix-grpc-daemon[776]: ts=2026-09-20T08:08:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3925worker1 # [ 39.358552] nix-grpc-daemon[774]: ts=2026-09-20T08:08:05Z level=info event=scheduler_connected addr=lb:500513926worker2 # [ 39.331515] nix-grpc-daemon[776]: ts=2026-09-20T08:08:05Z level=info event=scheduler_connected addr=lb:500513927worker1 # [ 39.365597] nix-grpc-daemon[774]: ts=2026-09-20T08:08:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3928worker2 # [ 39.338643] nix-grpc-daemon[776]: ts=2026-09-20T08:08:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3929worker2 # [ 39.541402] nix-grpc-daemon[776]: ts=2026-09-20T08:08:06Z level=info event=scheduler_connected addr=lb:500513930worker1 # [ 39.569236] nix-grpc-daemon[774]: ts=2026-09-20T08:08:06Z level=info event=scheduler_connected addr=lb:500513931worker1 # [ 39.574617] nix-grpc-daemon[774]: ts=2026-09-20T08:08:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3932worker2 # [ 39.547833] nix-grpc-daemon[776]: ts=2026-09-20T08:08:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3933worker1 # [ 39.775445] nix-grpc-daemon[774]: ts=2026-09-20T08:08:06Z level=info event=scheduler_connected addr=lb:500513934worker2 # [ 39.749065] nix-grpc-daemon[776]: ts=2026-09-20T08:08:06Z level=info event=scheduler_connected addr=lb:500513935worker1 # [ 39.783162] nix-grpc-daemon[774]: ts=2026-09-20T08:08:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3936worker2 # [ 39.756642] nix-grpc-daemon[776]: ts=2026-09-20T08:08:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3937worker1 # [ 39.984260] nix-grpc-daemon[774]: ts=2026-09-20T08:08:06Z level=info event=scheduler_connected addr=lb:500513938worker2 # [ 39.959140] nix-grpc-daemon[776]: ts=2026-09-20T08:08:06Z level=info event=scheduler_connected addr=lb:500513939worker1 # [ 39.992822] nix-grpc-daemon[774]: ts=2026-09-20T08:08:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3940worker2 # [ 39.970891] nix-grpc-daemon[776]: ts=2026-09-20T08:08:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3941worker1 # [ 40.192375] nix-grpc-daemon[774]: ts=2026-09-20T08:08:06Z level=info event=scheduler_connected addr=lb:500513942worker2 # [ 40.167895] nix-grpc-daemon[776]: ts=2026-09-20T08:08:06Z level=info event=scheduler_connected addr=lb:500513943worker1 # [ 40.199842] nix-grpc-daemon[774]: ts=2026-09-20T08:08:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3944worker2 # [ 40.175097] nix-grpc-daemon[776]: ts=2026-09-20T08:08:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3945worker1 # [ 40.401050] nix-grpc-daemon[774]: ts=2026-09-20T08:08:06Z level=info event=scheduler_connected addr=lb:500513946worker2 # [ 40.376504] nix-grpc-daemon[776]: ts=2026-09-20T08:08:06Z level=info event=scheduler_connected addr=lb:500513947worker1 # [ 40.407513] nix-grpc-daemon[774]: ts=2026-09-20T08:08:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3948worker2 # [ 40.382619] nix-grpc-daemon[776]: ts=2026-09-20T08:08:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3949worker1 # [ 40.610525] nix-grpc-daemon[774]: ts=2026-09-20T08:08:07Z level=info event=scheduler_connected addr=lb:500513950worker2 # [ 40.586098] nix-grpc-daemon[776]: ts=2026-09-20T08:08:07Z level=info event=scheduler_connected addr=lb:500513951worker1 # [ 40.615904] nix-grpc-daemon[774]: ts=2026-09-20T08:08:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3952worker2 # [ 40.590272] nix-grpc-daemon[776]: ts=2026-09-20T08:08:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3953worker2 # [ 40.786926] nix-grpc-daemon[776]: ts=2026-09-20T08:08:07Z level=info event=scheduler_connected addr=lb:500513954worker1 # [ 40.816964] nix-grpc-daemon[774]: ts=2026-09-20T08:08:07Z level=info event=scheduler_connected addr=lb:500513955worker2 # [ 40.793627] nix-grpc-daemon[776]: ts=2026-09-20T08:08:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3956worker1 # [ 40.822473] nix-grpc-daemon[774]: ts=2026-09-20T08:08:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3957worker2 # [ 40.993928] nix-grpc-daemon[776]: ts=2026-09-20T08:08:07Z level=info event=scheduler_connected addr=lb:500513958worker1 # [ 41.023194] nix-grpc-daemon[774]: ts=2026-09-20T08:08:07Z level=info event=scheduler_connected addr=lb:500513959worker1 # [ 41.029485] nix-grpc-daemon[774]: ts=2026-09-20T08:08:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3960worker2 # [ 41.002618] nix-grpc-daemon[776]: ts=2026-09-20T08:08:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3961worker1 # [ 41.230245] nix-grpc-daemon[774]: ts=2026-09-20T08:08:07Z level=info event=scheduler_connected addr=lb:500513962worker2 # [ 41.205065] nix-grpc-daemon[776]: ts=2026-09-20T08:08:07Z level=info event=scheduler_connected addr=lb:500513963worker1 # [ 41.236922] nix-grpc-daemon[774]: ts=2026-09-20T08:08:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3964worker2 # [ 41.210828] nix-grpc-daemon[776]: ts=2026-09-20T08:08:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3965lb # [ 41.241506] rustfs-bucket-start[1109]: mb s3://farm3966lb # [ 41.250540] systemd[1]: Finished rustfs-bucket.service.3967lb # [ 41.261005] systemd[1]: Starting niks3 server...3968worker1 # [ 41.438321] nix-grpc-daemon[774]: ts=2026-09-20T08:08:07Z level=info event=scheduler_connected addr=lb:500513969worker2 # [ 41.411593] nix-grpc-daemon[776]: ts=2026-09-20T08:08:07Z level=info event=scheduler_connected addr=lb:500513970worker1 # [ 41.444808] nix-grpc-daemon[774]: ts=2026-09-20T08:08:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3971worker2 # [ 41.417723] nix-grpc-daemon[776]: ts=2026-09-20T08:08:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3972lb # [ 41.499409] postgres[1128]: [1128] ERROR: relation "goose_db_version" does not exist at character 363973lb # [ 41.501200] postgres[1128]: [1128] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3974lb # [ 41.535767] niks3-server[1118]: 2026/09/20 08:08:08 OK 20241026095416_initial_model.sql (21.67ms)3975lb # [ 41.539644] niks3-server[1118]: 2026/09/20 08:08:08 OK 20251210153512_drop_unused_gin_index.sql (2.11ms)3976lb # [ 41.545793] niks3-server[1118]: 2026/09/20 08:08:08 OK 20251218171726_add_pins.sql (4.51ms)3977lb # [ 41.550951] niks3-server[1118]: 2026/09/20 08:08:08 OK 20260628120000_add_object_size_and_stats.sql (5.11ms)3978lb # [ 41.556656] niks3-server[1118]: 2026/09/20 08:08:08 OK 20260905000000_add_claims.sql (5.66ms)3979lb # [ 41.561300] niks3-server[1118]: 2026/09/20 08:08:08 OK 20260920000000_drop_claims.sql (4.53ms)3980lb # [ 41.563284] niks3-server[1118]: 2026/09/20 08:08:08 goose: successfully migrated database to version: 202609200000003981lb # [ 41.567973] niks3-server[1118]: 2026/09/20 08:08:08 OK 1_commit_pending_closure.sql (6.63ms)3982lb # [ 41.570607] niks3-server[1118]: 2026/09/20 08:08:08 OK 2_object_stats_trigger.sql (2.49ms)3983lb # [ 41.572099] niks3-server[1118]: 2026/09/20 08:08:08 goose: up to current file version: 23984lb # [ 41.576305] niks3-server[1118]: 2026/09/20 08:08:08 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3985worker2 # [ 41.621397] nix-grpc-daemon[776]: ts=2026-09-20T08:08:08Z level=info event=scheduler_connected addr=lb:500513986worker1 # [ 41.648694] nix-grpc-daemon[774]: ts=2026-09-20T08:08:08Z level=info event=scheduler_connected addr=lb:500513987worker2 # [ 41.625676] nix-grpc-daemon[776]: ts=2026-09-20T08:08:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3988worker1 # [ 41.652925] nix-grpc-daemon[774]: ts=2026-09-20T08:08:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3989lb # [ 41.621809] niks3-server[1118]: 2026/09/20 08:08:08 INFO Read proxy enabled — serving cache objects from S33990lb # [ 41.623228] niks3-server[1118]: 2026/09/20 08:08:08 INFO Using socket-activated listener address=0.0.0.0:57513991lb # [ 41.628091] niks3-server[1118]: 2026/09/20 08:08:08 INFO systemd watchdog enabled interval=15s3992lb # [ 41.629338] systemd[1]: Started niks3 server.3993lb # [ 41.632924] niks3-server[1118]: 2026/09/20 08:08:08 INFO Starting HTTP server address=0.0.0.0:57513994lb # [ 41.634779] systemd[1]: Reached target Multi-User System.3995lb # [ 41.639423] systemd[1]: Startup finished in 1.008s (kernel) + 5.633s (initrd) + 34.989s (userspace) = 41.632s.3996lb # [ 41.650078] niks3-server[1118]: 2026/09/20 08:08:08 INFO lead: acquired remote=192.168.1.3:334743997lb # [ 41.657656] niks3-server[1118]: 2026/09/20 08:08:08 INFO lead: released remote=192.168.1.3:334743998lb # [ 41.664218] niks3-server[1118]: 2026/09/20 08:08:08 INFO lead: acquired remote=192.168.1.4:546643999lb # [ 41.665415] niks3-server[1118]: 2026/09/20 08:08:08 INFO lead: released remote=192.168.1.4:546644000worker1 # [ 41.717469] nix-grpc-daemon[774]: ts=2026-09-20T08:08:08Z level=info event=scheduler_take_over4001lb # [ 41.672451] niks3-server[1118]: 2026/09/20 08:08:08 INFO lead: acquired remote=192.168.1.3:548764002worker2 # [ 41.821991] nix-grpc-daemon[776]: ts=2026-09-20T08:08:08Z level=info event=scheduler_connected addr=lb:500514003worker1 # [ 41.849134] nix-grpc-daemon[774]: ts=2026-09-20T08:08:08Z level=info event=scheduler_connected addr=lb:500514004worker1 # [ 41.855976] nix-grpc-daemon[774]: ts=2026-09-20T08:08:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4005worker1 # [ 41.862365] nix-grpc-daemon[774]: ts=2026-09-20T08:08:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04006worker1 # [ 42.063244] nix-grpc-daemon[774]: ts=2026-09-20T08:08:08Z level=info event=scheduler_connected addr=lb:500514007worker1 # [ 42.068910] nix-grpc-daemon[774]: ts=2026-09-20T08:08:08Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04008lb: (finished: waiting for unit niks3.service, in 27.24 seconds)4009lb: waiting for TCP port 5751 on localhost4010lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4011lb: (finished: waiting for TCP port 5751 on localhost, in 0.10 seconds)4012lb: waiting for unit envoy.service4013lb: (finished: waiting for unit envoy.service, in 0.07 seconds)4014lb: waiting for TCP port 50051 on localhost4015lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4016lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)4017lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4018??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4019 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284020lb: must succeed: curl -sf localhost:9901/clusters4021lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4022lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds)4023subtest: one node schedules and both builders hold a WorkerSession on it4024lb: must succeed: curl -sf localhost:9901/clusters4025lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4026worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4027worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)4028(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.16 seconds)4029subtest: balancer auth: client cert, bearer token, nothing, unknown CN4030worker1 # [ 43.617004] nix-grpc-daemon[774]: ts=2026-09-20T08:08:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:358904031worker1 # [ 43.635870] systemd[1]: Started Nix Daemon.4032worker1 # [ 43.969567] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4033worker1 # [ 44.012704] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 87 ms (attempt 1/5)4034worker1 # [ 44.106167] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 159 ms (attempt 2/5)4035worker1 # [ 44.273023] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 144 ms (attempt 3/5)4036worker1 # [ 44.417289] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 462 ms (attempt 4/5)4037worker1 # [ 44.883017] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4038worker1 # [ 44.905345] nix-grpc-daemon[774]: ts=2026-09-20T08:08:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:358904039worker1 # [ 44.919562] nix-grpc-daemon[774]: ts=2026-09-20T08:08:11Z level=debug event=path_info_miss path=rh6m2zj85qm755mc0pgdfrhyf6vajb8c-nixos-system-client-test error="error: path '/nix/store/rh6m2zj85qm755mc0pgdfrhyf6vajb8c-nixos-system-client-test' is required, but there is no substituter that can build it"4040worker1 # [ 44.932583] nix-grpc-daemon[774]: ts=2026-09-20T08:08:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:358904041worker1 # [ 44.943372] nix-grpc-daemon[774]: ts=2026-09-20T08:08:11Z level=debug event=path_info_miss path=rh6m2zj85qm755mc0pgdfrhyf6vajb8c-nixos-system-client-test error="error: path '/nix/store/rh6m2zj85qm755mc0pgdfrhyf6vajb8c-nixos-system-client-test' is required, but there is no substituter that can build it"4042client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4043client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.11 seconds)4044client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4045client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)4046worker2 # [ 45.392930] nix-grpc-daemon[776]: ts=2026-09-20T08:08:11Z level=info event=oidc_jwks provider=mock keys=14047worker2 # [ 45.397874] nix-grpc-daemon[776]: ts=2026-09-20T08:08:11Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:422964048worker2 # [ 45.411016] systemd[1]: Started Nix Daemon.4049worker2 # [ 45.750613] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4050worker2 # [ 45.778462] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 1/5)4051worker2 # [ 45.874380] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 145 ms (attempt 2/5)4052worker2 # [ 46.020049] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 74 ms (attempt 3/5)4053worker2 # [ 46.094428] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 356 ms (attempt 4/5)4054worker2 # [ 46.454428] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4055worker2 # [ 46.476168] nix-grpc-daemon[776]: ts=2026-09-20T08:08:13Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:422964056worker2 # [ 46.490614] nix-grpc-daemon[776]: ts=2026-09-20T08:08:13Z level=debug event=path_info_miss path=rh6m2zj85qm755mc0pgdfrhyf6vajb8c-nixos-system-client-test error="error: path '/nix/store/rh6m2zj85qm755mc0pgdfrhyf6vajb8c-nixos-system-client-test' is required, but there is no substituter that can build it"4057worker1 # [ 46.534569] nix-grpc-daemon[774]: ts=2026-09-20T08:08:13Z level=info event=oidc_jwks provider=mock keys=14058worker1 # [ 46.540508] nix-grpc-daemon[774]: ts=2026-09-20T08:08:13Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:358904059worker1 # [ 46.551368] nix-grpc-daemon[774]: ts=2026-09-20T08:08:13Z level=debug event=path_info_miss path=rh6m2zj85qm755mc0pgdfrhyf6vajb8c-nixos-system-client-test error="error: path '/nix/store/rh6m2zj85qm755mc0pgdfrhyf6vajb8c-nixos-system-client-test' is required, but there is no substituter that can build it"4060client: must succeed: rm -r /var/lib/nix-grpc-store4061client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.09 seconds)4062worker1 # [ 46.931140] nix-grpc-daemon[774]: ts=2026-09-20T08:08:13Z level=info event=denied method=QueryMissing cn=- role=none4063worker2 # [ 47.154487] nix-grpc-daemon[776]: ts=2026-09-20T08:08:13Z level=info event=denied method=QueryMissing cn=stranger role=none4064(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 4.02 seconds)4065subtest: DAG build is scheduled across workers and lands in the cache4066client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&24067worker1 # [ 47.506432] nix-grpc-daemon[774]: ts=2026-09-20T08:08:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:358904068client # don't know how to build these paths:4069client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4070worker1 # [ 47.544964] nix-grpc-daemon[774]: ts=2026-09-20T08:08:14Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=04071worker1 # [ 47.550319] nix-grpc-daemon[774]: ts=2026-09-20T08:08:14Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=14072worker2 # [ 47.573565] nix-grpc-daemon[776]: ts=2026-09-20T08:08:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:422964073worker2 # [ 47.594000] nix-grpc-daemon[776]: ts=2026-09-20T08:08:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:422964074client # copying 1 paths to 'lb:50051'...4075worker2 # [ 47.612130] nix-grpc-daemon[776]: ts=2026-09-20T08:08:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:422964076client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...4077worker2 # [ 47.638416] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4078worker2 # [ 47.676169] nix-grpc-daemon[776]: ts=2026-09-20T08:08:14Z level=info event=niks3_push_started pid=8494079worker2 # [ 48.150531] nix-daemon[839]: accepted connection from pid 862, user nix-grpc-daemon (trusted)4080worker2 # [ 48.170139] nix-daemon[839]: reaped child process 865, status = succeeded4081worker2 # [ 48.351942] nix-daemon[839]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4082worker2 # [ 48.371242] nix-daemon[839]: reaped child process 870, status = succeeded4083lb # [ 48.363740] niks3-server[1118]: 2026/09/20 08:08:14 INFO Received uploads request method=POST path=/api/pending_closures4084worker2 # [ 48.411390] nix-grpc-daemon[849]: time=2026-09-20T08:08:14.943Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4085worker2 # [ 48.414586] nix-grpc-daemon[849]: time=2026-09-20T08:08:14.943Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"4086lb # [ 48.439836] niks3-server[1118]: 2026/09/20 08:08:15 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst4087lb # [ 48.453547] niks3-server[1118]: 2026/09/20 08:08:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4088lb # [ 48.468105] niks3-server[1118]: 2026/09/20 08:08:15 INFO Signed narinfos id=1 count=14089worker2 # [ 48.494317] nix-grpc-daemon[849]: time=2026-09-20T08:08:15.028Z level=INFO msg="Uploading 1 narinfos"4090lb # [ 48.496304] niks3-server[1118]: 2026/09/20 08:08:15 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4091lb # [ 48.518730] niks3-server[1118]: 2026/09/20 08:08:15 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls4092lb # [ 48.528196] niks3-server[1118]: 2026/09/20 08:08:15 INFO Completed upload id=14093worker2 # [ 48.548789] nix-grpc-daemon[849]: time=2026-09-20T08:08:15.083Z level=INFO msg="Upload complete. (591ms)"4094lb # [ 48.537474] niks3-server[1118]: 2026/09/20 08:08:15 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo4095worker2 # [ 48.560312] nix-grpc-daemon[776]: ts=2026-09-20T08:08:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=0 paths=1 nar_bytes_in=5044096worker2 # [ 48.577684] nix-grpc-daemon[776]: ts=2026-09-20T08:08:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:422964097worker2 # [ 48.596351] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4098worker2 # [ 48.602021] nix-daemon[839]: reaped child process 847, status = succeeded4099client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...4100worker2 # [ 48.617488] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4101client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv4102client # farm-a> LOG-farm-a-t14103worker2 # [ 50.069417] nix-daemon[839]: reaped child process 874, status = succeeded4104worker2 # [ 50.256896] nix-daemon[839]: accepted connection from pid 889, user nix-grpc-daemon (trusted)4105worker2 # [ 50.276413] nix-daemon[839]: reaped child process 892, status = succeeded4106lb # [ 50.269078] niks3-server[1118]: 2026/09/20 08:08:16 INFO Received uploads request method=POST path=/api/pending_closures4107worker2 # [ 50.307825] nix-grpc-daemon[849]: time=2026-09-20T08:08:16.840Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4108worker2 # [ 50.310461] nix-grpc-daemon[849]: time=2026-09-20T08:08:16.840Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"4109lb # [ 50.320162] niks3-server[1118]: 2026/09/20 08:08:16 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv4110lb # [ 50.334778] niks3-server[1118]: 2026/09/20 08:08:16 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4111lb # [ 50.349410] niks3-server[1118]: 2026/09/20 08:08:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4112lb # [ 50.357468] niks3-server[1118]: 2026/09/20 08:08:16 INFO Signed narinfos id=2 count=14113worker2 # [ 50.377782] nix-grpc-daemon[849]: time=2026-09-20T08:08:16.910Z level=INFO msg="Uploading 1 narinfos"4114lb # [ 50.361323] niks3-server[1118]: 2026/09/20 08:08:16 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls4115lb # [ 50.378360] niks3-server[1118]: 2026/09/20 08:08:16 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4116lb # [ 50.385397] niks3-server[1118]: 2026/09/20 08:08:16 INFO Completed upload id=24117worker2 # [ 50.405055] nix-grpc-daemon[849]: time=2026-09-20T08:08:16.939Z level=INFO msg="Upload complete. (365ms)"4118lb # [ 50.388502] niks3-server[1118]: 2026/09/20 08:08:16 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo4119worker2 # [ 50.417382] nix-grpc-daemon[776]: ts=2026-09-20T08:08:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=14120worker1 # [ 50.455589] nix-grpc-daemon[774]: ts=2026-09-20T08:08:17Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=04121worker1 # [ 50.461644] nix-grpc-daemon[774]: ts=2026-09-20T08:08:17Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=14122worker2 # [ 50.438996] nix-daemon[839]: reaped child process 872, status = succeeded4123worker2 # [ 50.472868] nix-grpc-daemon[776]: ts=2026-09-20T08:08:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:422964124worker2 # [ 50.489293] nix-grpc-daemon[776]: ts=2026-09-20T08:08:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:422964125worker2 # [ 50.505067] nix-grpc-daemon[849]: time=2026-09-20T08:08:17.039Z level=INFO msg="All 1 paths already cached"4126client # copying 1 paths to 'lb:50051'...4127worker2 # [ 50.514432] nix-grpc-daemon[776]: ts=2026-09-20T08:08:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:422964128client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...4129worker2 # [ 50.539183] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4130worker2 # [ 50.752759] nix-daemon[839]: accepted connection from pid 896, user nix-grpc-daemon (trusted)4131worker2 # [ 50.774431] nix-daemon[839]: reaped child process 899, status = succeeded4132worker2 # [ 50.948091] nix-daemon[839]: accepted connection from pid 901, user nix-grpc-daemon (trusted)4133worker2 # [ 50.968452] nix-daemon[839]: reaped child process 904, status = succeeded4134lb # [ 50.959494] niks3-server[1118]: 2026/09/20 08:08:17 INFO Received uploads request method=POST path=/api/pending_closures4135worker2 # [ 50.989798] nix-grpc-daemon[849]: time=2026-09-20T08:08:17.524Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4136worker2 # [ 50.991295] nix-grpc-daemon[849]: time=2026-09-20T08:08:17.524Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"4137lb # [ 50.990318] niks3-server[1118]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst4138lb # [ 51.002963] niks3-server[1118]: 2026/09/20 08:08:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4139worker2 # [ 51.029901] nix-grpc-daemon[849]: time=2026-09-20T08:08:17.564Z level=INFO msg="Uploading 1 narinfos"4140lb # [ 51.015064] niks3-server[1118]: 2026/09/20 08:08:17 INFO Signed narinfos id=3 count=14141lb # [ 51.020893] niks3-server[1118]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls4142lb # [ 51.028715] niks3-server[1118]: 2026/09/20 08:08:17 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4143lb # [ 51.035203] niks3-server[1118]: 2026/09/20 08:08:17 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo4144lb # [ 51.040657] niks3-server[1118]: 2026/09/20 08:08:17 INFO Completed upload id=34145worker2 # [ 51.061029] nix-grpc-daemon[849]: time=2026-09-20T08:08:17.595Z level=INFO msg="Upload complete. (503ms)"4146worker2 # [ 51.070408] nix-grpc-daemon[776]: ts=2026-09-20T08:08:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=0 paths=1 nar_bytes_in=6244147worker2 # [ 51.085726] nix-grpc-daemon[776]: ts=2026-09-20T08:08:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:422964148worker2 # [ 51.094465] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4149worker2 # [ 51.099530] nix-daemon[839]: reaped child process 894, status = succeeded4150lb # [ 51.081960] envoy[912]: conn peer=[::1]:38786 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=44151client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...4152worker2 # [ 51.109257] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4153lb # [ 51.087131] envoy[912]: conn peer=[2001:db8:1::1]:34054 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=365 ms=13984154client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4155lb # [ 51.092235] envoy[912]: conn peer=[2001:db8:1::1]:34058 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=365 ms=11764156lb # [ 51.096777] envoy[912]: conn peer=[2001:db8:1::1]:34060 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=204157lb # [ 51.101224] envoy[912]: conn peer=[2001:db8:1::1]:34062 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=184158client # farm-b> LOG-farm-b-t14159worker2 # [ 52.153205] nix-daemon[839]: reaped child process 908, status = succeeded4160worker2 # [ 52.319647] nix-daemon[839]: accepted connection from pid 923, user nix-grpc-daemon (trusted)4161worker2 # [ 52.339457] nix-daemon[839]: reaped child process 926, status = succeeded4162lb # [ 52.334084] niks3-server[1118]: 2026/09/20 08:08:18 INFO Received uploads request method=POST path=/api/pending_closures4163worker2 # [ 52.363215] nix-grpc-daemon[849]: time=2026-09-20T08:08:18.897Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4164worker2 # [ 52.364842] nix-grpc-daemon[849]: time=2026-09-20T08:08:18.897Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"4165lb # [ 52.365315] niks3-server[1118]: 2026/09/20 08:08:18 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4166lb # [ 52.377380] niks3-server[1118]: 2026/09/20 08:08:18 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst4167lb # [ 52.392877] niks3-server[1118]: 2026/09/20 08:08:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4168worker2 # [ 52.417623] nix-grpc-daemon[849]: time=2026-09-20T08:08:18.952Z level=INFO msg="Uploading 1 narinfos"4169lb # [ 52.402734] niks3-server[1118]: 2026/09/20 08:08:18 INFO Signed narinfos id=4 count=14170lb # [ 52.408701] niks3-server[1118]: 2026/09/20 08:08:18 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls4171lb # [ 52.416487] niks3-server[1118]: 2026/09/20 08:08:18 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4172lb # [ 52.425051] niks3-server[1118]: 2026/09/20 08:08:18 INFO Completed upload id=44173worker2 # [ 52.445198] nix-grpc-daemon[849]: time=2026-09-20T08:08:18.979Z level=INFO msg="Upload complete. (322ms)"4174lb # [ 52.427801] niks3-server[1118]: 2026/09/20 08:08:18 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo4175worker2 # [ 52.457168] nix-grpc-daemon[776]: ts=2026-09-20T08:08:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=14176worker1 # [ 52.490444] nix-grpc-daemon[774]: ts=2026-09-20T08:08:19Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=04177worker1 # [ 52.496576] nix-grpc-daemon[774]: ts=2026-09-20T08:08:19Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=14178worker2 # [ 52.477549] nix-daemon[839]: reaped child process 906, status = succeeded4179worker2 # [ 52.509868] nix-grpc-daemon[776]: ts=2026-09-20T08:08:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:422964180worker2 # [ 52.526130] nix-grpc-daemon[776]: ts=2026-09-20T08:08:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:422964181worker2 # [ 52.540511] nix-grpc-daemon[849]: time=2026-09-20T08:08:19.075Z level=INFO msg="All 2 paths already cached"4182client # copying 1 paths to 'lb:50051'...4183worker2 # [ 52.551017] nix-grpc-daemon[776]: ts=2026-09-20T08:08:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:422964184client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...4185worker2 # [ 52.574531] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4186worker2 # [ 52.781453] nix-daemon[839]: accepted connection from pid 930, user nix-grpc-daemon (trusted)4187worker2 # [ 52.802069] nix-daemon[839]: reaped child process 933, status = succeeded4188worker2 # [ 52.975959] nix-daemon[839]: accepted connection from pid 935, user nix-grpc-daemon (trusted)4189worker2 # [ 52.995574] nix-daemon[839]: reaped child process 938, status = succeeded4190lb # [ 52.986990] niks3-server[1118]: 2026/09/20 08:08:19 INFO Received uploads request method=POST path=/api/pending_closures4191worker2 # [ 53.017174] nix-grpc-daemon[849]: time=2026-09-20T08:08:19.551Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4192worker2 # [ 53.018653] nix-grpc-daemon[849]: time=2026-09-20T08:08:19.551Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"4193lb # [ 53.014923] niks3-server[1118]: 2026/09/20 08:08:19 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst4194worker2 # [ 53.049341] nix-grpc-daemon[849]: time=2026-09-20T08:08:19.583Z level=INFO msg="Uploading 1 narinfos"4195lb # [ 53.030207] niks3-server[1118]: 2026/09/20 08:08:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4196lb # [ 53.042168] niks3-server[1118]: 2026/09/20 08:08:19 INFO Signed narinfos id=5 count=14197worker2 # [ 53.072307] nix-grpc-daemon[849]: time=2026-09-20T08:08:19.607Z level=INFO msg="Upload complete. (478ms)"4198lb # [ 53.048399] niks3-server[1118]: 2026/09/20 08:08:19 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls4199lb # [ 53.058924] niks3-server[1118]: 2026/09/20 08:08:19 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4200worker2 # [ 53.080098] nix-grpc-daemon[776]: ts=2026-09-20T08:08:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=0 paths=1 nar_bytes_in=7524201lb # [ 53.063591] niks3-server[1118]: 2026/09/20 08:08:19 INFO Completed upload id=54202lb # [ 53.065977] niks3-server[1118]: 2026/09/20 08:08:19 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo4203worker2 # [ 53.091838] nix-grpc-daemon[776]: ts=2026-09-20T08:08:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:422964204worker2 # [ 53.098410] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4205worker2 # [ 53.103109] nix-daemon[839]: reaped child process 928, status = succeeded4206client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...4207worker2 # [ 53.116183] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4208client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4209client # farm-top> LOG-farm-top-t14210worker2 # [ 54.158721] nix-daemon[839]: reaped child process 942, status = succeeded4211worker2 # [ 54.344717] nix-daemon[839]: accepted connection from pid 957, user nix-grpc-daemon (trusted)4212worker2 # [ 54.362580] nix-daemon[839]: reaped child process 960, status = succeeded4213lb # [ 54.356713] niks3-server[1118]: 2026/09/20 08:08:20 INFO Received uploads request method=POST path=/api/pending_closures4214worker2 # [ 54.389392] nix-grpc-daemon[849]: time=2026-09-20T08:08:20.922Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4215worker2 # [ 54.390966] nix-grpc-daemon[849]: time=2026-09-20T08:08:20.922Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4216lb # [ 54.403314] niks3-server[1118]: 2026/09/20 08:08:20 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4217lb # [ 54.414651] niks3-server[1118]: 2026/09/20 08:08:20 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4218worker2 # [ 54.445720] nix-grpc-daemon[849]: time=2026-09-20T08:08:20.980Z level=INFO msg="Uploading 1 narinfos"4219lb # [ 54.425990] niks3-server[1118]: 2026/09/20 08:08:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4220lb # [ 54.433780] niks3-server[1118]: 2026/09/20 08:08:20 INFO Signed narinfos id=6 count=14221lb # [ 54.435782] niks3-server[1118]: 2026/09/20 08:08:20 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4222lb # [ 54.443885] niks3-server[1118]: 2026/09/20 08:08:21 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4223lb # [ 54.452918] niks3-server[1118]: 2026/09/20 08:08:21 INFO Completed upload id=64224worker2 # [ 54.473230] nix-grpc-daemon[849]: time=2026-09-20T08:08:21.008Z level=INFO msg="Upload complete. (347ms)"4225lb # [ 54.456088] niks3-server[1118]: 2026/09/20 08:08:21 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4226worker2 # [ 54.485170] nix-grpc-daemon[776]: ts=2026-09-20T08:08:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14227worker2 # [ 54.504185] nix-daemon[839]: reaped child process 940, status = succeeded4228client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 7.35 seconds)4229client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath4230client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.23 seconds)4231client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4232client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.02 seconds)4233client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4234client # copying 3 paths...4235client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4236client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4237client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4238client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds)4239(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.01 seconds)4240subtest: repeat is answered Cached by the scheduler without building4241worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4242worker1 # finding garbage collector roots...4243worker1 # deleting specified paths...4244worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4245worker1 # deleting unused links...4246worker1 # note: hard linking is currently saving 0.0 KiB4247worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds)4248worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4249worker2 # finding garbage collector roots...4250worker2 # deleting specified paths...4251worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4252worker2 # deleting unused links...4253worker2 # note: hard linking is currently saving 0.0 KiB4254worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds)4255client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&24256worker2 # [ 56.018462] nix-grpc-daemon[776]: ts=2026-09-20T08:08:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:422964257client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4258client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4259worker1 # [ 56.079779] nix-grpc-daemon[774]: ts=2026-09-20T08:08:22Z level=debug event=want client=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=14260worker1 # [ 56.094816] nix-grpc-daemon[774]: ts=2026-09-20T08:08:22Z level=debug event=want client=2 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=14261worker1 # [ 56.108151] nix-grpc-daemon[774]: ts=2026-09-20T08:08:22Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14262client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 0.35 seconds)4263client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath4264client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.22 seconds)4265lb: must succeed: curl -sf localhost:9901/clusters4266lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4267lb: must succeed: curl -sf localhost:9901/clusters4268lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4269worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4270worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.09 seconds)4271(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.48 seconds)4272subtest: two clients wanting the same drv build it once4273client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4274client # [ 56.745118] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4275client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds)4276client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4277client # Running as unit: dedup1.service; invocation ID: e1b600ef1a3449f5a7e2567316579cc74278client # [ 57.001941] nix[864]: don't know how to build these paths:4279client # [ 57.003761] nix[864]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4280worker2 # [ 57.015550] nix-grpc-daemon[776]: ts=2026-09-20T08:08:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:422964281worker1 # [ 57.057097] nix-grpc-daemon[774]: ts=2026-09-20T08:08:23Z level=debug event=want client=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04282worker1 # [ 57.063757] nix-grpc-daemon[774]: ts=2026-09-20T08:08:23Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=14283worker1 # [ 57.114462] nix-grpc-daemon[774]: ts=2026-09-20T08:08:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:358904284worker1 # [ 57.130798] nix-grpc-daemon[774]: ts=2026-09-20T08:08:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:358904285client # [ 57.100844] nix[864]: copying 1 paths to 'lb:50051'...4286worker1 # [ 57.148861] nix-grpc-daemon[774]: ts=2026-09-20T08:08:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:358904287client # [ 57.105836] nix[864]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4288worker1 # [ 57.165411] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4289worker1 # [ 57.192860] nix-grpc-daemon[774]: ts=2026-09-20T08:08:23Z level=info event=niks3_push_started pid=8844290worker1 # [ 57.650743] nix-daemon[842]: accepted connection from pid 897, user nix-grpc-daemon (trusted)4291worker1 # [ 57.669822] nix-daemon[842]: reaped child process 900, status = succeeded4292worker1 # [ 57.854850] nix-daemon[842]: accepted connection from pid 902, user nix-grpc-daemon (trusted)4293worker1 # [ 57.873324] nix-daemon[842]: reaped child process 905, status = succeeded4294lb # [ 57.838412] niks3-server[1118]: 2026/09/20 08:08:24 INFO Received uploads request method=POST path=/api/pending_closures4295worker1 # [ 57.897721] nix-grpc-daemon[884]: time=2026-09-20T08:08:24.441Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4296worker1 # [ 57.899259] nix-grpc-daemon[884]: time=2026-09-20T08:08:24.442Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4297client # [ 57.872934] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4298lb # [ 57.880422] niks3-server[1118]: 2026/09/20 08:08:24 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4299worker1 # [ 57.938035] nix-grpc-daemon[884]: time=2026-09-20T08:08:24.483Z level=INFO msg="Uploading 1 narinfos"4300lb # [ 57.890408] niks3-server[1118]: 2026/09/20 08:08:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4301client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.14 seconds)4302lb # [ 57.902012] niks3-server[1118]: 2026/09/20 08:08:24 INFO Signed narinfos id=7 count=14303lb # [ 57.911790] niks3-server[1118]: 2026/09/20 08:08:24 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4304lb # [ 57.924081] niks3-server[1118]: 2026/09/20 08:08:24 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4305worker1 # [ 57.978506] nix-grpc-daemon[884]: time=2026-09-20T08:08:24.524Z level=INFO msg="Upload complete. (518ms)"4306lb # [ 57.932822] niks3-server[1118]: 2026/09/20 08:08:24 INFO Completed upload id=74307worker1 # [ 57.984156] nix-grpc-daemon[774]: ts=2026-09-20T08:08:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35890 duration_s=0 paths=1 nar_bytes_in=4324308lb # [ 57.936850] niks3-server[1118]: 2026/09/20 08:08:24 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4309worker1 # [ 57.994410] nix-grpc-daemon[774]: ts=2026-09-20T08:08:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:358904310worker1 # [ 58.003455] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4311worker1 # [ 58.009001] nix-daemon[842]: reaped child process 882, status = succeeded4312client # Running as unit: dedup2.service; invocation ID: 2e13b03b7c8a4839839a8e74e346efe64313client # [ 57.976688] nix[864]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4314worker1 # [ 58.023368] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4315client # [ 58.238743] nix[880]: don't know how to build these paths:4316worker2 # [ 58.253655] nix-grpc-daemon[776]: ts=2026-09-20T08:08:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:422964317client # [ 58.242892] nix[880]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4318worker1 # [ 58.298958] nix-grpc-daemon[774]: ts=2026-09-20T08:08:24Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04319worker1 # [ 58.313419] nix-grpc-daemon[774]: ts=2026-09-20T08:08:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:358904320client # [ 58.279025] nix[880]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4321client: must succeed: sleep 24322lb # [ 61.084460] envoy[912]: conn peer=[2001:db8:1::1]:34070 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9384 tx=3818 ms=71024323lb # [ 61.084966] envoy[912]: conn peer=[2001:db8:1::1]:40526 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1162 tx=481 ms=854324client: (finished: must succeed: sleep 2, in 2.08 seconds)4325??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4326 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394327client: waiting for success: ! systemctl is-active dedup1 dedup24328??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4329 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394330worker1 # [ 61.694752] nix-daemon[842]: reaped child process 913, status = succeeded4331worker1 # [ 61.896200] nix-daemon[842]: accepted connection from pid 940, user nix-grpc-daemon (trusted)4332worker1 # [ 61.918378] nix-daemon[842]: reaped child process 943, status = succeeded4333lb # [ 61.886336] niks3-server[1118]: 2026/09/20 08:08:28 INFO Received uploads request method=POST path=/api/pending_closures4334worker1 # [ 61.946366] nix-grpc-daemon[884]: time=2026-09-20T08:08:28.490Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4335worker1 # [ 61.948424] nix-grpc-daemon[884]: time=2026-09-20T08:08:28.490Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4336lb # [ 61.968616] niks3-server[1118]: 2026/09/20 08:08:28 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4337lb # [ 61.982956] niks3-server[1118]: 2026/09/20 08:08:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4338worker1 # [ 62.031942] nix-grpc-daemon[884]: time=2026-09-20T08:08:28.575Z level=INFO msg="Uploading 1 narinfos"4339lb # [ 61.987189] niks3-server[1118]: 2026/09/20 08:08:28 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4340lb # [ 61.999290] niks3-server[1118]: 2026/09/20 08:08:28 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4341lb # [ 62.003941] niks3-server[1118]: 2026/09/20 08:08:28 INFO Signed narinfos id=8 count=14342lb # [ 62.013848] niks3-server[1118]: 2026/09/20 08:08:28 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4343lb # [ 62.019846] niks3-server[1118]: 2026/09/20 08:08:28 INFO Completed upload id=84344lb # [ 62.022830] niks3-server[1118]: 2026/09/20 08:08:28 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4345worker1 # [ 62.077470] nix-grpc-daemon[884]: time=2026-09-20T08:08:28.613Z level=INFO msg="Upload complete. (427ms)"4346worker1 # [ 62.085514] nix-grpc-daemon[774]: ts=2026-09-20T08:08:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35890 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14347worker1 # [ 62.105744] nix-grpc-daemon[774]: ts=2026-09-20T08:08:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35890 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14348worker1 # [ 62.116623] nix-daemon[842]: reaped child process 911, status = succeeded4349client # [ 62.094521] systemd[1]: dedup1.service: Deactivated successfully.4350client # [ 62.106215] systemd[1]: dedup1.service: Consumed 167ms CPU time over 5.356s wall clock time, 37.2M memory peak, 8.6K incoming IP traffic, 8.9K outgoing IP traffic.4351client # [ 62.147600] systemd[1]: dedup2.service: Deactivated successfully.4352client # [ 62.150673] systemd[1]: dedup2.service: Consumed 210ms CPU time over 4.278s wall clock time, 31M memory peak, 7.6K incoming IP traffic, 6.6K outgoing IP traffic.4353client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.18 seconds)4354client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4355client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.09 seconds)4356worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4357worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.09 seconds)4358worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4359worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.09 seconds)4360worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4361worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.10 seconds)4362worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4363worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.12 seconds)4364(finished: subtest: two clients wanting the same drv build it once, in 6.54 seconds)4365subtest: build hook: nix-daemon with builders = grpc://lb4366client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log4367client # [ 63.485798] systemd[1]: Started Nix Daemon.4368client # [ 63.711670] nix-daemon[921]: accepted connection from pid 918, user root (trusted)4369worker1 # [ 63.992826] nix-grpc-daemon[774]: ts=2026-09-20T08:08:30Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:358904370worker1 # [ 63.999779] nix-grpc-daemon[774]: ts=2026-09-20T08:08:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:358904371worker1 # [ 64.022764] nix-grpc-daemon[774]: ts=2026-09-20T08:08:30Z level=debug event=want client=5 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04372worker1 # [ 64.029312] nix-grpc-daemon[774]: ts=2026-09-20T08:08:30Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14373worker2 # [ 64.010612] nix-grpc-daemon[776]: ts=2026-09-20T08:08:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:422964374worker2 # [ 64.029278] nix-grpc-daemon[776]: ts=2026-09-20T08:08:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:422964375worker2 # [ 64.048847] nix-grpc-daemon[776]: ts=2026-09-20T08:08:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:422964376worker2 # [ 64.068287] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4377worker2 # [ 64.319040] nix-daemon[839]: accepted connection from pid 1000, user nix-grpc-daemon (trusted)4378worker2 # [ 64.341127] nix-daemon[839]: reaped child process 1003, status = succeeded4379worker2 # [ 64.535076] nix-daemon[839]: accepted connection from pid 1005, user nix-grpc-daemon (trusted)4380worker2 # [ 64.558384] nix-daemon[839]: reaped child process 1008, status = succeeded4381lb # [ 64.551416] niks3-server[1118]: 2026/09/20 08:08:31 INFO Received uploads request method=POST path=/api/pending_closures4382worker2 # [ 64.583218] nix-grpc-daemon[849]: time=2026-09-20T08:08:31.117Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4383worker2 # [ 64.584909] nix-grpc-daemon[849]: time=2026-09-20T08:08:31.117Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4384lb # [ 64.587695] niks3-server[1118]: 2026/09/20 08:08:31 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4385lb # [ 64.606496] niks3-server[1118]: 2026/09/20 08:08:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4386worker2 # [ 64.635753] nix-grpc-daemon[849]: time=2026-09-20T08:08:31.170Z level=INFO msg="Uploading 1 narinfos"4387lb # [ 64.623696] niks3-server[1118]: 2026/09/20 08:08:31 INFO Signed narinfos id=9 count=14388lb # [ 64.630714] niks3-server[1118]: 2026/09/20 08:08:31 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4389lb # [ 64.643778] niks3-server[1118]: 2026/09/20 08:08:31 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4390lb # [ 64.650522] niks3-server[1118]: 2026/09/20 08:08:31 INFO Completed upload id=94391worker2 # [ 64.671054] nix-grpc-daemon[849]: time=2026-09-20T08:08:31.205Z level=INFO msg="Upload complete. (580ms)"4392lb # [ 64.654603] niks3-server[1118]: 2026/09/20 08:08:31 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4393worker2 # [ 64.684773] nix-grpc-daemon[776]: ts=2026-09-20T08:08:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=0 paths=1 nar_bytes_in=5124394worker2 # [ 64.700676] nix-grpc-daemon[776]: ts=2026-09-20T08:08:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:422964395worker2 # [ 64.709048] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4396worker2 # [ 64.714222] nix-daemon[839]: reaped child process 998, status = succeeded4397worker2 # [ 64.727635] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4398worker2 # [ 65.974293] nix-daemon[839]: reaped child process 1012, status = succeeded4399worker2 # [ 66.147660] nix-daemon[839]: accepted connection from pid 1027, user nix-grpc-daemon (trusted)4400worker2 # [ 66.163897] nix-daemon[839]: reaped child process 1030, status = succeeded4401lb # [ 66.162683] niks3-server[1118]: 2026/09/20 08:08:32 INFO Received uploads request method=POST path=/api/pending_closures4402worker2 # [ 66.196462] nix-grpc-daemon[849]: time=2026-09-20T08:08:32.727Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4403worker2 # [ 66.198339] nix-grpc-daemon[849]: time=2026-09-20T08:08:32.727Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4404lb # [ 66.200294] niks3-server[1118]: 2026/09/20 08:08:32 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4405lb # [ 66.215170] niks3-server[1118]: 2026/09/20 08:08:32 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4406lb # [ 66.229431] niks3-server[1118]: 2026/09/20 08:08:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4407worker2 # [ 66.254518] nix-grpc-daemon[849]: time=2026-09-20T08:08:32.788Z level=INFO msg="Uploading 1 narinfos"4408lb # [ 66.239251] niks3-server[1118]: 2026/09/20 08:08:32 INFO Signed narinfos id=10 count=14409lb # [ 66.244722] niks3-server[1118]: 2026/09/20 08:08:32 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4410lb # [ 66.251909] niks3-server[1118]: 2026/09/20 08:08:32 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4411lb # [ 66.258865] niks3-server[1118]: 2026/09/20 08:08:32 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4412lb # [ 66.264563] niks3-server[1118]: 2026/09/20 08:08:32 INFO Completed upload id=104413worker2 # [ 66.284858] nix-grpc-daemon[849]: time=2026-09-20T08:08:32.819Z level=INFO msg="Upload complete. (346ms)"4414worker2 # [ 66.298419] nix-grpc-daemon[776]: ts=2026-09-20T08:08:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=5 outputs=14415worker2 # [ 66.316107] nix-grpc-daemon[776]: ts=2026-09-20T08:08:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:422964416worker2 # [ 66.322082] nix-daemon[839]: reaped child process 1010, status = succeeded4417worker1 # [ 66.350872] nix-grpc-daemon[774]: ts=2026-09-20T08:08:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:358904418worker1 # [ 66.368069] nix-grpc-daemon[774]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4419worker1 # [ 66.390214] nix-grpc-daemon[774]: ts=2026-09-20T08:08:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35890 duration_s=0 paths=1 nar_bytes_out=1284420worker1 # [ 66.690713] nix-grpc-daemon[774]: ts=2026-09-20T08:08:33Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:358904421worker2 # [ 66.667602] nix-grpc-daemon[776]: ts=2026-09-20T08:08:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:422964422worker2 # [ 66.677326] nix-grpc-daemon[849]: time=2026-09-20T08:08:33.212Z level=INFO msg="All 1 paths already cached"4423worker1 # [ 66.722911] nix-grpc-daemon[774]: ts=2026-09-20T08:08:33Z level=debug event=want client=6 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04424worker2 # [ 66.699188] nix-grpc-daemon[776]: ts=2026-09-20T08:08:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:422964425worker1 # [ 66.729197] nix-grpc-daemon[774]: ts=2026-09-20T08:08:33Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14426worker2 # [ 66.714016] nix-grpc-daemon[776]: ts=2026-09-20T08:08:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:422964427worker2 # [ 66.728382] nix-grpc-daemon[849]: time=2026-09-20T08:08:33.263Z level=INFO msg="All 1 paths already cached"4428worker2 # [ 66.737608] nix-grpc-daemon[776]: ts=2026-09-20T08:08:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:422964429worker2 # [ 66.751312] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4430worker2 # [ 66.952963] nix-daemon[839]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4431worker2 # [ 66.973449] nix-daemon[839]: reaped child process 1037, status = succeeded4432worker2 # [ 67.147956] nix-daemon[839]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)4433worker2 # [ 67.164474] nix-daemon[839]: reaped child process 1042, status = succeeded4434lb # [ 67.158065] niks3-server[1118]: 2026/09/20 08:08:33 INFO Received uploads request method=POST path=/api/pending_closures4435worker2 # [ 67.188462] nix-grpc-daemon[849]: time=2026-09-20T08:08:33.723Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4436worker2 # [ 67.189932] nix-grpc-daemon[849]: time=2026-09-20T08:08:33.723Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4437worker2 # [ 67.214268] nix-grpc-daemon[849]: time=2026-09-20T08:08:33.748Z level=INFO msg="Uploading 1 narinfos"4438lb # [ 67.194195] niks3-server[1118]: 2026/09/20 08:08:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4439lb # [ 67.207361] niks3-server[1118]: 2026/09/20 08:08:33 INFO Signed narinfos id=11 count=14440lb # [ 67.214551] niks3-server[1118]: 2026/09/20 08:08:33 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4441worker2 # [ 67.244950] nix-grpc-daemon[849]: time=2026-09-20T08:08:33.779Z level=INFO msg="Upload complete. (477ms)"4442lb # [ 67.227270] niks3-server[1118]: 2026/09/20 08:08:33 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4443worker2 # [ 67.252242] nix-grpc-daemon[776]: ts=2026-09-20T08:08:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=0 paths=1 nar_bytes_in=6244444lb # [ 67.234568] niks3-server[1118]: 2026/09/20 08:08:33 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4445lb # [ 67.238910] niks3-server[1118]: 2026/09/20 08:08:33 INFO Completed upload id=114446lb # [ 67.241117] niks3-server[1118]: 2026/09/20 08:08:33 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4447worker2 # [ 67.263819] nix-grpc-daemon[776]: ts=2026-09-20T08:08:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:422964448worker2 # [ 67.270625] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4449worker2 # [ 67.275653] nix-daemon[839]: reaped child process 1032, status = succeeded4450worker2 # [ 67.285663] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4451worker2 # [ 68.517849] nix-daemon[839]: reaped child process 1046, status = succeeded4452worker2 # [ 68.691645] nix-daemon[839]: accepted connection from pid 1061, user nix-grpc-daemon (trusted)4453worker2 # [ 68.709957] nix-daemon[839]: reaped child process 1064, status = succeeded4454lb # [ 68.703750] niks3-server[1118]: 2026/09/20 08:08:35 INFO Received uploads request method=POST path=/api/pending_closures4455worker2 # [ 68.735511] nix-grpc-daemon[849]: time=2026-09-20T08:08:35.268Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4456worker2 # [ 68.739161] nix-grpc-daemon[849]: time=2026-09-20T08:08:35.268Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4457lb # [ 68.752241] niks3-server[1118]: 2026/09/20 08:08:35 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4458worker2 # [ 68.782341] nix-grpc-daemon[849]: time=2026-09-20T08:08:35.316Z level=INFO msg="Uploading 1 narinfos"4459lb # [ 68.767379] niks3-server[1118]: 2026/09/20 08:08:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4460lb # [ 68.781513] niks3-server[1118]: 2026/09/20 08:08:35 INFO Signed narinfos id=12 count=14461worker2 # [ 68.806129] nix-grpc-daemon[849]: time=2026-09-20T08:08:35.340Z level=INFO msg="Upload complete. (309ms)"4462lb # [ 68.789188] niks3-server[1118]: 2026/09/20 08:08:35 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4463lb # [ 68.796750] niks3-server[1118]: 2026/09/20 08:08:35 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4464lb # [ 68.801552] niks3-server[1118]: 2026/09/20 08:08:35 INFO Completed upload id=124465worker1 # [ 68.850829] nix-grpc-daemon[774]: ts=2026-09-20T08:08:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:358904466worker2 # [ 68.817034] nix-grpc-daemon[776]: ts=2026-09-20T08:08:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=6 outputs=14467lb # [ 68.805681] niks3-server[1118]: 2026/09/20 08:08:35 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4468worker2 # [ 68.829475] nix-daemon[839]: reaped child process 1044, status = succeeded4469lb # [ 68.809441] niks3-server[1118]: 2026/09/20 08:08:35 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4470worker1 # [ 68.866309] nix-grpc-daemon[774]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4471worker1 # [ 68.908124] nix-grpc-daemon[774]: ts=2026-09-20T08:08:35Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:358904472worker1 # [ 68.913862] nix-grpc-daemon[774]: ts=2026-09-20T08:08:35Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35890 duration_s=0 paths=1 nar_bytes_out=1764473worker2 # [ 69.195055] nix-grpc-daemon[776]: ts=2026-09-20T08:08:35Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:422964474worker2 # [ 69.203026] nix-grpc-daemon[776]: ts=2026-09-20T08:08:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:422964475worker2 # [ 69.209046] nix-grpc-daemon[849]: time=2026-09-20T08:08:35.743Z level=INFO msg="All 2 paths already cached"4476worker1 # [ 69.254290] nix-grpc-daemon[774]: ts=2026-09-20T08:08:35Z level=debug event=want client=7 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04477worker1 # [ 69.260231] nix-grpc-daemon[774]: ts=2026-09-20T08:08:35Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14478worker2 # [ 69.272576] nix-grpc-daemon[776]: ts=2026-09-20T08:08:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:422964479worker2 # [ 69.288358] nix-grpc-daemon[776]: ts=2026-09-20T08:08:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:422964480worker2 # [ 69.303070] nix-grpc-daemon[849]: time=2026-09-20T08:08:35.837Z level=INFO msg="All 2 paths already cached"4481worker2 # [ 69.312610] nix-grpc-daemon[776]: ts=2026-09-20T08:08:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:422964482worker2 # [ 69.326497] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4483worker2 # [ 69.542352] nix-daemon[839]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)4484worker2 # [ 69.563245] nix-daemon[839]: reaped child process 1071, status = succeeded4485worker2 # [ 69.738412] nix-daemon[839]: accepted connection from pid 1073, user nix-grpc-daemon (trusted)4486worker2 # [ 69.757843] nix-daemon[839]: reaped child process 1076, status = succeeded4487lb # [ 69.751798] niks3-server[1118]: 2026/09/20 08:08:36 INFO Received uploads request method=POST path=/api/pending_closures4488worker2 # [ 69.785914] nix-grpc-daemon[849]: time=2026-09-20T08:08:36.320Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4489worker2 # [ 69.787440] nix-grpc-daemon[849]: time=2026-09-20T08:08:36.320Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4490lb # [ 69.787280] niks3-server[1118]: 2026/09/20 08:08:36 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4491worker2 # [ 69.819173] nix-grpc-daemon[849]: time=2026-09-20T08:08:36.353Z level=INFO msg="Uploading 1 narinfos"4492lb # [ 69.801710] niks3-server[1118]: 2026/09/20 08:08:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4493lb # [ 69.814459] niks3-server[1118]: 2026/09/20 08:08:36 INFO Signed narinfos id=13 count=14494lb # [ 69.819547] niks3-server[1118]: 2026/09/20 08:08:36 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4495lb # [ 69.828799] niks3-server[1118]: 2026/09/20 08:08:36 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4496lb # [ 69.836708] niks3-server[1118]: 2026/09/20 08:08:36 INFO Completed upload id=134497lb # [ 69.840232] niks3-server[1118]: 2026/09/20 08:08:36 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4498worker2 # [ 69.855021] nix-grpc-daemon[849]: time=2026-09-20T08:08:36.389Z level=INFO msg="Upload complete. (510ms)"4499worker2 # [ 69.866071] nix-grpc-daemon[776]: ts=2026-09-20T08:08:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=0 paths=1 nar_bytes_in=7524500worker2 # [ 69.879703] nix-grpc-daemon[776]: ts=2026-09-20T08:08:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:422964501worker2 # [ 69.886072] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4502worker2 # [ 69.890978] nix-daemon[839]: reaped child process 1066, status = succeeded4503worker2 # [ 69.905846] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4504lb # [ 71.083839] envoy[912]: conn peer=[2001:db8:1::1]:40534 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1372 ms=50574505lb # [ 71.088851] envoy[912]: conn peer=[2001:db8:1::1]:40548 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1456 tx=1085 ms=38664506lb # [ 71.093603] envoy[912]: conn peer=[2001:db8:1::1]:51782 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3427 tx=1664 ms=24604507lb # [ 71.100638] envoy[912]: conn peer=[2001:db8:1::1]:51798 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=334 ms=1014508lb # [ 71.105443] envoy[912]: conn peer=[2001:db8:1::1]:51804 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3862 tx=1967 ms=22814509lb # [ 71.110489] envoy[912]: conn peer=[2001:db8:1::1]:51806 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=694510worker2 # [ 71.145845] nix-daemon[839]: reaped child process 1080, status = succeeded4511worker2 # [ 71.317699] nix-daemon[839]: accepted connection from pid 1095, user nix-grpc-daemon (trusted)4512worker2 # [ 71.337697] nix-daemon[839]: reaped child process 1098, status = succeeded4513lb # [ 71.334211] niks3-server[1118]: 2026/09/20 08:08:37 INFO Received uploads request method=POST path=/api/pending_closures4514worker2 # [ 71.362525] nix-grpc-daemon[849]: time=2026-09-20T08:08:37.896Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4515worker2 # [ 71.364070] nix-grpc-daemon[849]: time=2026-09-20T08:08:37.896Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4516lb # [ 71.364695] niks3-server[1118]: 2026/09/20 08:08:37 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4517lb # [ 71.381449] niks3-server[1118]: 2026/09/20 08:08:37 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4518lb # [ 71.391437] niks3-server[1118]: 2026/09/20 08:08:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4519worker2 # [ 71.417051] nix-grpc-daemon[849]: time=2026-09-20T08:08:37.951Z level=INFO msg="Uploading 1 narinfos"4520lb # [ 71.401077] niks3-server[1118]: 2026/09/20 08:08:37 INFO Signed narinfos id=14 count=14521lb # [ 71.403525] niks3-server[1118]: 2026/09/20 08:08:37 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4522lb # [ 71.412566] niks3-server[1118]: 2026/09/20 08:08:37 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4523lb # [ 71.421416] niks3-server[1118]: 2026/09/20 08:08:37 INFO Completed upload id=144524worker2 # [ 71.441073] nix-grpc-daemon[849]: time=2026-09-20T08:08:37.975Z level=INFO msg="Upload complete. (324ms)"4525lb # [ 71.424414] niks3-server[1118]: 2026/09/20 08:08:37 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4526worker1 # [ 71.485084] nix-grpc-daemon[774]: ts=2026-09-20T08:08:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:358904527worker2 # [ 71.452933] nix-grpc-daemon[776]: ts=2026-09-20T08:08:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=7 outputs=14528worker2 # [ 71.467412] nix-daemon[839]: reaped child process 1078, status = succeeded4529worker1 # [ 71.499153] nix-grpc-daemon[774]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4530worker2 # [ 71.515183] nix-grpc-daemon[776]: ts=2026-09-20T08:08:38Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:422964531worker2 # [ 71.522126] nix-grpc-daemon[776]: ts=2026-09-20T08:08:38Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=0 paths=1 nar_bytes_out=2324532client # [ 71.608869] nix-daemon[921]: reaped child process 923, status = succeeded4533client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.42 seconds)4534client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4535client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4536client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4537client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4538client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4539client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4540(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.55 seconds)4541subtest: an input only one worker has still reaches the builder4542client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4543client # this derivation will be built:4544client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4545client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4546client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.45 seconds)4547client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4548client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.21 seconds)4549worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4550worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.26 seconds)4551worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4552worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4553client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24554client # [ 72.927351] nix-daemon[921]: accepted connection from pid 1004, user root (trusted)4555client # this derivation will be built:4556client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4557worker1 # [ 73.374346] nix-grpc-daemon[774]: ts=2026-09-20T08:08:39Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:358904558client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4559worker1 # [ 73.382407] nix-grpc-daemon[774]: ts=2026-09-20T08:08:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:358904560worker1 # [ 73.594142] nix-daemon[842]: accepted connection from pid 970, user nix-grpc-daemon (trusted)4561worker1 # [ 73.612121] nix-daemon[842]: reaped child process 973, status = succeeded4562lb # [ 73.578388] niks3-server[1118]: 2026/09/20 08:08:40 INFO Received uploads request method=POST path=/api/pending_closures4563worker1 # [ 73.636452] nix-grpc-daemon[884]: time=2026-09-20T08:08:40.181Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4564worker1 # [ 73.638385] nix-grpc-daemon[884]: time=2026-09-20T08:08:40.181Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4565lb # [ 73.609493] niks3-server[1118]: 2026/09/20 08:08:40 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4566worker1 # [ 73.670834] nix-grpc-daemon[884]: time=2026-09-20T08:08:40.216Z level=INFO msg="Uploading 1 narinfos"4567lb # [ 73.625188] niks3-server[1118]: 2026/09/20 08:08:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4568lb # [ 73.636428] niks3-server[1118]: 2026/09/20 08:08:40 INFO Signed narinfos id=15 count=14569lb # [ 73.641626] niks3-server[1118]: 2026/09/20 08:08:40 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4570lb # [ 73.649472] niks3-server[1118]: 2026/09/20 08:08:40 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4571lb # [ 73.654010] niks3-server[1118]: 2026/09/20 08:08:40 INFO Completed upload id=154572worker1 # [ 73.701463] nix-grpc-daemon[884]: time=2026-09-20T08:08:40.247Z level=INFO msg="Upload complete. (313ms)"4573lb # [ 73.656816] niks3-server[1118]: 2026/09/20 08:08:40 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4574worker1 # [ 73.725600] nix-grpc-daemon[774]: ts=2026-09-20T08:08:40Z level=debug event=want client=8 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04575worker1 # [ 73.733432] nix-grpc-daemon[774]: ts=2026-09-20T08:08:40Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14576worker1 # [ 73.772165] nix-grpc-daemon[774]: ts=2026-09-20T08:08:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:358904577worker1 # [ 73.788757] nix-grpc-daemon[774]: ts=2026-09-20T08:08:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:358904578client # copying 2 paths to 'lb:50051'...4579client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4580worker1 # [ 73.809645] nix-grpc-daemon[774]: ts=2026-09-20T08:08:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:358904581client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4582worker1 # [ 73.826666] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4583worker1 # [ 74.027341] nix-daemon[842]: accepted connection from pid 979, user nix-grpc-daemon (trusted)4584worker1 # [ 74.048800] nix-daemon[842]: reaped child process 982, status = succeeded4585worker1 # [ 74.223088] nix-daemon[842]: accepted connection from pid 984, user nix-grpc-daemon (trusted)4586worker1 # [ 74.240164] nix-daemon[842]: reaped child process 987, status = succeeded4587lb # [ 74.207864] niks3-server[1118]: 2026/09/20 08:08:40 INFO Received uploads request method=POST path=/api/pending_closures4588lb # [ 74.218032] niks3-server[1118]: 2026/09/20 08:08:40 INFO Received uploads request method=POST path=/api/pending_closures4589worker1 # [ 74.274647] nix-grpc-daemon[884]: time=2026-09-20T08:08:40.820Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4590worker1 # [ 74.276300] nix-grpc-daemon[884]: time=2026-09-20T08:08:40.820Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4591worker1 # [ 74.278028] nix-grpc-daemon[884]: time=2026-09-20T08:08:40.820Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4592lb # [ 74.245591] niks3-server[1118]: 2026/09/20 08:08:40 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4593lb # [ 74.263426] niks3-server[1118]: 2026/09/20 08:08:40 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4594lb # [ 74.277342] niks3-server[1118]: 2026/09/20 08:08:40 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4595lb # [ 74.284772] niks3-server[1118]: 2026/09/20 08:08:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4596lb # [ 74.291330] niks3-server[1118]: 2026/09/20 08:08:40 INFO Signed narinfos id=16 count=14597worker1 # [ 74.340219] nix-grpc-daemon[884]: time=2026-09-20T08:08:40.884Z level=INFO msg="Uploading 3 narinfos"4598lb # [ 74.295120] niks3-server[1118]: 2026/09/20 08:08:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4599lb # [ 74.300865] niks3-server[1118]: 2026/09/20 08:08:40 INFO Signed narinfos id=17 count=24600lb # [ 74.304750] niks3-server[1118]: 2026/09/20 08:08:40 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4601lb # [ 74.320133] niks3-server[1118]: 2026/09/20 08:08:40 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4602lb # [ 74.331315] niks3-server[1118]: 2026/09/20 08:08:40 INFO Completed upload id=164603lb # [ 74.334871] niks3-server[1118]: 2026/09/20 08:08:40 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4604lb # [ 74.339268] niks3-server[1118]: 2026/09/20 08:08:40 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4605lb # [ 74.344524] niks3-server[1118]: 2026/09/20 08:08:40 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4606lb # [ 74.347138] niks3-server[1118]: 2026/09/20 08:08:40 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4607lb # [ 74.350317] niks3-server[1118]: 2026/09/20 08:08:40 INFO Completed upload id=174608worker1 # [ 74.397887] nix-grpc-daemon[884]: time=2026-09-20T08:08:40.943Z level=INFO msg="Upload complete. (551ms)"4609worker1 # [ 74.409309] nix-grpc-daemon[774]: ts=2026-09-20T08:08:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35890 duration_s=0 paths=2 nar_bytes_in=9844610worker1 # [ 74.428596] nix-grpc-daemon[774]: ts=2026-09-20T08:08:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:358904611worker1 # [ 74.436934] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4612worker1 # [ 74.443136] nix-daemon[842]: reaped child process 977, status = succeeded4613client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4614worker1 # [ 74.457039] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4615client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4616worker1 # [ 75.906748] nix-daemon[842]: reaped child process 991, status = succeeded4617worker1 # [ 76.097149] nix-daemon[842]: accepted connection from pid 1006, user nix-grpc-daemon (trusted)4618worker1 # [ 76.115117] nix-daemon[842]: reaped child process 1009, status = succeeded4619lb # [ 76.081165] niks3-server[1118]: 2026/09/20 08:08:42 INFO Received uploads request method=POST path=/api/pending_closures4620worker1 # [ 76.138238] nix-grpc-daemon[884]: time=2026-09-20T08:08:42.684Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4621worker1 # [ 76.170348] nix-grpc-daemon[884]: time=2026-09-20T08:08:42.716Z level=INFO msg="Uploading 1 narinfos"4622lb # [ 76.113835] niks3-server[1118]: 2026/09/20 08:08:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4623lb # [ 76.128652] niks3-server[1118]: 2026/09/20 08:08:42 INFO Signed narinfos id=18 count=14624lb # [ 76.131817] niks3-server[1118]: 2026/09/20 08:08:42 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4625lb # [ 76.147888] niks3-server[1118]: 2026/09/20 08:08:42 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4626lb # [ 76.154408] niks3-server[1118]: 2026/09/20 08:08:42 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4627lb # [ 76.158506] niks3-server[1118]: 2026/09/20 08:08:42 INFO Completed upload id=184628worker1 # [ 76.205730] nix-grpc-daemon[884]: time=2026-09-20T08:08:42.751Z level=INFO msg="Upload complete. (332ms)"4629lb # [ 76.160996] niks3-server[1118]: 2026/09/20 08:08:42 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4630client # copying 1 paths...4631worker1 # [ 76.216955] nix-grpc-daemon[774]: ts=2026-09-20T08:08:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35890 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=8 outputs=14632client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4633worker1 # [ 76.233380] nix-grpc-daemon[774]: ts=2026-09-20T08:08:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:358904634worker1 # [ 76.237495] nix-daemon[842]: reaped child process 989, status = succeeded4635worker2 # [ 76.227777] nix-grpc-daemon[776]: ts=2026-09-20T08:08:42Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:422964636worker2 # [ 76.244595] nix-grpc-daemon[776]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4637worker2 # [ 76.266538] nix-grpc-daemon[776]: ts=2026-09-20T08:08:42Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=0 paths=1 nar_bytes_out=1204638client # [ 76.379278] nix-daemon[921]: reaped child process 1007, status = succeeded4639client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.69 seconds)4640client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24641client # [ 76.598115] nix-daemon[921]: accepted connection from pid 1026, user root (trusted)4642client # this derivation will be built:4643client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4644worker1 # [ 76.836172] nix-grpc-daemon[774]: ts=2026-09-20T08:08:43Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:358904645client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4646worker1 # [ 76.844093] nix-grpc-daemon[774]: ts=2026-09-20T08:08:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:358904647worker1 # [ 76.851142] nix-grpc-daemon[884]: time=2026-09-20T08:08:43.395Z level=INFO msg="All 1 paths already cached"4648worker1 # [ 76.864255] nix-grpc-daemon[774]: ts=2026-09-20T08:08:43Z level=debug event=want client=9 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04649worker2 # [ 76.840375] nix-grpc-daemon[776]: ts=2026-09-20T08:08:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:422964650worker1 # [ 76.870504] nix-grpc-daemon[774]: ts=2026-09-20T08:08:43Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14651worker2 # [ 76.857105] nix-grpc-daemon[776]: ts=2026-09-20T08:08:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:422964652client # copying 1 paths to 'lb:50051'...4653client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4654worker2 # [ 76.878412] nix-grpc-daemon[776]: ts=2026-09-20T08:08:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:422964655worker2 # [ 76.893804] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4656worker2 # [ 76.916848] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 1/5)4657worker2 # [ 76.988331] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 168 ms (attempt 2/5)4658worker2 # [ 77.156710] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 294 ms (attempt 3/5)4659worker2 # [ 77.459564] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 427 ms (attempt 4/5)4660worker2 # [ 77.894866] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4661worker2 # [ 77.904767] nix-grpc-daemon[776]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4662worker2 # [ 78.149522] nix-daemon[839]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4663worker2 # [ 78.169066] nix-daemon[839]: reaped child process 1113, status = succeeded4664worker2 # [ 78.342985] nix-daemon[839]: accepted connection from pid 1115, user nix-grpc-daemon (trusted)4665worker2 # [ 78.360310] nix-daemon[839]: reaped child process 1118, status = succeeded4666lb # [ 78.358324] niks3-server[1118]: 2026/09/20 08:08:44 INFO Received uploads request method=POST path=/api/pending_closures4667worker2 # [ 78.386054] nix-grpc-daemon[849]: time=2026-09-20T08:08:44.920Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4668worker2 # [ 78.387563] nix-grpc-daemon[849]: time=2026-09-20T08:08:44.920Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4669lb # [ 78.389137] niks3-server[1118]: 2026/09/20 08:08:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4670worker2 # [ 78.417752] nix-grpc-daemon[849]: time=2026-09-20T08:08:44.952Z level=INFO msg="Uploading 1 narinfos"4671lb # [ 78.404799] niks3-server[1118]: 2026/09/20 08:08:44 INFO Signed narinfos id=19 count=14672lb # [ 78.407734] niks3-server[1118]: 2026/09/20 08:08:44 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4673worker2 # [ 78.442227] nix-grpc-daemon[849]: time=2026-09-20T08:08:44.977Z level=INFO msg="Upload complete. (505ms)"4674lb # [ 78.423469] niks3-server[1118]: 2026/09/20 08:08:44 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4675lb # [ 78.428001] niks3-server[1118]: 2026/09/20 08:08:44 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4676worker2 # [ 78.448787] nix-grpc-daemon[776]: ts=2026-09-20T08:08:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=1 paths=1 nar_bytes_in=5684677lb # [ 78.433232] niks3-server[1118]: 2026/09/20 08:08:44 INFO Completed upload id=194678lb # [ 78.435579] niks3-server[1118]: 2026/09/20 08:08:44 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4679worker2 # [ 78.458167] nix-grpc-daemon[776]: ts=2026-09-20T08:08:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:422964680worker2 # [ 78.470006] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4681worker2 # [ 78.474407] nix-daemon[839]: reaped child process 1104, status = succeeded4682worker2 # [ 78.489916] nix-grpc-daemon[776]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4683worker2 # [ 78.505551] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4684client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4685client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4686worker2 # [ 80.155955] nix-daemon[839]: reaped child process 1123, status = succeeded4687worker2 # [ 80.334351] nix-daemon[839]: accepted connection from pid 1138, user nix-grpc-daemon (trusted)4688worker2 # [ 80.355742] nix-daemon[839]: reaped child process 1141, status = succeeded4689lb # [ 80.349460] niks3-server[1118]: 2026/09/20 08:08:46 INFO Received uploads request method=POST path=/api/pending_closures4690worker2 # [ 80.380471] nix-grpc-daemon[849]: time=2026-09-20T08:08:46.914Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4691lb # [ 80.376629] niks3-server[1118]: 2026/09/20 08:08:46 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4692lb # [ 80.391115] niks3-server[1118]: 2026/09/20 08:08:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4693worker2 # [ 80.417462] nix-grpc-daemon[849]: time=2026-09-20T08:08:46.952Z level=INFO msg="Uploading 1 narinfos"4694lb # [ 80.404000] niks3-server[1118]: 2026/09/20 08:08:46 INFO Signed narinfos id=20 count=14695lb # [ 80.411437] niks3-server[1118]: 2026/09/20 08:08:46 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4696lb # [ 80.422523] niks3-server[1118]: 2026/09/20 08:08:46 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4697lb # [ 80.428305] niks3-server[1118]: 2026/09/20 08:08:46 INFO Completed upload id=204698worker2 # [ 80.447846] nix-grpc-daemon[849]: time=2026-09-20T08:08:46.982Z level=INFO msg="Upload complete. (328ms)"4699lb # [ 80.431567] niks3-server[1118]: 2026/09/20 08:08:46 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4700worker2 # [ 80.457074] nix-grpc-daemon[776]: ts=2026-09-20T08:08:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=9 outputs=14701worker2 # [ 80.473707] nix-daemon[839]: reaped child process 1120, status = succeeded4702client # copying 1 paths...4703worker2 # [ 80.505191] nix-grpc-daemon[776]: ts=2026-09-20T08:08:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:422964704client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4705worker2 # [ 80.541854] nix-grpc-daemon[776]: ts=2026-09-20T08:08:47Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:422964706worker2 # [ 80.547174] nix-grpc-daemon[776]: ts=2026-09-20T08:08:47Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=0 paths=1 nar_bytes_out=1204707client # [ 80.656946] nix-daemon[921]: reaped child process 1029, status = succeeded4708client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 4.28 seconds)4709client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24710client # [ 80.881033] nix-daemon[921]: accepted connection from pid 1048, user root (trusted)4711client # this derivation will be built:4712client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4713worker2 # [ 81.097572] nix-grpc-daemon[776]: ts=2026-09-20T08:08:47Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:422964714client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4715lb # [ 81.082708] envoy[912]: conn peer=[2001:db8:1::1]:51820 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4330 tx=2242 ms=23504716worker1 # [ 81.130652] nix-grpc-daemon[774]: ts=2026-09-20T08:08:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:358904717lb # [ 81.087884] envoy[912]: conn peer=[2001:db8:1::1]:46540 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=406 ms=374718lb # [ 81.095041] envoy[912]: conn peer=[2001:db8:1::1]:46548 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3836 tx=1764 ms=29794719lb # [ 81.100251] envoy[912]: conn peer=[2001:db8:1::1]:46560 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1034720worker1 # [ 81.153905] nix-grpc-daemon[884]: time=2026-09-20T08:08:47.699Z level=INFO msg="All 1 paths already cached"4721lb # [ 81.106031] envoy[912]: conn peer=[2001:db8:1::1]:46576 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3710 tx=1806 ms=37914722lb # [ 81.111108] envoy[912]: conn peer=[2001:db8:1::1]:46582 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=654723worker1 # [ 81.177291] nix-grpc-daemon[774]: ts=2026-09-20T08:08:47Z level=debug event=want client=10 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04724worker1 # [ 81.184981] nix-grpc-daemon[774]: ts=2026-09-20T08:08:47Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14725worker1 # [ 81.194145] nix-grpc-daemon[774]: ts=2026-09-20T08:08:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:358904726worker1 # [ 81.205560] nix-grpc-daemon[774]: ts=2026-09-20T08:08:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:358904727worker1 # [ 81.219418] nix-grpc-daemon[884]: time=2026-09-20T08:08:47.765Z level=INFO msg="All 1 paths already cached"4728client # copying 1 paths to 'lb:50051'...4729client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4730worker1 # [ 81.230577] nix-grpc-daemon[774]: ts=2026-09-20T08:08:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:358904731worker1 # [ 81.245927] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4732worker1 # [ 81.448972] nix-daemon[842]: accepted connection from pid 1017, user nix-grpc-daemon (trusted)4733worker1 # [ 81.469681] nix-daemon[842]: reaped child process 1020, status = succeeded4734worker1 # [ 81.645501] nix-daemon[842]: accepted connection from pid 1022, user nix-grpc-daemon (trusted)4735worker1 # [ 81.664122] nix-daemon[842]: reaped child process 1025, status = succeeded4736lb # [ 81.632804] niks3-server[1118]: 2026/09/20 08:08:48 INFO Received uploads request method=POST path=/api/pending_closures4737worker1 # [ 81.694080] nix-grpc-daemon[884]: time=2026-09-20T08:08:48.239Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4738worker1 # [ 81.695611] nix-grpc-daemon[884]: time=2026-09-20T08:08:48.240Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4739lb # [ 81.666624] niks3-server[1118]: 2026/09/20 08:08:48 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4740lb # [ 81.680534] niks3-server[1118]: 2026/09/20 08:08:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4741worker1 # [ 81.736312] nix-grpc-daemon[884]: time=2026-09-20T08:08:48.282Z level=INFO msg="Uploading 1 narinfos"4742lb # [ 81.689022] niks3-server[1118]: 2026/09/20 08:08:48 INFO Signed narinfos id=21 count=14743lb # [ 81.697159] niks3-server[1118]: 2026/09/20 08:08:48 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4744lb # [ 81.708691] niks3-server[1118]: 2026/09/20 08:08:48 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4745lb # [ 81.715272] niks3-server[1118]: 2026/09/20 08:08:48 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4746lb # [ 81.720729] niks3-server[1118]: 2026/09/20 08:08:48 INFO Completed upload id=214747worker1 # [ 81.768096] nix-grpc-daemon[884]: time=2026-09-20T08:08:48.314Z level=INFO msg="Upload complete. (504ms)"4748worker1 # [ 81.776555] nix-grpc-daemon[774]: ts=2026-09-20T08:08:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35890 duration_s=0 paths=1 nar_bytes_in=5684749worker1 # [ 81.795197] nix-grpc-daemon[774]: ts=2026-09-20T08:08:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:358904750worker1 # [ 81.804713] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4751worker1 # [ 81.807971] nix-daemon[842]: reaped child process 1015, status = succeeded4752client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4753client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4754worker1 # [ 81.823359] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4755worker1 # [ 83.051663] nix-daemon[842]: reaped child process 1029, status = succeeded4756worker1 # [ 83.212665] nix-daemon[842]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)4757worker1 # [ 83.229114] nix-daemon[842]: reaped child process 1047, status = succeeded4758lb # [ 83.197503] niks3-server[1118]: 2026/09/20 08:08:49 INFO Received uploads request method=POST path=/api/pending_closures4759worker1 # [ 83.254542] nix-grpc-daemon[884]: time=2026-09-20T08:08:49.799Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4760lb # [ 83.227614] niks3-server[1118]: 2026/09/20 08:08:49 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4761worker1 # [ 83.283331] nix-grpc-daemon[884]: time=2026-09-20T08:08:49.829Z level=INFO msg="Uploading 1 narinfos"4762lb # [ 83.243005] niks3-server[1118]: 2026/09/20 08:08:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4763lb # [ 83.253121] niks3-server[1118]: 2026/09/20 08:08:49 INFO Signed narinfos id=22 count=14764worker1 # [ 83.308335] nix-grpc-daemon[884]: time=2026-09-20T08:08:49.854Z level=INFO msg="Upload complete. (273ms)"4765lb # [ 83.262828] niks3-server[1118]: 2026/09/20 08:08:49 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4766lb # [ 83.270232] niks3-server[1118]: 2026/09/20 08:08:49 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4767worker1 # [ 83.317837] nix-grpc-daemon[774]: ts=2026-09-20T08:08:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35890 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=10 outputs=14768lb # [ 83.275674] niks3-server[1118]: 2026/09/20 08:08:49 INFO Completed upload id=224769lb # [ 83.278616] niks3-server[1118]: 2026/09/20 08:08:49 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4770worker1 # [ 83.332156] nix-daemon[842]: reaped child process 1027, status = succeeded4771client # copying 1 paths...4772worker1 # [ 83.368515] nix-grpc-daemon[774]: ts=2026-09-20T08:08:49Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:358904773client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4774worker2 # [ 83.369740] nix-grpc-daemon[776]: ts=2026-09-20T08:08:49Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:422964775worker2 # [ 83.383624] nix-grpc-daemon[776]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4776worker2 # [ 83.399727] nix-grpc-daemon[776]: ts=2026-09-20T08:08:49Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42296 duration_s=0 paths=1 nar_bytes_out=1204777client # [ 83.513131] nix-daemon[921]: reaped child process 1051, status = succeeded4778client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.85 seconds)4779(finished: subtest: an input only one worker has still reaches the builder, in 11.77 seconds)4780subtest: upload whose reference the worker lacks is completed from the cache4781client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4782client # this derivation will be built:4783client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4784client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4785client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.46 seconds)4786client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4787client # this derivation will be built:4788client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4789client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4790client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.44 seconds)4791client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4792client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds)4793worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4794worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds)4795worker2 # [ 84.964483] systemd[1]: Stopping Nix worker-protocol over gRPC...4796worker2 # [ 85.536696] nix-grpc-daemon[776]: ts=2026-09-20T08:08:52Z level=info event=signal_exit4797worker1 # [ 87.016394] nix-grpc-daemon[774]: ts=2026-09-20T08:08:53Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:569324798worker1 # [ 87.016798] nix-grpc-daemon[774]: ts=2026-09-20T08:08:53Z level=info event=worker_gone addr=192.168.1.4:500514799worker2 # [ 86.999831] nix-grpc-daemon[776]: ts=2026-09-20T08:08:53Z level=info event=scheduler_restarting4800worker2 # [ 87.018536] nix-grpc-daemon[776]: ts=2026-09-20T08:08:53Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4801worker2 # [ 87.035834] nix-daemon[839]: reaped child process 841, status = succeeded4802worker2 # [ 87.279965] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4803worker2 # [ 87.283709] systemd[1]: Stopped Nix worker-protocol over gRPC.4804worker2 # [ 87.292902] systemd[1]: nix-grpc-daemon.service: Consumed 3.472s CPU time over 1min 6.162s wall clock time, 56.3M memory peak, 80.1K incoming IP traffic, 146.3K outgoing IP traffic.4805worker2 # [ 87.305412] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4806worker2 # [ 87.307609] systemd[1]: Closed Nix worker-protocol over gRPC.4807worker2 # [ 87.312887] systemd[1]: nix-grpc-daemon.socket: Consumed 717us CPU time over 1min 15.127s wall clock time, 256K memory peak, 110.2K incoming IP traffic, 90.3K outgoing IP traffic.4808lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4809lb: must succeed: curl -sf localhost:9901/clusters4810lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4811lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4812client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24813worker1 # [ 87.671350] nix-grpc-daemon[774]: ts=2026-09-20T08:08:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:358904814client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4815worker1 # [ 87.678977] nix-grpc-daemon[774]: ts=2026-09-20T08:08:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:358904816client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.27 seconds)4817worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4818worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4819worker2 # [ 87.781923] systemd[1]: Listening on Nix worker-protocol over gRPC.4820worker1 # [ 87.886609] systemd[1]: Stopping Nix worker-protocol over gRPC...4821worker1 # [ 88.537756] nix-grpc-daemon[774]: ts=2026-09-20T08:08:55Z level=info event=signal_exit4822worker2 # [ 88.700295] systemd[1]: Starting Nix worker-protocol over gRPC...4823worker2 # [ 88.917182] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4824worker2 # [ 88.920368] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14825worker2 # [ 88.928042] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4826worker2 # [ 88.929759] systemd[1]: Started Nix worker-protocol over gRPC.4827worker2 # [ 88.955562] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:55Z level=info event=scheduler_connected addr=lb:500514828worker2 # [ 88.959879] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4829worker1 # [ 89.001758] nix-grpc-daemon[774]: ts=2026-09-20T08:08:55Z level=info event=scheduler_yield4830worker1 # [ 89.006943] nix-grpc-daemon[774]: ts=2026-09-20T08:08:55Z level=info event=scheduler_restarting addr=lb:500514831lb # [ 88.962504] niks3-server[1118]: 2026/09/20 08:08:55 INFO lead: released remote=192.168.1.3:548764832worker1 # [ 89.013020] nix-grpc-daemon[774]: ts=2026-09-20T08:08:55Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:569324833worker1 # [ 89.017892] nix-grpc-daemon[774]: ts=2026-09-20T08:08:55Z level=info event=worker_gone addr=192.168.1.3:500514834worker2 # [ 89.161076] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:55Z level=info event=scheduler_connected addr=lb:500514835worker1 # [ 89.207563] nix-grpc-daemon[774]: ts=2026-09-20T08:08:55Z level=info event=scheduler_connected addr=lb:500514836worker2 # [ 89.179149] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4837worker1 # [ 89.214979] nix-grpc-daemon[774]: ts=2026-09-20T08:08:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4838worker2 # [ 89.380195] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:55Z level=info event=scheduler_connected addr=lb:500514839worker2 # [ 89.385427] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4840worker1 # [ 89.415829] nix-grpc-daemon[774]: ts=2026-09-20T08:08:55Z level=info event=scheduler_connected addr=lb:500514841worker1 # [ 89.420852] nix-grpc-daemon[774]: ts=2026-09-20T08:08:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4842worker2 # [ 89.586196] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:56Z level=info event=scheduler_connected addr=lb:500514843worker2 # [ 89.591457] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4844worker1 # [ 89.622660] nix-grpc-daemon[774]: ts=2026-09-20T08:08:56Z level=info event=scheduler_connected addr=lb:500514845worker1 # [ 89.627728] nix-grpc-daemon[774]: ts=2026-09-20T08:08:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4846worker2 # [ 89.792445] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:56Z level=info event=scheduler_connected addr=lb:500514847worker2 # [ 89.797699] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4848worker1 # [ 89.828487] nix-grpc-daemon[774]: ts=2026-09-20T08:08:56Z level=info event=scheduler_connected addr=lb:500514849worker1 # [ 89.833703] nix-grpc-daemon[774]: ts=2026-09-20T08:08:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4850worker1 # [ 90.007545] nix-grpc-daemon[774]: ts=2026-09-20T08:08:56Z level=info event=scheduler_restarting4851worker2 # [ 89.999643] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:56Z level=info event=scheduler_connected addr=lb:500514852worker1 # [ 90.027438] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4853worker1 # [ 90.056463] nix-grpc-daemon[774]: E0000 00:00:1789891736.573275 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true4854worker1 # [ 90.068301] nix-grpc-daemon[774]: ts=2026-09-20T08:08:56Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4855worker1 # [ 90.073656] nix-daemon[842]: reaped child process 844, status = succeeded4856worker1 # [ 90.715259] nix-grpc-daemon[774]: E0000 00:00:1789891737.260178 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4857lb # [ 91.084867] envoy[912]: conn peer=[2001:db8:1::1]:40860 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3698 tx=1801 ms=23594858worker2 # [ 91.150806] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:57Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4859worker1 # [ 90.722541] nix-grpc-daemon[774]: E0000 00:00:1789891737.268627 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4860worker1 # [ 91.195603] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4861worker1 # [ 91.216391] systemd[1]: Stopped Nix worker-protocol over gRPC.4862worker1 # [ 91.218795] systemd[1]: nix-grpc-daemon.service: Consumed 2.264s CPU time over 1min 10.056s wall clock time, 52M memory peak, 69.2K incoming IP traffic, 119.1K outgoing IP traffic.4863worker1 # [ 91.231591] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4864worker1 # [ 91.235496] systemd[1]: Closed Nix worker-protocol over gRPC.4865worker1 # [ 91.238096] systemd[1]: nix-grpc-daemon.socket: Consumed 621us CPU time over 1min 19.023s wall clock time, 256K memory peak, 121.7K incoming IP traffic, 103.9K outgoing IP traffic.4866lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4867lb: must succeed: curl -sf localhost:9901/clusters4868lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4869lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4870client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24871worker2 # [ 91.350816] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:57Z level=info event=scheduler_connected addr=lb:500514872worker2 # [ 91.358063] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4873worker2 # [ 91.558974] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:58Z level=info event=scheduler_connected addr=lb:500514874worker2 # [ 91.569496] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:58Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4875worker2 # [ 91.592150] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:332344876worker2 # [ 91.603189] nix-daemon[839]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)4877worker2 # [ 91.612817] nix-grpc-daemon[1163]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 1/5)4878worker2 # [ 91.631080] nix-grpc-daemon[1163]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 2/5)4879worker2 # [ 91.671786] nix-grpc-daemon[1163]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 3/5)4880lb # [ 91.090036] envoy[912]: conn peer=[2001:db8:1::1]:40870 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=914881lb # [ 91.090176] envoy[912]: conn peer=192.168.1.4:39224 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=13613 tx=3790 ms=646524882lb # [ 91.090302] envoy[912]: conn peer=[2001:db8:1::1]:40882 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=224883worker2 # [ 91.722462] nix-grpc-daemon[1163]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 4/5)4884lb # [ 91.090417] envoy[912]: conn peer=192.168.1.3:35036 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=14076 tx=3695 ms=674034885worker2 # [ 91.732899] nix-grpc-daemon[1163]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4886client # copying 2 paths...4887client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4888worker2 # [ 91.757775] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:332344889client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4890worker2 # [ 91.765344] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:58Z level=info event=scheduler_connected addr=lb:500514891worker2 # [ 91.775072] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4892worker2 # [ 91.795455] nix-daemon[839]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)4893worker2 # [ 91.815442] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:58Z level=info event=niks3_push_started pid=12194894worker2 # [ 91.972686] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:58Z level=info event=scheduler_connected addr=lb:500514895worker2 # [ 91.975582] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:58Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4896worker2 # [ 92.180201] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:58Z level=info event=scheduler_connected addr=lb:500514897worker2 # [ 92.181667] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4898worker2 # [ 92.226370] nix-daemon[839]: accepted connection from pid 1232, user nix-grpc-daemon (trusted)4899worker2 # [ 92.245404] nix-daemon[839]: reaped child process 1235, status = succeeded4900lb # [ 92.238002] niks3-server[1118]: 2026/09/20 08:08:58 INFO Received uploads request method=POST path=/api/pending_closures4901lb # [ 92.248614] niks3-server[1118]: 2026/09/20 08:08:58 INFO Received uploads request method=POST path=/api/pending_closures4902worker2 # [ 92.279350] nix-grpc-daemon[1219]: time=2026-09-20T08:08:58.811Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4903worker2 # [ 92.282247] nix-grpc-daemon[1219]: time=2026-09-20T08:08:58.811Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4904worker2 # [ 92.284167] nix-grpc-daemon[1219]: time=2026-09-20T08:08:58.812Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4905lb # [ 92.313125] niks3-server[1118]: 2026/09/20 08:08:58 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4906lb # [ 92.324382] niks3-server[1118]: 2026/09/20 08:08:58 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4907lb # [ 92.327686] niks3-server[1118]: 2026/09/20 08:08:58 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4908lb # [ 92.332807] niks3-server[1118]: 2026/09/20 08:08:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4909lb # [ 92.339260] niks3-server[1118]: 2026/09/20 08:08:58 INFO Signed narinfos id=23 count=14910worker2 # [ 92.360123] nix-grpc-daemon[1219]: time=2026-09-20T08:08:58.893Z level=INFO msg="Uploading 3 narinfos"4911lb # [ 92.341385] niks3-server[1118]: 2026/09/20 08:08:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4912lb # [ 92.343898] niks3-server[1118]: 2026/09/20 08:08:58 INFO Signed narinfos id=24 count=24913lb # [ 92.350756] niks3-server[1118]: 2026/09/20 08:08:58 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4914worker2 # [ 92.379956] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:58Z level=info event=scheduler_connected addr=lb:500514915lb # [ 92.365878] niks3-server[1118]: 2026/09/20 08:08:58 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4916worker2 # [ 92.385377] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:58Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4917lb # [ 92.372902] niks3-server[1118]: 2026/09/20 08:08:58 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4918lb # [ 92.378976] niks3-server[1118]: 2026/09/20 08:08:58 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4919lb # [ 92.382669] niks3-server[1118]: 2026/09/20 08:08:58 INFO Completed upload id=234920lb # [ 92.386450] niks3-server[1118]: 2026/09/20 08:08:58 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4921lb # [ 92.389305] niks3-server[1118]: 2026/09/20 08:08:58 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4922lb # [ 92.392201] niks3-server[1118]: 2026/09/20 08:08:58 INFO Completed upload id=244923worker2 # [ 92.412618] nix-grpc-daemon[1219]: time=2026-09-20T08:08:58.947Z level=INFO msg="Upload complete. (364ms)"4924worker2 # [ 92.424456] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33234 duration_s=0 paths=2 nar_bytes_in=3124925worker2 # [ 92.439631] nix-daemon[839]: reaped child process 1217, status = succeeded4926client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.16 seconds)4927worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4928worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)4929worker2 # [ 92.586044] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:59Z level=info event=scheduler_connected addr=lb:500514930worker1 # [ 92.617102] systemd[1]: Listening on Nix worker-protocol over gRPC.4931worker2 # [ 92.592722] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4932worker1 # [ 92.624716] systemd[1]: Starting Nix worker-protocol over gRPC...4933worker2 # [ 92.793721] nix-grpc-daemon[1163]: ts=2026-09-20T08:08:59Z level=info event=scheduler_connected addr=lb:500514934worker1 # [ 92.827573] nix-grpc-daemon[1070]: ts=2026-09-20T08:08:59Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4935worker1 # [ 92.829990] nix-grpc-daemon[1070]: ts=2026-09-20T08:08:59Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14936worker1 # [ 92.837087] nix-grpc-daemon[1070]: ts=2026-09-20T08:08:59Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4937worker1 # [ 92.845652] systemd[1]: Started Nix worker-protocol over gRPC.4938worker1 # [ 92.852366] nix-grpc-daemon[1070]: ts=2026-09-20T08:08:59Z level=info event=scheduler_take_over4939lb # [ 92.803425] niks3-server[1118]: 2026/09/20 08:08:59 INFO lead: acquired remote=192.168.1.3:583404940worker1 # [ 92.853694] nix-grpc-daemon[1070]: ts=2026-09-20T08:08:59Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04941lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4942lb: must succeed: curl -sf localhost:9901/clusters4943worker1 # [ 92.865033] nix-grpc-daemon[1070]: ts=2026-09-20T08:08:59Z level=info event=scheduler_connected addr=lb:500514944worker1 # [ 92.868606] nix-grpc-daemon[1070]: ts=2026-09-20T08:08:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4945lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4946worker1 # [ 93.069716] nix-grpc-daemon[1070]: ts=2026-09-20T08:08:59Z level=info event=scheduler_connected addr=lb:500514947worker1 # [ 93.075695] nix-grpc-daemon[1070]: ts=2026-09-20T08:08:59Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04948lb: must succeed: curl -sf localhost:9901/clusters4949lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4950lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.19 seconds)4951(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.48 seconds)4952subtest: scheduler down: the other node takes the lock and keeps it4953lb: must succeed: curl -sf localhost:9901/clusters4954lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4955lb: must succeed: curl -sf localhost:9901/clusters4956lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4957lb: must succeed: curl -sf localhost:9901/clusters4958lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4959lb: must succeed: curl -sf localhost:9901/clusters4960lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4961worker1 # [ 94.318108] systemd[1]: Stopping Nix worker-protocol over gRPC...4962worker1 # [ 94.845141] nix-grpc-daemon[1070]: ts=2026-09-20T08:09:01Z level=info event=signal_exit4963worker1 # [ 95.053039] nix-grpc-daemon[1070]: ts=2026-09-20T08:09:01Z level=info event=scheduler_yield4964lb # [ 95.009325] niks3-server[1118]: 2026/09/20 08:09:01 INFO lead: released remote=192.168.1.3:583404965worker1 # [ 95.058749] nix-grpc-daemon[1070]: ts=2026-09-20T08:09:01Z level=info event=scheduler_restarting addr=lb:500514966worker1 # [ 95.064849] nix-grpc-daemon[1070]: ts=2026-09-20T08:09:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:528244967worker2 # [ 95.039141] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:01Z level=info event=scheduler_restarting addr=lb:500514968worker1 # [ 95.069417] nix-grpc-daemon[1070]: ts=2026-09-20T08:09:01Z level=info event=worker_gone addr=192.168.1.3:500514969worker1 # [ 95.074333] nix-grpc-daemon[1070]: ts=2026-09-20T08:09:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:528244970worker1 # [ 95.078849] nix-grpc-daemon[1070]: ts=2026-09-20T08:09:01Z level=info event=worker_gone addr=192.168.1.4:500514971worker1 # [ 95.259682] nix-grpc-daemon[1070]: ts=2026-09-20T08:09:01Z level=info event=scheduler_connected addr=lb:500514972worker2 # [ 95.238917] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:01Z level=info event=scheduler_connected addr=lb:500514973worker1 # [ 95.265181] nix-grpc-daemon[1070]: ts=2026-09-20T08:09:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4974worker2 # [ 95.249847] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4975worker1 # [ 95.465773] nix-grpc-daemon[1070]: ts=2026-09-20T08:09:02Z level=info event=scheduler_connected addr=lb:500514976worker1 # [ 95.471203] nix-grpc-daemon[1070]: ts=2026-09-20T08:09:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4977worker2 # [ 95.450836] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:01Z level=info event=scheduler_connected addr=lb:500514978worker2 # [ 95.456207] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4979worker1 # [ 95.671944] nix-grpc-daemon[1070]: ts=2026-09-20T08:09:02Z level=info event=scheduler_connected addr=lb:500514980worker1 # [ 95.677258] nix-grpc-daemon[1070]: ts=2026-09-20T08:09:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4981worker2 # [ 95.656809] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:02Z level=info event=scheduler_connected addr=lb:500514982worker2 # [ 95.662015] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4983worker1 # [ 95.879440] nix-grpc-daemon[1070]: ts=2026-09-20T08:09:02Z level=info event=scheduler_connected addr=lb:500514984worker1 # [ 95.884945] nix-grpc-daemon[1070]: ts=2026-09-20T08:09:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4985worker2 # [ 95.862553] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:02Z level=info event=scheduler_connected addr=lb:500514986worker2 # [ 95.867848] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4987worker1 # [ 96.060167] nix-grpc-daemon[1070]: ts=2026-09-20T08:09:02Z level=info event=scheduler_restarting4988worker2 # [ 96.071141] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:02Z level=info event=scheduler_connected addr=lb:500514989worker2 # [ 96.075381] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4990worker1 # [ 96.189960] nix-grpc-daemon[1070]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4991worker1 # [ 96.195388] nix-grpc-daemon[1070]: E0000 00:00:1789891742.735899 1113 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4992worker1 # [ 96.202033] nix-grpc-daemon[1070]: E0000 00:00:1789891742.741275 1113 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4993worker2 # [ 96.272122] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:02Z level=info event=scheduler_connected addr=lb:500514994worker1 # [ 96.301124] nix-grpc-daemon[1070]: E0000 00:00:1789891742.847176 1113 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true4995worker2 # [ 96.823096] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:03Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4996worker1 # [ 96.871502] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4997worker1 # [ 96.881880] systemd[1]: Stopped Nix worker-protocol over gRPC.4998worker1 # [ 96.887725] systemd[1]: nix-grpc-daemon.service: Consumed 187ms CPU time over 4.246s wall clock time, 10.8M memory peak, 7.4K incoming IP traffic, 7.5K outgoing IP traffic.4999worker1 # [ 96.901388] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5000worker1 # [ 96.904827] systemd[1]: Closed Nix worker-protocol over gRPC.5001worker1 # [ 96.908295] systemd[1]: nix-grpc-daemon.socket: Consumed 964us CPU time over 4.297s wall clock time, 256K memory peak, 18.2K incoming IP traffic, 13K outgoing IP traffic.5002worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5003worker2 # [ 97.024132] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:03Z level=info event=scheduler_connected addr=lb:500515004worker2 # [ 97.031417] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5005worker2 # [ 97.233699] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:03Z level=info event=scheduler_connected addr=lb:500515006worker2 # [ 97.238852] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:03Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5007worker2 # [ 97.439728] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:03Z level=info event=scheduler_connected addr=lb:500515008worker2 # [ 97.446580] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5009worker2 # [ 97.647702] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:04Z level=info event=scheduler_connected addr=lb:500515010worker2 # [ 97.653380] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:04Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5011worker2 # [ 97.854078] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:04Z level=info event=scheduler_connected addr=lb:500515012worker2 # [ 97.861356] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5013worker2 # [ 98.062417] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:04Z level=info event=scheduler_connected addr=lb:500515014worker2 # [ 98.066960] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:04Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5015worker2 # [ 98.270205] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:04Z level=info event=scheduler_connected addr=lb:500515016worker2 # [ 98.275686] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5017worker2 # [ 98.476687] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:05Z level=info event=scheduler_connected addr=lb:500515018worker2 # [ 98.482153] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:05Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5019worker2 # [ 98.682993] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:05Z level=info event=scheduler_connected addr=lb:500515020worker2 # [ 98.690120] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5021worker2 # [ 98.891305] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:05Z level=info event=scheduler_connected addr=lb:500515022worker2 # [ 98.897061] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:05Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5023worker2 # [ 98.941883] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:05Z level=info event=scheduler_take_over5024lb # [ 98.922593] niks3-server[1118]: 2026/09/20 08:09:05 INFO lead: acquired remote=192.168.1.4:458205025worker2 # [ 99.097917] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:05Z level=info event=scheduler_connected addr=lb:500515026worker2 # [ 99.103921] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:05Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05027worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 2.27 seconds)5028worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5029worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)5030client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&25031worker2 # [ 99.471918] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:332345032client # don't know how to build these paths:5033client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5034worker2 # [ 99.491996] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:06Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=05035worker2 # [ 99.498607] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:06Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=15036worker2 # [ 99.537425] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:332345037worker2 # [ 99.558237] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:332345038client # copying 1 paths to 'lb:50051'...5039worker2 # [ 99.578818] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:332345040client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...5041worker2 # [ 99.601215] nix-daemon[839]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)5042worker2 # [ 99.847638] nix-daemon[839]: accepted connection from pid 1267, user nix-grpc-daemon (trusted)5043worker2 # [ 99.869783] nix-daemon[839]: reaped child process 1270, status = succeeded5044worker2 # [ 100.073059] nix-daemon[839]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)5045worker2 # [ 100.093615] nix-daemon[839]: reaped child process 1275, status = succeeded5046lb # [ 100.089913] niks3-server[1118]: 2026/09/20 08:09:06 INFO Received uploads request method=POST path=/api/pending_closures5047worker2 # [ 100.127226] nix-grpc-daemon[1219]: time=2026-09-20T08:09:06.661Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5048worker2 # [ 100.128883] nix-grpc-daemon[1219]: time=2026-09-20T08:09:06.661Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"5049lb # [ 100.145556] niks3-server[1118]: 2026/09/20 08:09:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5050lb # [ 100.174503] niks3-server[1118]: 2026/09/20 08:09:06 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst5051lb # [ 100.204888] niks3-server[1118]: 2026/09/20 08:09:06 INFO Signed narinfos id=25 count=15052worker2 # [ 100.225934] nix-grpc-daemon[1219]: time=2026-09-20T08:09:06.760Z level=INFO msg="Uploading 1 narinfos"5053lb # [ 100.227641] niks3-server[1118]: 2026/09/20 08:09:06 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5054lb # [ 100.238945] niks3-server[1118]: 2026/09/20 08:09:06 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls5055lb # [ 100.244699] niks3-server[1118]: 2026/09/20 08:09:06 INFO Completed upload id=255056worker2 # [ 100.265064] nix-grpc-daemon[1219]: time=2026-09-20T08:09:06.799Z level=INFO msg="Upload complete. (640ms)"5057lb # [ 100.247831] niks3-server[1118]: 2026/09/20 08:09:06 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo5058worker2 # [ 100.277911] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33234 duration_s=0 paths=1 nar_bytes_in=5205059worker2 # [ 100.293389] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:332345060worker2 # [ 100.313285] nix-daemon[839]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)5061worker2 # [ 100.328336] nix-daemon[839]: reaped child process 1265, status = succeeded5062client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5063client # farm-a> worker2: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5064worker2 # [ 100.347465] nix-daemon[839]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)5065lb # [ 101.086255] envoy[912]: conn peer=[2001:db8:1::1]:40208 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1006 tx=282 ms=8785066lb # [ 101.091471] envoy[912]: conn peer=[2001:db8:1::3]:41822 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1163 tx=413 ms=32305067client # farm-a> LOG-farm-a-on-standby5068worker2 # [ 102.009004] nix-daemon[839]: reaped child process 1279, status = succeeded5069worker2 # [ 102.219159] nix-daemon[839]: accepted connection from pid 1294, user nix-grpc-daemon (trusted)5070worker2 # [ 102.244907] nix-daemon[839]: reaped child process 1297, status = succeeded5071lb # [ 102.237812] niks3-server[1118]: 2026/09/20 08:09:08 INFO Received uploads request method=POST path=/api/pending_closures5072worker2 # [ 102.270070] nix-grpc-daemon[1219]: time=2026-09-20T08:09:08.804Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5073worker2 # [ 102.274376] nix-grpc-daemon[1219]: time=2026-09-20T08:09:08.806Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5074lb # [ 102.291943] niks3-server[1118]: 2026/09/20 08:09:08 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5075lb # [ 102.302746] niks3-server[1118]: 2026/09/20 08:09:08 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5076lb # [ 102.312929] niks3-server[1118]: 2026/09/20 08:09:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5077worker2 # [ 102.338623] nix-grpc-daemon[1219]: time=2026-09-20T08:09:08.871Z level=INFO msg="Uploading 1 narinfos"5078lb # [ 102.320483] niks3-server[1118]: 2026/09/20 08:09:08 INFO Signed narinfos id=26 count=15079lb # [ 102.325725] niks3-server[1118]: 2026/09/20 08:09:08 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5080lb # [ 102.336151] niks3-server[1118]: 2026/09/20 08:09:08 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5081lb # [ 102.344605] niks3-server[1118]: 2026/09/20 08:09:08 INFO Completed upload id=265082worker2 # [ 102.363344] nix-grpc-daemon[1219]: time=2026-09-20T08:09:08.898Z level=INFO msg="Upload complete. (397ms)"5083lb # [ 102.347705] niks3-server[1118]: 2026/09/20 08:09:08 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5084worker2 # [ 102.396713] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33234 duration_s=2 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15085worker2 # [ 102.404402] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:08Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05086worker2 # [ 102.407679] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:08Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=15087worker2 # [ 102.416646] nix-daemon[839]: reaped child process 1277, status = succeeded5088worker2 # [ 102.440993] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:332345089worker2 # [ 102.460839] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:332345090worker2 # [ 102.480432] nix-grpc-daemon[1219]: time=2026-09-20T08:09:09.015Z level=INFO msg="All 1 paths already cached"5091client # copying 1 paths to 'lb:50051'...5092client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5093worker2 # [ 102.493263] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:332345094worker2 # [ 102.511674] nix-daemon[839]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)5095worker2 # [ 102.744116] nix-daemon[839]: accepted connection from pid 1303, user nix-grpc-daemon (trusted)5096worker2 # [ 102.766058] nix-daemon[839]: reaped child process 1306, status = succeeded5097worker2 # [ 102.969289] nix-daemon[839]: accepted connection from pid 1308, user nix-grpc-daemon (trusted)5098worker2 # [ 102.990220] nix-daemon[839]: reaped child process 1311, status = succeeded5099lb # [ 102.982336] niks3-server[1118]: 2026/09/20 08:09:09 INFO Received uploads request method=POST path=/api/pending_closures5100worker2 # [ 103.013995] nix-grpc-daemon[1219]: time=2026-09-20T08:09:09.548Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5101worker2 # [ 103.015557] nix-grpc-daemon[1219]: time=2026-09-20T08:09:09.548Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5102lb # [ 103.022730] niks3-server[1118]: 2026/09/20 08:09:09 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5103lb # [ 103.041519] niks3-server[1118]: 2026/09/20 08:09:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5104worker2 # [ 103.069891] nix-grpc-daemon[1219]: time=2026-09-20T08:09:09.604Z level=INFO msg="Uploading 1 narinfos"5105lb # [ 103.055534] niks3-server[1118]: 2026/09/20 08:09:09 INFO Signed narinfos id=27 count=15106lb # [ 103.076157] niks3-server[1118]: 2026/09/20 08:09:09 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5107lb # [ 103.087252] niks3-server[1118]: 2026/09/20 08:09:09 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5108lb # [ 103.091532] niks3-server[1118]: 2026/09/20 08:09:09 INFO Completed upload id=275109worker2 # [ 103.111854] nix-grpc-daemon[1219]: time=2026-09-20T08:09:09.646Z level=INFO msg="Upload complete. (578ms)"5110lb # [ 103.094911] niks3-server[1118]: 2026/09/20 08:09:09 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5111worker2 # [ 103.123811] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33234 duration_s=0 paths=1 nar_bytes_in=6405112worker2 # [ 103.138772] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:332345113worker2 # [ 103.154340] nix-daemon[839]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)5114worker2 # [ 103.161102] nix-daemon[839]: reaped child process 1301, status = succeeded5115client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5116client # farm-b> worker2: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5117worker2 # [ 103.176131] nix-daemon[839]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)5118client # farm-b> LOG-farm-b-on-standby5119worker2 # [ 104.835724] nix-daemon[839]: reaped child process 1315, status = succeeded5120worker2 # [ 105.064133] nix-daemon[839]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)5121worker2 # [ 105.083899] nix-daemon[839]: reaped child process 1333, status = succeeded5122lb # [ 105.078203] niks3-server[1118]: 2026/09/20 08:09:11 INFO Received uploads request method=POST path=/api/pending_closures5123worker2 # [ 105.121372] nix-grpc-daemon[1219]: time=2026-09-20T08:09:11.654Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5124worker2 # [ 105.123058] nix-grpc-daemon[1219]: time=2026-09-20T08:09:11.655Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5125lb # [ 105.146169] niks3-server[1118]: 2026/09/20 08:09:11 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5126lb # [ 105.158958] niks3-server[1118]: 2026/09/20 08:09:11 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5127worker2 # [ 105.191682] nix-grpc-daemon[1219]: time=2026-09-20T08:09:11.725Z level=INFO msg="Uploading 1 narinfos"5128lb # [ 105.172677] niks3-server[1118]: 2026/09/20 08:09:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5129lb # [ 105.182483] niks3-server[1118]: 2026/09/20 08:09:11 INFO Signed narinfos id=28 count=15130lb # [ 105.187821] niks3-server[1118]: 2026/09/20 08:09:11 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5131lb # [ 105.197668] niks3-server[1118]: 2026/09/20 08:09:11 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5132lb # [ 105.213059] niks3-server[1118]: 2026/09/20 08:09:11 INFO Completed upload id=285133worker2 # [ 105.233367] nix-grpc-daemon[1219]: time=2026-09-20T08:09:11.768Z level=INFO msg="Upload complete. (443ms)"5134lb # [ 105.216155] niks3-server[1118]: 2026/09/20 08:09:11 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5135worker2 # [ 105.257059] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33234 duration_s=2 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15136worker2 # [ 105.276708] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:11Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05137worker2 # [ 105.281306] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:11Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=15138worker2 # [ 105.286361] nix-daemon[839]: reaped child process 1313, status = succeeded5139worker2 # [ 105.298262] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:332345140worker2 # [ 105.321322] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:332345141worker2 # [ 105.341590] nix-grpc-daemon[1219]: time=2026-09-20T08:09:11.876Z level=INFO msg="All 2 paths already cached"5142client # copying 1 paths to 'lb:50051'...5143client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5144worker2 # [ 105.354109] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:332345145worker2 # [ 105.373118] nix-daemon[839]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)5146worker2 # [ 105.612832] nix-daemon[839]: accepted connection from pid 1339, user nix-grpc-daemon (trusted)5147worker2 # [ 105.636400] nix-daemon[839]: reaped child process 1342, status = succeeded5148worker2 # [ 105.842001] nix-daemon[839]: accepted connection from pid 1344, user nix-grpc-daemon (trusted)5149worker2 # [ 105.865758] nix-daemon[839]: reaped child process 1347, status = succeeded5150lb # [ 105.858061] niks3-server[1118]: 2026/09/20 08:09:12 INFO Received uploads request method=POST path=/api/pending_closures5151worker2 # [ 105.890967] nix-grpc-daemon[1219]: time=2026-09-20T08:09:12.425Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5152worker2 # [ 105.892632] nix-grpc-daemon[1219]: time=2026-09-20T08:09:12.425Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5153lb # [ 105.898467] niks3-server[1118]: 2026/09/20 08:09:12 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5154worker2 # [ 105.939802] nix-grpc-daemon[1219]: time=2026-09-20T08:09:12.474Z level=INFO msg="Uploading 1 narinfos"5155lb # [ 105.913946] niks3-server[1118]: 2026/09/20 08:09:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5156lb # [ 105.924868] niks3-server[1118]: 2026/09/20 08:09:12 INFO Signed narinfos id=29 count=15157lb # [ 105.927048] niks3-server[1118]: 2026/09/20 08:09:12 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5158lb # [ 105.936936] niks3-server[1118]: 2026/09/20 08:09:12 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5159lb # [ 105.945464] niks3-server[1118]: 2026/09/20 08:09:12 INFO Completed upload id=295160worker2 # [ 105.964920] nix-grpc-daemon[1219]: time=2026-09-20T08:09:12.499Z level=INFO msg="Upload complete. (570ms)"5161lb # [ 105.947584] niks3-server[1118]: 2026/09/20 08:09:12 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5162worker2 # [ 105.975740] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33234 duration_s=0 paths=1 nar_bytes_in=7685163worker2 # [ 105.994117] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:332345164worker2 # [ 106.002417] nix-daemon[839]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)5165worker2 # [ 106.007724] nix-daemon[839]: reaped child process 1337, status = succeeded5166client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5167worker2 # [ 106.022676] nix-daemon[839]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)5168client # farm-top> worker2: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5169worker2 # [ 107.049756] nix-daemon[839]: reaped child process 1351, status = succeeded5170client # farm-top> LOG-farm-top-on-standby5171worker2 # [ 107.232290] nix-daemon[839]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5172worker2 # [ 107.251412] nix-daemon[839]: reaped child process 1369, status = succeeded5173lb # [ 107.250310] niks3-server[1118]: 2026/09/20 08:09:13 INFO Received uploads request method=POST path=/api/pending_closures5174worker2 # [ 107.286154] nix-grpc-daemon[1219]: time=2026-09-20T08:09:13.818Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5175worker2 # [ 107.287692] nix-grpc-daemon[1219]: time=2026-09-20T08:09:13.818Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5176lb # [ 107.300365] niks3-server[1118]: 2026/09/20 08:09:13 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5177lb # [ 107.322918] niks3-server[1118]: 2026/09/20 08:09:13 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5178worker2 # [ 107.352519] nix-grpc-daemon[1219]: time=2026-09-20T08:09:13.886Z level=INFO msg="Uploading 1 narinfos"5179lb # [ 107.334969] niks3-server[1118]: 2026/09/20 08:09:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5180lb # [ 107.339627] niks3-server[1118]: 2026/09/20 08:09:13 INFO Signed narinfos id=30 count=15181lb # [ 107.344677] niks3-server[1118]: 2026/09/20 08:09:13 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5182lb # [ 107.357194] niks3-server[1118]: 2026/09/20 08:09:13 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5183lb # [ 107.369221] niks3-server[1118]: 2026/09/20 08:09:13 INFO Completed upload id=305184worker2 # [ 107.389266] nix-grpc-daemon[1219]: time=2026-09-20T08:09:13.924Z level=INFO msg="Upload complete. (352ms)"5185lb # [ 107.371865] niks3-server[1118]: 2026/09/20 08:09:13 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5186worker2 # [ 107.405585] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33234 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15187worker2 # [ 107.426504] nix-daemon[839]: reaped child process 1349, status = succeeded5188client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&2, in 8.25 seconds)5189client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath5190client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath, in 0.29 seconds)5191worker1 # [ 107.897356] systemd[1]: Listening on Nix worker-protocol over gRPC.5192worker1 # [ 107.904826] systemd[1]: Starting Nix worker-protocol over gRPC...5193worker1 # [ 108.125302] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5194worker1 # [ 108.128357] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15195worker1 # [ 108.137560] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5196worker1 # [ 108.139343] systemd[1]: Started Nix worker-protocol over gRPC.5197lb: must succeed: curl -sf localhost:9901/clusters5198worker1 # [ 108.170642] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:14Z level=info event=scheduler_connected addr=lb:500515199worker2 # [ 108.147619] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05200lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)5201worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5202worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.11 seconds)5203lb: must succeed: curl -sf localhost:9901/clusters5204lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5205lb: must succeed: curl -sf localhost:9901/clusters5206lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5207worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5208worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)5209(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.61 seconds)5210subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5211client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5212client # [ 108.693362] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5213client # Running as unit: rs.service; invocation ID: ea97174bddc846ef9cc743028170d12e5214client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.11 seconds)5215worker2 # [ 108.974500] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:332345216client # [ 108.968673] nix[1151]: don't know how to build these paths:5217client # [ 108.969611] nix[1151]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5218worker2 # [ 108.999736] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:15Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05219worker2 # [ 109.008785] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:15Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=15220worker2 # [ 109.046430] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:332345221worker2 # [ 109.066798] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:332345222client # [ 109.068333] nix[1151]: copying 1 paths to 'lb:50051'...5223worker2 # [ 109.084130] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:332345224client # [ 109.073592] nix[1151]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5225worker2 # [ 109.108838] nix-daemon[839]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)5226worker2 # [ 109.355087] nix-daemon[839]: accepted connection from pid 1384, user nix-grpc-daemon (trusted)5227worker2 # [ 109.375256] nix-daemon[839]: reaped child process 1387, status = succeeded5228worker2 # [ 109.570464] nix-daemon[839]: accepted connection from pid 1389, user nix-grpc-daemon (trusted)5229worker2 # [ 109.593266] nix-daemon[839]: reaped child process 1392, status = succeeded5230lb # [ 109.586753] niks3-server[1118]: 2026/09/20 08:09:16 INFO Received uploads request method=POST path=/api/pending_closures5231worker2 # [ 109.620675] nix-grpc-daemon[1219]: time=2026-09-20T08:09:16.154Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5232worker2 # [ 109.622205] nix-grpc-daemon[1219]: time=2026-09-20T08:09:16.154Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5233lb # [ 109.627397] niks3-server[1118]: 2026/09/20 08:09:16 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5234lb # [ 109.645577] niks3-server[1118]: 2026/09/20 08:09:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5235worker2 # [ 109.672540] nix-grpc-daemon[1219]: time=2026-09-20T08:09:16.206Z level=INFO msg="Uploading 1 narinfos"5236lb # [ 109.657326] niks3-server[1118]: 2026/09/20 08:09:16 INFO Signed narinfos id=31 count=15237lb # [ 109.674766] niks3-server[1118]: 2026/09/20 08:09:16 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5238lb # [ 109.684710] niks3-server[1118]: 2026/09/20 08:09:16 INFO Completed upload id=315239worker2 # [ 109.702627] nix-grpc-daemon[1219]: time=2026-09-20T08:09:16.237Z level=INFO msg="Upload complete. (572ms)"5240lb # [ 109.686678] niks3-server[1118]: 2026/09/20 08:09:16 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5241lb # [ 109.692298] niks3-server[1118]: 2026/09/20 08:09:16 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5242worker2 # [ 109.712953] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33234 duration_s=0 paths=1 nar_bytes_in=4165243worker2 # [ 109.729144] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:332345244worker2 # [ 109.746251] nix-daemon[839]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)5245worker2 # [ 109.755084] nix-daemon[839]: reaped child process 1382, status = succeeded5246client # [ 109.750566] nix[1151]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5247worker2 # [ 109.767597] nix-daemon[839]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)5248lb # [ 111.083886] envoy[912]: conn peer=[2001:db8:1::1]:40224 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9497 tx=3846 ms=79495249lb: must succeed: curl -sf localhost:9901/clusters5250lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5251lb: must succeed: curl -sf localhost:9901/clusters5252lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5253lb: must succeed: curl -sf localhost:9901/clusters5254lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5255lb: must succeed: curl -sf localhost:9901/clusters5256lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5257worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5258worker1 # [ 111.766746] systemd-journald[274]: Received client request to rotate journal, rotating.5259worker1 # [ 111.795101] systemd-journald[274]: Vacuuming done, freed 0B of archived journals from /var/log/journal/226e9f60d89e4827b10bdaed4210243d.5260worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)5261worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service5262worker2 # [ 111.816903] systemd[1]: Stopping Nix worker-protocol over gRPC...5263worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5264??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5265 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735266client: must succeed: sleep 5.05267worker2 # [ 111.946942] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:18Z level=info event=draining5268client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5269worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5270worker2 # [ 117.419283] nix-daemon[839]: reaped child process 1396, status = succeeded5271worker2 # [ 117.608374] nix-daemon[839]: accepted connection from pid 1436, user nix-grpc-daemon (trusted)5272worker2 # [ 117.627358] nix-daemon[839]: reaped child process 1439, status = succeeded5273lb # [ 117.619409] niks3-server[1118]: 2026/09/20 08:09:24 INFO Received uploads request method=POST path=/api/pending_closures5274worker2 # [ 117.656464] nix-grpc-daemon[1219]: time=2026-09-20T08:09:24.187Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5275worker2 # [ 117.658420] nix-grpc-daemon[1219]: time=2026-09-20T08:09:24.187Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5276lb # [ 117.676763] niks3-server[1118]: 2026/09/20 08:09:24 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5277worker2 # [ 117.708784] nix-grpc-daemon[1219]: time=2026-09-20T08:09:24.243Z level=INFO msg="Uploading 1 narinfos"5278lb # [ 117.686298] niks3-server[1118]: 2026/09/20 08:09:24 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5279lb # [ 117.700077] niks3-server[1118]: 2026/09/20 08:09:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5280lb # [ 117.703150] niks3-server[1118]: 2026/09/20 08:09:24 INFO Signed narinfos id=32 count=15281lb # [ 117.707349] niks3-server[1118]: 2026/09/20 08:09:24 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5282lb # [ 117.714806] niks3-server[1118]: 2026/09/20 08:09:24 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5283lb # [ 117.719240] niks3-server[1118]: 2026/09/20 08:09:24 INFO Completed upload id=325284worker2 # [ 117.738479] nix-grpc-daemon[1219]: time=2026-09-20T08:09:24.273Z level=INFO msg="Upload complete. (349ms)"5285lb # [ 117.721242] niks3-server[1118]: 2026/09/20 08:09:24 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5286worker2 # [ 117.753138] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33234 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15287worker2 # [ 117.770369] nix-daemon[839]: reaped child process 1394, status = succeeded5288client # [ 117.777579] systemd[1]: rs.service: Deactivated successfully.5289client # [ 117.781941] systemd[1]: rs.service: Consumed 186ms CPU time over 9.088s wall clock time, 39.2M memory peak, 8.5K incoming IP traffic, 8.9K outgoing IP traffic.5290worker2 # [ 117.947627] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:24Z level=info event=signal_exit5291worker2 # [ 118.174326] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:24Z level=info event=scheduler_yield5292lb # [ 118.157402] niks3-server[1118]: 2026/09/20 08:09:24 INFO lead: released remote=192.168.1.4:458205293worker1 # [ 118.207298] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:24Z level=info event=scheduler_restarting addr=lb:500515294worker2 # [ 118.185916] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:24Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:405745295worker2 # [ 118.191337] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:24Z level=info event=worker_gone addr=192.168.1.3:500515296worker2 # [ 118.197153] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:24Z level=info event=scheduler_restarting addr=lb:500515297worker2 # [ 118.201267] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:24Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:405745298worker2 # [ 118.205697] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:24Z level=info event=worker_gone addr=192.168.1.4:500515299worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.15 seconds)5300client: waiting for success: ! systemctl is-active rs5301worker1 # [ 118.407389] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:24Z level=info event=scheduler_connected addr=lb:500515302worker2 # [ 118.392322] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:24Z level=info event=scheduler_connected addr=lb:500515303worker1 # [ 118.434086] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5304worker2 # [ 118.407690] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5305client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5306client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5307client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds)5308client: must fail: journalctl -u rs | grep -q 'reconnecting'5309client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5310lb: must succeed: curl -sf localhost:9901/clusters5311lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5312worker1 # [ 118.635185] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:25Z level=info event=scheduler_connected addr=lb:500515313worker2 # [ 118.608636] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:25Z level=info event=scheduler_connected addr=lb:500515314worker2 # [ 118.615392] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5315worker1 # [ 118.642867] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5316worker1 # [ 118.844257] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:25Z level=info event=scheduler_connected addr=lb:500515317worker2 # [ 118.818916] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:25Z level=info event=scheduler_connected addr=lb:500515318worker1 # [ 118.850366] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5319worker2 # [ 118.824187] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5320worker1 # [ 119.051317] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:25Z level=info event=scheduler_connected addr=lb:500515321worker2 # [ 119.024783] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:25Z level=info event=scheduler_connected addr=lb:500515322worker1 # [ 119.058278] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5323worker2 # [ 119.031137] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5324worker2 # [ 119.180143] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:25Z level=info event=scheduler_restarting5325worker2 # [ 119.212779] nix-daemon[839]: reaped child process 1212, status = succeeded5326worker1 # [ 119.260637] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:25Z level=info event=scheduler_connected addr=lb:500515327worker2 # [ 119.240117] nix-grpc-daemon[1163]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5328worker2 # [ 119.256356] nix-grpc-daemon[1163]: E0000 00:00:1789891765.770630 1206 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5329worker2 # [ 119.262823] nix-grpc-daemon[1163]: ts=2026-09-20T08:09:25Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5330lb: must succeed: curl -sf localhost:9901/clusters5331lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5332worker2 # [ 120.014746] nix-grpc-daemon[1163]: E0000 00:00:1789891766.548370 1206 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5333worker2 # [ 120.038828] nix-grpc-daemon[1163]: E0000 00:00:1789891766.573576 1206 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5334worker1 # [ 120.415084] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5335worker2 # [ 120.409390] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5336worker2 # [ 120.418116] systemd[1]: Stopped Nix worker-protocol over gRPC.5337worker2 # [ 120.423040] systemd[1]: nix-grpc-daemon.service: Consumed 2.345s CPU time over 31.712s wall clock time, 34.2M memory peak, 58.6K incoming IP traffic, 109.6K outgoing IP traffic.5338worker2 # [ 120.437054] systemd[1]: Starting Nix worker-protocol over gRPC...5339worker1 # [ 120.615117] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:27Z level=info event=scheduler_connected addr=lb:500515340worker1 # [ 120.622137] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5341worker2 # [ 120.638351] nix-grpc-daemon[1446]: ts=2026-09-20T08:09:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5342worker2 # [ 120.640825] nix-grpc-daemon[1446]: ts=2026-09-20T08:09:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15343worker2 # [ 120.648070] nix-grpc-daemon[1446]: ts=2026-09-20T08:09:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5344worker2 # [ 120.652431] systemd[1]: Started Nix worker-protocol over gRPC.5345worker2 # [ 120.664956] nix-grpc-daemon[1446]: ts=2026-09-20T08:09:27Z level=info event=scheduler_take_over5346lb # [ 120.639603] niks3-server[1118]: 2026/09/20 08:09:27 INFO lead: acquired remote=192.168.1.4:343725347worker2 # [ 120.673502] nix-grpc-daemon[1446]: ts=2026-09-20T08:09:27Z level=info event=scheduler_connected addr=lb:500515348lb: must succeed: curl -sf localhost:9901/clusters5349worker2 # [ 120.685088] nix-grpc-daemon[1446]: ts=2026-09-20T08:09:27Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05350lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5351worker1 # [ 120.823301] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:27Z level=info event=scheduler_connected addr=lb:500515352worker1 # [ 120.830165] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5353worker1 # [ 121.031217] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:27Z level=info event=scheduler_connected addr=lb:500515354worker2 # [ 121.006469] nix-grpc-daemon[1446]: ts=2026-09-20T08:09:27Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05355lb # [ 121.083978] envoy[912]: conn peer=[2001:db8:1::1]:53722 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2940 tx=1352 ms=87925356lb # [ 121.089073] envoy[912]: conn peer=[2001:db8:1::4]:38128 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5740 tx=1831 ms=302915357lb: must succeed: curl -sf localhost:9901/clusters5358lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5359worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5360worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5361(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.29 seconds)5362subtest: scheduler restart mid-build: build finishes, no double build5363client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5364client # [ 121.972669] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5365client # Running as unit: mid.service; invocation ID: b209703330094aa18571aa22f807861c5366client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)5367worker2 # [ 122.239400] nix-grpc-daemon[1446]: ts=2026-09-20T08:09:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:502685368worker2 # [ 122.254450] nix-daemon[839]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5369client # [ 122.256873] nix[1187]: don't know how to build these paths:5370client # [ 122.258378] nix[1187]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5371worker2 # [ 122.285217] nix-grpc-daemon[1446]: ts=2026-09-20T08:09:28Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05372worker2 # [ 122.291845] nix-grpc-daemon[1446]: ts=2026-09-20T08:09:28Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15373worker2 # [ 122.336848] nix-grpc-daemon[1446]: ts=2026-09-20T08:09:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:502685374worker2 # [ 122.355641] nix-grpc-daemon[1446]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 1/5)5375worker2 # [ 122.416311] nix-grpc-daemon[1446]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 131 ms (attempt 2/5)5376worker2 # [ 122.555042] nix-grpc-daemon[1446]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 337 ms (attempt 3/5)5377worker2 # [ 122.899940] nix-grpc-daemon[1446]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 456 ms (attempt 4/5)5378worker2 # [ 123.357725] nix-grpc-daemon[1446]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5379worker2 # [ 123.377648] nix-grpc-daemon[1446]: ts=2026-09-20T08:09:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:502685380client # [ 123.377280] nix[1187]: copying 1 paths to 'lb:50051'...5381worker2 # [ 123.392559] nix-grpc-daemon[1446]: ts=2026-09-20T08:09:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:502685382client # [ 123.380790] nix[1187]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5383worker2 # [ 123.411112] nix-daemon[839]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5384worker2 # [ 123.441134] nix-grpc-daemon[1446]: ts=2026-09-20T08:09:29Z level=info event=niks3_push_started pid=15175385worker2 # [ 123.832301] nix-daemon[839]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5386worker2 # [ 123.850290] nix-daemon[839]: reaped child process 1533, status = succeeded5387worker2 # [ 124.030388] nix-daemon[839]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)5388worker2 # [ 124.048383] nix-daemon[839]: reaped child process 1538, status = succeeded5389lb # [ 124.040872] niks3-server[1118]: 2026/09/20 08:09:30 INFO Received uploads request method=POST path=/api/pending_closures5390worker2 # [ 124.071381] nix-grpc-daemon[1517]: time=2026-09-20T08:09:30.605Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5391worker2 # [ 124.074711] nix-grpc-daemon[1517]: time=2026-09-20T08:09:30.607Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5392lb # [ 124.087675] niks3-server[1118]: 2026/09/20 08:09:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5393lb # [ 124.100874] niks3-server[1118]: 2026/09/20 08:09:30 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5394lb # [ 124.109953] niks3-server[1118]: 2026/09/20 08:09:30 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5395lb # [ 124.121135] niks3-server[1118]: 2026/09/20 08:09:30 INFO Signed narinfos id=33 count=15396worker2 # [ 124.142243] nix-grpc-daemon[1517]: time=2026-09-20T08:09:30.676Z level=INFO msg="Uploading 1 narinfos"5397lb # [ 124.131453] niks3-server[1118]: 2026/09/20 08:09:30 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5398lb # [ 124.142194] niks3-server[1118]: 2026/09/20 08:09:30 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5399lb # [ 124.152442] niks3-server[1118]: 2026/09/20 08:09:30 INFO Completed upload id=335400worker2 # [ 124.172947] nix-grpc-daemon[1517]: time=2026-09-20T08:09:30.707Z level=INFO msg="Upload complete. (512ms)"5401worker2 # [ 124.183447] nix-grpc-daemon[1446]: ts=2026-09-20T08:09:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50268 duration_s=0 paths=1 nar_bytes_in=4245402worker2 # [ 124.200324] nix-grpc-daemon[1446]: ts=2026-09-20T08:09:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:502685403worker2 # [ 124.211291] nix-daemon[839]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5404worker2 # [ 124.217718] nix-daemon[839]: reaped child process 1515, status = succeeded5405client # [ 124.214280] nix[1187]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5406worker2 # [ 124.234468] nix-daemon[839]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5407lb: must succeed: curl -sf localhost:9901/clusters5408lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5409lb: must succeed: curl -sf localhost:9901/clusters5410lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5411worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5412worker2 # [ 127.146262] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1446 (nix-grpc-daemon) on client request.5413worker2 # [ 127.148206] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5414lb # [ 127.142818] niks3-server[1118]: 2026/09/20 08:09:33 INFO lead: released remote=192.168.1.4:343725415client # [ 127.146522] nix[1187]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5416worker1 # [ 127.188306] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5417client # [ 127.153029] nix[1187]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5418worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds)5419client: must succeed: sleep 5.05420worker2 # [ 127.190630] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5421worker2 # [ 127.199547] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5422worker2 # [ 127.201065] systemd[1]: nix-grpc-daemon.service: Consumed 508ms CPU time over 6.752s wall clock time, 31.6M memory peak, 11.9K incoming IP traffic, 14.9K outgoing IP traffic.5423worker2 # [ 127.209550] nix-daemon[839]: reaped child process 1504, status = succeeded5424worker2 # [ 127.210913] nix-daemon[839]: reaped child process 1540, status = succeeded5425worker2 # [ 127.220668] nix-daemon[1542]: unexpected Nix daemon error: error: interrupted by the user5426worker2 # [ 127.225768] nix-daemon[839]: reaped child process 1542, status = failed with exit code 15427worker1 # [ 127.388220] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:33Z level=info event=scheduler_connected addr=lb:500515428worker2 # [ 127.367875] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5429worker2 # [ 127.373987] systemd[1]: Starting Nix worker-protocol over gRPC...5430worker2 # [ 127.566197] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:34Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5431worker2 # [ 127.568678] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:34Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15432worker2 # [ 127.576735] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:34Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5433worker2 # [ 127.578444] systemd[1]: Started Nix worker-protocol over gRPC.5434worker2 # [ 127.593606] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:34Z level=info event=scheduler_take_over5435lb # [ 127.576185] niks3-server[1118]: 2026/09/20 08:09:34 INFO lead: acquired remote=192.168.1.4:569365436worker1 # [ 127.636427] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5437worker2 # [ 127.614898] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:34Z level=info event=scheduler_connected addr=lb:500515438worker2 # [ 127.617071] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:34Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05439worker2 # [ 127.671178] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:34Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05440worker2 # [ 127.677692] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:34Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15441worker2 # [ 127.720174] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:503005442worker2 # [ 127.734209] nix-daemon[839]: accepted connection from pid 1582, user nix-grpc-daemon (trusted)5443worker2 # [ 127.753360] nix-daemon[839]: accepted connection from pid 1582, user nix-grpc-daemon (trusted)5444client # [ 127.749316] nix[1187]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5445worker2 # [ 127.768272] nix-daemon[839]: accepted connection from pid 1582, user nix-grpc-daemon (trusted)5446worker1 # [ 127.837445] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:34Z level=info event=scheduler_connected addr=lb:500515447worker2 # [ 127.811804] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:34Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05448lb # [ 131.084841] envoy[912]: conn peer=[2001:db8:1::4]:32854 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=470 tx=226 ms=64985449client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5450client: waiting for success: ! systemctl is-active mid5451worker2 # [ 132.593863] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:39Z level=info event=niks3_push_started pid=16615452worker2 # [ 132.609775] nix-daemon[839]: reaped child process 1637, status = succeeded5453worker2 # [ 132.957694] nix-daemon[839]: accepted connection from pid 1674, user nix-grpc-daemon (trusted)5454worker2 # [ 132.974802] nix-daemon[839]: reaped child process 1677, status = succeeded5455lb # [ 132.969812] niks3-server[1118]: 2026/09/20 08:09:39 INFO Received uploads request method=POST path=/api/pending_closures5456worker2 # [ 133.000435] nix-grpc-daemon[1661]: time=2026-09-20T08:09:39.533Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5457worker2 # [ 133.001931] nix-grpc-daemon[1661]: time=2026-09-20T08:09:39.533Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5458lb # [ 133.013149] niks3-server[1118]: 2026/09/20 08:09:39 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5459lb # [ 133.025021] niks3-server[1118]: 2026/09/20 08:09:39 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5460lb # [ 133.035269] niks3-server[1118]: 2026/09/20 08:09:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5461lb # [ 133.040641] niks3-server[1118]: 2026/09/20 08:09:39 INFO Signed narinfos id=34 count=15462worker2 # [ 133.061441] nix-grpc-daemon[1661]: time=2026-09-20T08:09:39.595Z level=INFO msg="Uploading 1 narinfos"5463lb # [ 133.045687] niks3-server[1118]: 2026/09/20 08:09:39 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5464lb # [ 133.053769] niks3-server[1118]: 2026/09/20 08:09:39 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5465worker2 # [ 133.078990] nix-grpc-daemon[1661]: time=2026-09-20T08:09:39.613Z level=INFO msg="Upload complete. (292ms)"5466lb # [ 133.060102] niks3-server[1118]: 2026/09/20 08:09:39 INFO Completed upload id=345467lb # [ 133.062710] niks3-server[1118]: 2026/09/20 08:09:39 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo5468worker2 # [ 133.091488] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50300 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15469worker2 # [ 133.105707] nix-daemon[839]: reaped child process 1635, status = succeeded5470client # [ 133.119797] systemd[1]: mid.service: Deactivated successfully.5471client # [ 133.124541] systemd[1]: mid.service: Consumed 175ms CPU time over 11.151s wall clock time, 39.2M memory peak, 9.6K incoming IP traffic, 10.6K outgoing IP traffic.5472client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5473client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5474client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5475(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 11.83 seconds)5476subtest: interrupting the client stops the build on the worker5477client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5478client # [ 133.771675] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5479client # Running as unit: intr.service; invocation ID: 1a4dd2d1ce56449aab1f06c4260ba6c75480client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.05 seconds)5481worker1 # [ 134.043178] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:457205482worker1 # [ 134.058225] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5483client # [ 134.035433] nix[1223]: don't know how to build these paths:5484client # [ 134.038038] nix[1223]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5485worker2 # [ 134.063660] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:40Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05486worker2 # [ 134.070065] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:40Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=15487worker1 # [ 134.143646] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457205488worker1 # [ 134.164930] nix-grpc-daemon[1134]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 1/5)5489worker1 # [ 134.243618] nix-grpc-daemon[1134]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 130 ms (attempt 2/5)5490worker1 # [ 134.381229] nix-grpc-daemon[1134]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 306 ms (attempt 3/5)5491worker1 # [ 134.694921] nix-grpc-daemon[1134]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 463 ms (attempt 4/5)5492worker1 # [ 135.167279] nix-grpc-daemon[1134]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5493worker1 # [ 135.188911] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457205494client # [ 135.161290] nix[1223]: copying 1 paths to 'lb:50051'...5495worker1 # [ 135.203817] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457205496client # [ 135.164561] nix[1223]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5497worker1 # [ 135.222981] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5498worker1 # [ 135.250803] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:41Z level=info event=niks3_push_started pid=12765499worker1 # [ 135.640002] nix-daemon[842]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)5500worker1 # [ 135.659802] nix-daemon[842]: reaped child process 1292, status = succeeded5501worker1 # [ 135.836854] nix-daemon[842]: accepted connection from pid 1294, user nix-grpc-daemon (trusted)5502worker1 # [ 135.853381] nix-daemon[842]: reaped child process 1297, status = succeeded5503lb # [ 135.821757] niks3-server[1118]: 2026/09/20 08:09:42 INFO Received uploads request method=POST path=/api/pending_closures5504worker1 # [ 135.878141] nix-grpc-daemon[1276]: time=2026-09-20T08:09:42.422Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5505worker1 # [ 135.879647] nix-grpc-daemon[1276]: time=2026-09-20T08:09:42.422Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5506lb # [ 135.863066] niks3-server[1118]: 2026/09/20 08:09:42 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5507worker1 # [ 135.921530] nix-grpc-daemon[1276]: time=2026-09-20T08:09:42.467Z level=INFO msg="Uploading 1 narinfos"5508lb # [ 135.880730] niks3-server[1118]: 2026/09/20 08:09:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5509worker1 # [ 135.940589] nix-grpc-daemon[1276]: time=2026-09-20T08:09:42.486Z level=INFO msg="Upload complete. (470ms)"5510lb # [ 135.896624] niks3-server[1118]: 2026/09/20 08:09:42 INFO Signed narinfos id=35 count=15511lb # [ 135.901525] niks3-server[1118]: 2026/09/20 08:09:42 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5512worker1 # [ 135.948977] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=0 paths=1 nar_bytes_in=4245513lb # [ 135.907202] niks3-server[1118]: 2026/09/20 08:09:42 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5514worker1 # [ 135.955262] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457205515lb # [ 135.912117] niks3-server[1118]: 2026/09/20 08:09:42 INFO Completed upload id=355516lb # [ 135.915145] niks3-server[1118]: 2026/09/20 08:09:42 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5517worker1 # [ 135.967071] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5518worker1 # [ 135.973967] nix-daemon[842]: reaped child process 1274, status = succeeded5519client # [ 135.935612] nix[1223]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5520worker1 # [ 135.980414] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5521client: must succeed: systemctl kill -s INT intr5522client # [ 137.494058] systemd[1]: intr.service: Sent signal SIGINT to main process 1223 (nix) on client request.5523client # [ 137.500773] nix[1223]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5524client # [ 137.504437] nix[1223]: error: interrupted by the user5525client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5526client # [ 137.551879] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5527client # [ 137.556883] systemd[1]: intr.service: Failed with result 'exit-code'.5528client # [ 137.560827] systemd[1]: intr.service: Consumed 146ms CPU time over 3.784s wall clock time, 37.2M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5529worker1 # [ 137.616737] nix-daemon[842]: reaped child process 1299, status = succeeded5530worker1 # [ 137.623719] nix-daemon[1301]: unexpected Nix daemon error: error: interrupted by the user5531worker1 # [ 137.629792] nix-daemon[842]: reaped child process 1301, status = failed with exit code 15532(finished: subtest: interrupting the client stops the build on the worker, in 3.94 seconds)5533subtest: a deploy mid-build drains: the build finishes, the new generation takes over5534client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5535client # [ 137.740179] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5536client # Running as unit: sw.service; invocation ID: 9cea87066e7843c8b764b6694acad9525537client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.10 seconds)5538worker1 # [ 138.037169] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:457205539client # [ 138.003557] nix[1244]: don't know how to build these paths:5540client # [ 138.004783] nix[1244]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5541worker2 # [ 138.029995] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:44Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05542worker2 # [ 138.030359] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:44Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=15543worker2 # [ 138.072638] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:503005544worker2 # [ 138.088925] nix-grpc-daemon[1582]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 1/5)5545worker2 # [ 138.117322] nix-grpc-daemon[1582]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 161 ms (attempt 2/5)5546worker2 # [ 138.285687] nix-grpc-daemon[1582]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 3/5)5547worker2 # [ 138.310180] nix-grpc-daemon[1582]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 523 ms (attempt 4/5)5548worker2 # [ 138.841519] nix-grpc-daemon[1582]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5549worker2 # [ 138.862297] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:503005550client # [ 138.860315] nix[1244]: copying 1 paths to 'lb:50051'...5551worker2 # [ 138.876841] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:503005552client # [ 138.863884] nix[1244]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5553worker2 # [ 138.894745] nix-daemon[839]: accepted connection from pid 1582, user nix-grpc-daemon (trusted)5554worker2 # [ 139.118696] nix-daemon[839]: accepted connection from pid 1712, user nix-grpc-daemon (trusted)5555worker2 # [ 139.143355] nix-daemon[839]: reaped child process 1719, status = succeeded5556worker2 # [ 139.314339] nix-daemon[839]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)5557worker2 # [ 139.331440] nix-daemon[839]: reaped child process 1724, status = succeeded5558lb # [ 139.328780] niks3-server[1118]: 2026/09/20 08:09:45 INFO Received uploads request method=POST path=/api/pending_closures5559worker2 # [ 139.358846] nix-grpc-daemon[1661]: time=2026-09-20T08:09:45.892Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5560worker2 # [ 139.360421] nix-grpc-daemon[1661]: time=2026-09-20T08:09:45.893Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5561lb # [ 139.361648] niks3-server[1118]: 2026/09/20 08:09:45 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5562worker2 # [ 139.390231] nix-grpc-daemon[1661]: time=2026-09-20T08:09:45.924Z level=INFO msg="Uploading 1 narinfos"5563lb # [ 139.375792] niks3-server[1118]: 2026/09/20 08:09:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5564lb # [ 139.390270] niks3-server[1118]: 2026/09/20 08:09:45 INFO Signed narinfos id=36 count=15565worker2 # [ 139.413438] nix-grpc-daemon[1661]: time=2026-09-20T08:09:45.948Z level=INFO msg="Upload complete. (501ms)"5566lb # [ 139.395067] niks3-server[1118]: 2026/09/20 08:09:45 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5567worker2 # [ 139.420409] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50300 duration_s=0 paths=1 nar_bytes_in=4165568lb # [ 139.400545] niks3-server[1118]: 2026/09/20 08:09:45 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5569lb # [ 139.404771] niks3-server[1118]: 2026/09/20 08:09:45 INFO Completed upload id=365570lb # [ 139.406777] niks3-server[1118]: 2026/09/20 08:09:45 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5571worker2 # [ 139.431314] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:503005572worker2 # [ 139.437991] nix-daemon[839]: accepted connection from pid 1582, user nix-grpc-daemon (trusted)5573worker2 # [ 139.442182] nix-daemon[839]: reaped child process 1710, status = succeeded5574worker2 # [ 139.451325] nix-daemon[839]: accepted connection from pid 1582, user nix-grpc-daemon (trusted)5575client # [ 139.436828] nix[1244]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5576lb # [ 141.084544] envoy[912]: conn peer=[2001:db8:1::1]:53684 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3841 tx=1662 ms=108715577lb # [ 141.089536] envoy[912]: conn peer=[2001:db8:1::1]:59400 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=755 ms=35295578worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25579worker2 # Checking switch inhibitors... done5580worker2 # activating the configuration...5581worker2 # [ 142.424118] nixos[1759]: switching to system configuration /nix/store/g397cnlhrbvbdvd49ymcqzfx4yl3wfdd-nixos-system-worker2-test5582worker2 # [ 142.425992] systemd[1]: Stopped target Remote File Systems.5583worker2 # [ 142.426832] systemd[1]: Stopped target Local File Systems.5584worker2 # setting up /etc...5585worker2 # [ 143.192719] systemd[1]: Reload requested from client PID 1759 ('.switch-to-conf') (unit backdoor.service)...5586worker2 # [ 143.194543] systemd[1]: Reloading...5587worker2 # [ 144.080562] systemd[1]: Reloading finished in 883 ms.5588worker2 # restarting sysinit-reactivation.target5589worker2 # [ 144.167767] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5590worker2 # [ 144.335000] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5591worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5592worker2 # [ 144.339532] systemd[1]: Reached target Reactivate sysinit units.5593worker2 # [ 144.346114] systemd[1]: Reloading D-Bus System Message Bus...5594worker2 # [ 144.349162] dbus-broker-launch[503]: Caught SIGHUP, trigger reload.5595worker2 # [ 144.350120] systemd[1]: Reloading Nix worker-protocol over gRPC...5596worker2 # [ 144.372690] dbus-broker-launch[503]: Looking up NSS user entry for 'systemd-timesync'...5597worker2 # [ 144.374951] dbus-broker-launch[503]: NSS returned no entry for 'systemd-timesync'5598worker2 # [ 144.378208] dbus-broker-launch[503]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5599worker2 # [ 144.409913] systemd[1]: Reloaded Nix worker-protocol over gRPC.5600worker2 # [ 144.433513] systemd[1]: Reloaded D-Bus System Message Bus.5601worker2 # [ 144.442351] systemd[1]: Reached target Remote File Systems.5602worker2 # [ 144.445975] systemd[1]: Starting linger-users.service...5603worker2 # [ 144.446815] systemd[1]: Reached target Local File Systems.5604worker2 # [ 144.456183] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5605worker2 # [ 144.461989] systemd[1]: Starting Create SUID/SGID Wrappers...5606worker2 # [ 144.469032] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5607worker2 # [ 144.470287] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675608worker2 # [ 144.484604] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5609worker2 # [ 144.486188] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5610worker2 # [ 144.487434] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5611worker2 # [ 144.492854] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5612worker2 # [ 144.496370] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5613worker2 # [ 144.539593] systemd[1]: linger-users.service: Deactivated successfully.5614worker2 # [ 144.541349] systemd[1]: Finished linger-users.service.5615worker2 # [ 144.592829] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:51Z level=info event=draining5616worker2 # [ 145.083231] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5617worker2 # [ 145.088310] systemd[1]: Finished Create SUID/SGID Wrappers.5618worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5619worker2 # [ 145.339530] nixos[1759]: finished switching to system configuration /nix/store/g397cnlhrbvbdvd49ymcqzfx4yl3wfdd-nixos-system-worker2-test5620worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.74 seconds)5621worker2: must succeed: pgrep -f 'read -t [9]0 x'5622worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.07 seconds)5623client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&25624client # don't know how to build these paths:5625client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5626worker1 # [ 145.779673] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:457205627worker2 # [ 145.765143] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:52Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05628worker2 # [ 145.767308] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:52Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=15629worker1 # [ 145.845224] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457205630worker1 # [ 145.867836] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457205631client # copying 1 paths to 'lb:50051'...5632worker1 # [ 145.889189] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457205633client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5634worker1 # [ 145.918641] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5635worker1 # [ 146.189578] nix-daemon[842]: accepted connection from pid 1351, user nix-grpc-daemon (trusted)5636worker1 # [ 146.214516] nix-daemon[842]: reaped child process 1354, status = succeeded5637worker1 # [ 146.418997] nix-daemon[842]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5638worker1 # [ 146.438210] nix-daemon[842]: reaped child process 1359, status = succeeded5639lb # [ 146.411770] niks3-server[1118]: 2026/09/20 08:09:52 INFO Received uploads request method=POST path=/api/pending_closures5640worker1 # [ 146.472169] nix-grpc-daemon[1276]: time=2026-09-20T08:09:53.017Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5641worker1 # [ 146.473843] nix-grpc-daemon[1276]: time=2026-09-20T08:09:53.017Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5642lb # [ 146.464382] niks3-server[1118]: 2026/09/20 08:09:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5643worker1 # [ 146.518129] nix-grpc-daemon[1276]: time=2026-09-20T08:09:53.063Z level=INFO msg="Uploading 1 narinfos"5644lb # [ 146.479050] niks3-server[1118]: 2026/09/20 08:09:53 INFO Signed narinfos id=37 count=15645lb # [ 146.486550] niks3-server[1118]: 2026/09/20 08:09:53 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5646lb # [ 146.496919] niks3-server[1118]: 2026/09/20 08:09:53 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5647worker1 # [ 146.554850] nix-grpc-daemon[1276]: time=2026-09-20T08:09:53.100Z level=INFO msg="Upload complete. (611ms)"5648lb # [ 146.509164] niks3-server[1118]: 2026/09/20 08:09:53 INFO Completed upload id=375649lb # [ 146.516382] niks3-server[1118]: 2026/09/20 08:09:53 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5650worker1 # [ 146.564382] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=0 paths=1 nar_bytes_in=5285651lb # [ 146.538758] niks3-server[1118]: 2026/09/20 08:09:53 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5652worker1 # [ 146.584839] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457205653worker1 # [ 146.595324] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5654worker1 # [ 146.602281] nix-daemon[842]: reaped child process 1349, status = succeeded5655client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5656client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5657worker1 # [ 146.622981] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5658client # farm-a> LOG-farm-a-during-drain5659worker1 # [ 147.662263] nix-daemon[842]: reaped child process 1363, status = succeeded5660worker1 # [ 147.865717] nix-daemon[842]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5661worker1 # [ 147.888813] nix-daemon[842]: reaped child process 1381, status = succeeded5662lb # [ 147.860836] niks3-server[1118]: 2026/09/20 08:09:54 INFO Received uploads request method=POST path=/api/pending_closures5663worker1 # [ 147.928790] nix-grpc-daemon[1276]: time=2026-09-20T08:09:54.473Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5664worker1 # [ 147.930688] nix-grpc-daemon[1276]: time=2026-09-20T08:09:54.473Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5665lb # [ 147.936625] niks3-server[1118]: 2026/09/20 08:09:54 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5666lb # [ 147.948916] niks3-server[1118]: 2026/09/20 08:09:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5667lb # [ 147.958456] niks3-server[1118]: 2026/09/20 08:09:54 INFO Signed narinfos id=38 count=15668worker1 # [ 148.004248] nix-grpc-daemon[1276]: time=2026-09-20T08:09:54.548Z level=INFO msg="Uploading 1 narinfos"5669lb # [ 147.961611] niks3-server[1118]: 2026/09/20 08:09:54 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5670lb # [ 147.968692] niks3-server[1118]: 2026/09/20 08:09:54 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5671lb # [ 147.979311] niks3-server[1118]: 2026/09/20 08:09:54 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5672lb # [ 147.992991] niks3-server[1118]: 2026/09/20 08:09:54 INFO Completed upload id=385673lb # [ 147.995978] niks3-server[1118]: 2026/09/20 08:09:54 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5674worker1 # [ 148.040711] nix-grpc-daemon[1276]: time=2026-09-20T08:09:54.586Z level=INFO msg="Upload complete. (401ms)"5675worker2 # [ 148.029863] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:54Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05676worker2 # [ 148.032240] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:54Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=15677worker1 # [ 148.059430] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15678worker1 # [ 148.080297] nix-daemon[842]: reaped child process 1361, status = succeeded5679worker1 # [ 148.111597] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457205680worker1 # [ 148.133271] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457205681worker1 # [ 148.153548] nix-grpc-daemon[1276]: time=2026-09-20T08:09:54.699Z level=INFO msg="All 1 paths already cached"5682client # copying 1 paths to 'lb:50051'...5683worker1 # [ 148.167265] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457205684client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5685worker1 # [ 148.195796] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5686worker1 # [ 148.464834] nix-daemon[842]: accepted connection from pid 1385, user nix-grpc-daemon (trusted)5687worker1 # [ 148.488526] nix-daemon[842]: reaped child process 1388, status = succeeded5688worker1 # [ 148.696785] nix-daemon[842]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5689worker1 # [ 148.717512] nix-daemon[842]: reaped child process 1393, status = succeeded5690lb # [ 148.683131] niks3-server[1118]: 2026/09/20 08:09:55 INFO Received uploads request method=POST path=/api/pending_closures5691worker1 # [ 148.744126] nix-grpc-daemon[1276]: time=2026-09-20T08:09:55.290Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5692worker1 # [ 148.746408] nix-grpc-daemon[1276]: time=2026-09-20T08:09:55.291Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5693lb # [ 148.733758] niks3-server[1118]: 2026/09/20 08:09:55 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5694worker1 # [ 148.792778] nix-grpc-daemon[1276]: time=2026-09-20T08:09:55.338Z level=INFO msg="Uploading 1 narinfos"5695lb # [ 148.751815] niks3-server[1118]: 2026/09/20 08:09:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5696lb # [ 148.761576] niks3-server[1118]: 2026/09/20 08:09:55 INFO Signed narinfos id=39 count=15697lb # [ 148.768391] niks3-server[1118]: 2026/09/20 08:09:55 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5698lb # [ 148.776409] niks3-server[1118]: 2026/09/20 08:09:55 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5699worker1 # [ 148.832534] nix-grpc-daemon[1276]: time=2026-09-20T08:09:55.378Z level=INFO msg="Upload complete. (612ms)"5700lb # [ 148.787770] niks3-server[1118]: 2026/09/20 08:09:55 INFO Completed upload id=395701lb # [ 148.792112] niks3-server[1118]: 2026/09/20 08:09:55 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5702worker1 # [ 148.845409] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=0 paths=1 nar_bytes_in=6405703worker1 # [ 148.864597] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457205704worker1 # [ 148.874898] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5705worker1 # [ 148.882304] nix-daemon[842]: reaped child process 1383, status = succeeded5706client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5707client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5708worker1 # [ 148.902026] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5709client # farm-b> LOG-farm-b-during-drain5710worker1 # [ 149.734977] nix-daemon[842]: reaped child process 1397, status = succeeded5711worker1 # [ 149.927926] nix-daemon[842]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5712worker1 # [ 149.952324] nix-daemon[842]: reaped child process 1415, status = succeeded5713lb # [ 149.919865] niks3-server[1118]: 2026/09/20 08:09:56 INFO Received uploads request method=POST path=/api/pending_closures5714worker1 # [ 149.980070] nix-grpc-daemon[1276]: time=2026-09-20T08:09:56.525Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5715worker1 # [ 149.982671] nix-grpc-daemon[1276]: time=2026-09-20T08:09:56.527Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5716lb # [ 149.976399] niks3-server[1118]: 2026/09/20 08:09:56 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5717lb # [ 150.000212] niks3-server[1118]: 2026/09/20 08:09:56 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5718lb # [ 150.009110] niks3-server[1118]: 2026/09/20 08:09:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5719worker1 # [ 150.061432] nix-grpc-daemon[1276]: time=2026-09-20T08:09:56.606Z level=INFO msg="Uploading 1 narinfos"5720lb # [ 150.016576] niks3-server[1118]: 2026/09/20 08:09:56 INFO Signed narinfos id=40 count=15721lb # [ 150.022134] niks3-server[1118]: 2026/09/20 08:09:56 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5722lb # [ 150.036274] niks3-server[1118]: 2026/09/20 08:09:56 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5723lb # [ 150.046279] niks3-server[1118]: 2026/09/20 08:09:56 INFO Completed upload id=405724worker1 # [ 150.092742] nix-grpc-daemon[1276]: time=2026-09-20T08:09:56.638Z level=INFO msg="Upload complete. (373ms)"5725lb # [ 150.056900] niks3-server[1118]: 2026/09/20 08:09:56 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5726worker1 # [ 150.105641] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15727worker2 # [ 150.086904] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:56Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05728worker2 # [ 150.088899] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:56Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=15729worker1 # [ 150.133464] nix-daemon[842]: reaped child process 1395, status = succeeded5730worker1 # [ 150.161877] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457205731worker1 # [ 150.184992] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457205732worker1 # [ 150.205324] nix-grpc-daemon[1276]: time=2026-09-20T08:09:56.751Z level=INFO msg="All 2 paths already cached"5733client # copying 1 paths to 'lb:50051'...5734worker1 # [ 150.218323] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457205735client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5736worker1 # [ 150.235739] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5737worker1 # [ 150.514992] nix-daemon[842]: accepted connection from pid 1419, user nix-grpc-daemon (trusted)5738worker1 # [ 150.539130] nix-daemon[842]: reaped child process 1422, status = succeeded5739worker1 # [ 150.752410] nix-daemon[842]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5740worker1 # [ 150.773525] nix-daemon[842]: reaped child process 1427, status = succeeded5741lb # [ 150.741540] niks3-server[1118]: 2026/09/20 08:09:57 INFO Received uploads request method=POST path=/api/pending_closures5742worker1 # [ 150.802357] nix-grpc-daemon[1276]: time=2026-09-20T08:09:57.348Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5743worker1 # [ 150.803901] nix-grpc-daemon[1276]: time=2026-09-20T08:09:57.348Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5744lb # [ 150.791530] niks3-server[1118]: 2026/09/20 08:09:57 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5745worker1 # [ 150.851589] nix-grpc-daemon[1276]: time=2026-09-20T08:09:57.397Z level=INFO msg="Uploading 1 narinfos"5746lb # [ 150.808499] niks3-server[1118]: 2026/09/20 08:09:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5747lb # [ 150.818691] niks3-server[1118]: 2026/09/20 08:09:57 INFO Signed narinfos id=41 count=15748lb # [ 150.823604] niks3-server[1118]: 2026/09/20 08:09:57 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5749lb # [ 150.830404] niks3-server[1118]: 2026/09/20 08:09:57 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5750lb # [ 150.838663] niks3-server[1118]: 2026/09/20 08:09:57 INFO Completed upload id=415751worker1 # [ 150.885641] nix-grpc-daemon[1276]: time=2026-09-20T08:09:57.431Z level=INFO msg="Upload complete. (621ms)"5752lb # [ 150.841296] niks3-server[1118]: 2026/09/20 08:09:57 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5753worker1 # [ 150.896411] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=0 paths=1 nar_bytes_in=7685754worker1 # [ 150.916848] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457205755worker1 # [ 150.927097] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5756worker1 # [ 150.934116] nix-daemon[842]: reaped child process 1417, status = succeeded5757client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5758worker1 # [ 150.950289] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5759client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5760client # farm-top> LOG-farm-top-during-drain5761worker1 # [ 151.987718] nix-daemon[842]: reaped child process 1431, status = succeeded5762worker1 # [ 152.157154] nix-daemon[842]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5763worker1 # [ 152.175716] nix-daemon[842]: reaped child process 1449, status = succeeded5764lb # [ 152.144140] niks3-server[1118]: 2026/09/20 08:09:58 INFO Received uploads request method=POST path=/api/pending_closures5765worker1 # [ 152.202669] nix-grpc-daemon[1276]: time=2026-09-20T08:09:58.746Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5766worker1 # [ 152.204235] nix-grpc-daemon[1276]: time=2026-09-20T08:09:58.746Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5767lb # [ 152.183198] niks3-server[1118]: 2026/09/20 08:09:58 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5768worker1 # [ 152.242747] nix-grpc-daemon[1276]: time=2026-09-20T08:09:58.788Z level=INFO msg="Uploading 1 narinfos"5769lb # [ 152.196546] niks3-server[1118]: 2026/09/20 08:09:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5770lb # [ 152.209892] niks3-server[1118]: 2026/09/20 08:09:58 INFO Signed narinfos id=42 count=15771lb # [ 152.217215] niks3-server[1118]: 2026/09/20 08:09:58 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5772lb # [ 152.228837] niks3-server[1118]: 2026/09/20 08:09:58 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5773worker1 # [ 152.275762] nix-grpc-daemon[1276]: time=2026-09-20T08:09:58.821Z level=INFO msg="Upload complete. (309ms)"5774lb # [ 152.235367] niks3-server[1118]: 2026/09/20 08:09:58 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5775lb # [ 152.240314] niks3-server[1118]: 2026/09/20 08:09:58 INFO Completed upload id=425776lb # [ 152.242522] niks3-server[1118]: 2026/09/20 08:09:58 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5777worker1 # [ 152.289011] nix-grpc-daemon[1134]: ts=2026-09-20T08:09:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15778worker1 # [ 152.302627] nix-daemon[842]: reaped child process 1429, status = succeeded5779client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&2, in 6.90 seconds)5780client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath5781client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath, in 0.24 seconds)5782worker2: must succeed: pkill -f 'read -t [9]0 x'5783worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.07 seconds)5784client: waiting for success: ! systemctl is-active sw5785worker2 # [ 152.694240] nix-daemon[839]: reaped child process 1728, status = succeeded5786worker2 # [ 152.861180] nix-daemon[839]: accepted connection from pid 1905, user nix-grpc-daemon (trusted)5787worker2 # [ 152.879478] nix-daemon[839]: reaped child process 1908, status = succeeded5788lb # [ 152.871197] niks3-server[1118]: 2026/09/20 08:09:59 INFO Received uploads request method=POST path=/api/pending_closures5789worker2 # [ 152.903323] nix-grpc-daemon[1661]: time=2026-09-20T08:09:59.437Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5790worker2 # [ 152.904932] nix-grpc-daemon[1661]: time=2026-09-20T08:09:59.437Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5791lb # [ 152.911787] niks3-server[1118]: 2026/09/20 08:09:59 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5792lb # [ 152.922509] niks3-server[1118]: 2026/09/20 08:09:59 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5793worker2 # [ 152.951364] nix-grpc-daemon[1661]: time=2026-09-20T08:09:59.484Z level=INFO msg="Uploading 1 narinfos"5794lb # [ 152.933558] niks3-server[1118]: 2026/09/20 08:09:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5795lb # [ 152.940409] niks3-server[1118]: 2026/09/20 08:09:59 INFO Signed narinfos id=43 count=15796lb # [ 152.944197] niks3-server[1118]: 2026/09/20 08:09:59 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5797worker2 # [ 152.970104] nix-grpc-daemon[1661]: time=2026-09-20T08:09:59.504Z level=INFO msg="Upload complete. (293ms)"5798lb # [ 152.950074] niks3-server[1118]: 2026/09/20 08:09:59 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5799lb # [ 152.955858] niks3-server[1118]: 2026/09/20 08:09:59 INFO Completed upload id=435800lb # [ 152.959613] niks3-server[1118]: 2026/09/20 08:09:59 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5801worker2 # [ 152.984184] nix-grpc-daemon[1582]: ts=2026-09-20T08:09:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50300 duration_s=13 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15802worker2 # [ 152.994294] nix-daemon[839]: reaped child process 1726, status = succeeded5803client # [ 153.011540] systemd[1]: sw.service: Deactivated successfully.5804client # [ 153.018071] systemd[1]: sw.service: Consumed 176ms CPU time over 15.274s wall clock time, 39.2M memory peak, 8.7K incoming IP traffic, 9K outgoing IP traffic.5805worker2 # [ 153.597148] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:00Z level=info event=signal_exit5806client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5807client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5808client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5809worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5810worker2 # [ 153.817041] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:00Z level=info event=scheduler_yield5811lb # [ 153.802088] niks3-server[1118]: 2026/09/20 08:10:00 INFO lead: released remote=192.168.1.4:569365812worker1 # [ 153.850441] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:00Z level=info event=scheduler_restarting addr=lb:500515813worker2 # [ 153.823945] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:00Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:502705814worker2 # [ 153.833113] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:00Z level=info event=worker_gone addr=192.168.1.3:500515815worker2 # [ 153.837956] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:00Z level=info event=scheduler_restarting addr=lb:500515816worker2 # [ 153.844286] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:00Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:502705817worker2 # [ 153.851007] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:00Z level=info event=worker_gone addr=192.168.1.4:500515818worker1 # [ 154.050214] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:00Z level=info event=scheduler_connected addr=lb:500515819worker1 # [ 154.057322] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5820worker2 # [ 154.032797] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:00Z level=info event=scheduler_connected addr=lb:500515821worker2 # [ 154.043485] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5822worker1 # [ 154.258410] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:00Z level=info event=scheduler_connected addr=lb:500515823worker1 # [ 154.265037] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5824worker2 # [ 154.244737] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:00Z level=info event=scheduler_connected addr=lb:500515825worker2 # [ 154.251976] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5826worker1 # [ 154.466042] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:01Z level=info event=scheduler_connected addr=lb:500515827worker1 # [ 154.472726] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5828worker2 # [ 154.453373] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:00Z level=info event=scheduler_connected addr=lb:500515829worker2 # [ 154.460132] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5830worker1 # [ 154.673498] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:01Z level=info event=scheduler_connected addr=lb:500515831worker1 # [ 154.678542] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5832worker2 # [ 154.661139] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:01Z level=info event=scheduler_connected addr=lb:500515833worker2 # [ 154.668521] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5834worker2 # [ 154.821983] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:01Z level=info event=scheduler_restarting5835worker2 # [ 154.855309] nix-daemon[839]: reaped child process 1633, status = succeeded5836worker1 # [ 154.881071] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:01Z level=info event=scheduler_connected addr=lb:500515837worker1 # [ 154.887029] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5838worker2 # [ 154.886243] nix-grpc-daemon[1582]: ts=2026-09-20T08:10:01Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5839worker1 # [ 155.087997] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:01Z level=info event=scheduler_connected addr=lb:500515840worker2 # [ 155.064456] nix-grpc-daemon[1582]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5841worker2 # [ 155.068808] nix-grpc-daemon[1582]: E0000 00:00:1789891801.597941 1625 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5842worker1 # [ 155.636464] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:02Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5843worker2 # [ 155.632626] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5844worker2 # [ 155.635565] systemd[1]: nix-grpc-daemon.service: Consumed 846ms CPU time over 28.440s wall clock time, 31.8M memory peak, 24.1K incoming IP traffic, 32.2K outgoing IP traffic.5845worker2 # [ 155.658311] systemd[1]: Starting Nix worker-protocol over gRPC...5846worker1 # [ 155.837432] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:02Z level=info event=scheduler_connected addr=lb:500515847worker1 # [ 155.844481] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5848worker2 # [ 155.864819] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:02Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5849worker2 # [ 155.867490] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:02Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15850worker2 # [ 155.875638] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:02Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5851worker2 # [ 155.890909] systemd[1]: Started Nix worker-protocol over gRPC.5852worker2 # [ 155.895104] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:02Z level=info event=scheduler_take_over5853lb # [ 155.873843] niks3-server[1118]: 2026/09/20 08:10:02 INFO lead: acquired remote=192.168.1.4:526105854worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.10 seconds)5855lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5856lb: must succeed: curl -sf localhost:9901/clusters5857worker2 # [ 155.917498] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:02Z level=info event=scheduler_connected addr=lb:500515858worker2 # [ 155.922476] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:02Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05859lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5860lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds)5861lb: must succeed: curl -sf localhost:9901/clusters5862worker1 # [ 156.049202] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:02Z level=info event=scheduler_connected addr=lb:500515863worker1 # [ 156.053619] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5864lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5865worker1 # [ 156.249152] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:02Z level=info event=scheduler_connected addr=lb:500515866worker2 # [ 156.224777] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:02Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05867lb: must succeed: curl -sf localhost:9901/clusters5868lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5869worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5870worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5871(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 19.53 seconds)5872subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5873client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15874worker2 # [ 157.476788] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:400045875worker2 # [ 157.491776] nix-daemon[839]: accepted connection from pid 1922, user nix-grpc-daemon (trusted)5876worker2 # [ 157.520232] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:04Z level=debug event=want client=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05877worker2 # [ 157.526592] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:04Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15878worker2 # [ 157.532710] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:04Z level=debug event=want client=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05879worker2 # [ 157.537808] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:04Z level=debug event=want client=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05880worker1 # [ 157.603681] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457205881worker1 # [ 157.619843] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457205882worker1 # [ 157.635258] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457205883worker1 # [ 157.650445] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5884worker1 # [ 157.856793] nix-daemon[842]: accepted connection from pid 1453, user nix-grpc-daemon (trusted)5885worker1 # [ 157.875328] nix-daemon[842]: reaped child process 1456, status = succeeded5886worker1 # [ 158.048252] nix-daemon[842]: accepted connection from pid 1458, user nix-grpc-daemon (trusted)5887worker1 # [ 158.066418] nix-daemon[842]: reaped child process 1461, status = succeeded5888lb # [ 158.033634] niks3-server[1118]: 2026/09/20 08:10:04 INFO Received uploads request method=POST path=/api/pending_closures5889worker1 # [ 158.091081] nix-grpc-daemon[1276]: time=2026-09-20T08:10:04.636Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5890worker1 # [ 158.092618] nix-grpc-daemon[1276]: time=2026-09-20T08:10:04.636Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5891lb # [ 158.063695] niks3-server[1118]: 2026/09/20 08:10:04 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5892worker1 # [ 158.124985] nix-grpc-daemon[1276]: time=2026-09-20T08:10:04.670Z level=INFO msg="Uploading 1 narinfos"5893lb # [ 158.081119] niks3-server[1118]: 2026/09/20 08:10:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5894lb # [ 158.091103] niks3-server[1118]: 2026/09/20 08:10:04 INFO Signed narinfos id=44 count=15895lb # [ 158.095570] niks3-server[1118]: 2026/09/20 08:10:04 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5896lb # [ 158.106901] niks3-server[1118]: 2026/09/20 08:10:04 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5897worker1 # [ 158.153978] nix-grpc-daemon[1276]: time=2026-09-20T08:10:04.700Z level=INFO msg="Upload complete. (487ms)"5898worker1 # [ 158.160388] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=0 paths=1 nar_bytes_in=5125899lb # [ 158.118233] niks3-server[1118]: 2026/09/20 08:10:04 INFO Completed upload id=445900worker1 # [ 158.174874] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457205901lb # [ 158.132345] niks3-server[1118]: 2026/09/20 08:10:04 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5902worker1 # [ 158.182071] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5903worker1 # [ 158.186772] nix-daemon[842]: reaped child process 1451, status = succeeded5904worker1 # [ 158.199457] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5905worker1 # [ 159.640409] nix-daemon[842]: reaped child process 1465, status = succeeded5906worker1 # [ 159.822206] nix-daemon[842]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)5907worker1 # [ 159.838246] nix-daemon[842]: reaped child process 1483, status = succeeded5908lb # [ 159.803870] niks3-server[1118]: 2026/09/20 08:10:06 INFO Received uploads request method=POST path=/api/pending_closures5909worker1 # [ 159.867233] nix-grpc-daemon[1276]: time=2026-09-20T08:10:06.410Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5910worker1 # [ 159.868839] nix-grpc-daemon[1276]: time=2026-09-20T08:10:06.410Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5911lb # [ 159.850107] niks3-server[1118]: 2026/09/20 08:10:06 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5912worker1 # [ 159.908649] nix-grpc-daemon[1276]: time=2026-09-20T08:10:06.454Z level=INFO msg="Uploading 1 narinfos"5913lb # [ 159.862218] niks3-server[1118]: 2026/09/20 08:10:06 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5914lb # [ 159.872283] niks3-server[1118]: 2026/09/20 08:10:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5915lb # [ 159.875360] niks3-server[1118]: 2026/09/20 08:10:06 INFO Signed narinfos id=45 count=15916lb # [ 159.879216] niks3-server[1118]: 2026/09/20 08:10:06 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5917lb # [ 159.887924] niks3-server[1118]: 2026/09/20 08:10:06 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5918lb # [ 159.891128] niks3-server[1118]: 2026/09/20 08:10:06 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5919lb # [ 159.894679] niks3-server[1118]: 2026/09/20 08:10:06 INFO Completed upload id=455920worker1 # [ 159.941821] nix-grpc-daemon[1276]: time=2026-09-20T08:10:06.487Z level=INFO msg="Upload complete. (332ms)"5921worker2 # [ 159.927718] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:06Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15922worker1 # [ 159.954055] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=1 outputs=15923worker2 # [ 159.937133] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:06Z level=debug event=want client=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05924worker1 # [ 159.972326] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457205925worker1 # [ 159.980714] nix-daemon[842]: reaped child process 1463, status = succeeded5926worker1 # [ 159.985006] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457205927worker1 # [ 159.994401] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457205928worker1 # [ 160.005506] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5929worker1 # [ 160.193441] nix-daemon[842]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5930worker1 # [ 160.211719] nix-daemon[842]: reaped child process 1490, status = succeeded5931worker1 # [ 160.381863] nix-daemon[842]: accepted connection from pid 1492, user nix-grpc-daemon (trusted)5932worker1 # [ 160.397402] nix-daemon[842]: reaped child process 1495, status = succeeded5933lb # [ 160.361610] niks3-server[1118]: 2026/09/20 08:10:06 INFO Received uploads request method=POST path=/api/pending_closures5934worker1 # [ 160.417875] nix-grpc-daemon[1276]: time=2026-09-20T08:10:06.963Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5935worker1 # [ 160.419556] nix-grpc-daemon[1276]: time=2026-09-20T08:10:06.963Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5936lb # [ 160.392930] niks3-server[1118]: 2026/09/20 08:10:06 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5937worker1 # [ 160.448608] nix-grpc-daemon[1276]: time=2026-09-20T08:10:06.994Z level=INFO msg="Uploading 1 narinfos"5938lb # [ 160.405989] niks3-server[1118]: 2026/09/20 08:10:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5939lb # [ 160.417864] niks3-server[1118]: 2026/09/20 08:10:06 INFO Signed narinfos id=46 count=15940lb # [ 160.427818] niks3-server[1118]: 2026/09/20 08:10:06 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5941worker1 # [ 160.480307] nix-grpc-daemon[1276]: time=2026-09-20T08:10:07.026Z level=INFO msg="Upload complete. (462ms)"5942lb # [ 160.433403] niks3-server[1118]: 2026/09/20 08:10:06 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5943lb # [ 160.438988] niks3-server[1118]: 2026/09/20 08:10:06 INFO Completed upload id=465944worker1 # [ 160.486572] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=0 paths=1 nar_bytes_in=5125945lb # [ 160.443049] niks3-server[1118]: 2026/09/20 08:10:07 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5946worker1 # [ 160.496404] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457205947worker1 # [ 160.504684] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5948worker1 # [ 160.507987] nix-daemon[842]: reaped child process 1485, status = succeeded5949worker1 # [ 160.519128] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5950lb # [ 161.082069] envoy[912]: conn peer=[2001:db8:1::1]:40906 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9499 tx=3820 ms=65385951lb # [ 161.086880] envoy[912]: conn peer=[2001:db8:1::1]:59402 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=1353 ms=149845952lb # [ 161.091646] envoy[912]: conn peer=[2001:db8:1::4]:41416 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1401 tx=529 ms=272695953worker1 # [ 161.938362] nix-daemon[842]: reaped child process 1499, status = succeeded5954worker1 # [ 162.096789] nix-daemon[842]: accepted connection from pid 1514, user nix-grpc-daemon (trusted)5955worker1 # [ 162.114221] nix-daemon[842]: reaped child process 1517, status = succeeded5956lb # [ 162.079228] niks3-server[1118]: 2026/09/20 08:10:08 INFO Received uploads request method=POST path=/api/pending_closures5957worker1 # [ 162.140273] nix-grpc-daemon[1276]: time=2026-09-20T08:10:08.683Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5958worker1 # [ 162.141724] nix-grpc-daemon[1276]: time=2026-09-20T08:10:08.683Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5959lb # [ 162.118358] niks3-server[1118]: 2026/09/20 08:10:08 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5960lb # [ 162.129982] niks3-server[1118]: 2026/09/20 08:10:08 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5961worker1 # [ 162.187890] nix-grpc-daemon[1276]: time=2026-09-20T08:10:08.733Z level=INFO msg="Uploading 1 narinfos"5962lb # [ 162.142404] niks3-server[1118]: 2026/09/20 08:10:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5963lb # [ 162.150928] niks3-server[1118]: 2026/09/20 08:10:08 INFO Signed narinfos id=47 count=15964lb # [ 162.155418] niks3-server[1118]: 2026/09/20 08:10:08 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5965lb # [ 162.163593] niks3-server[1118]: 2026/09/20 08:10:08 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5966lb # [ 162.168528] niks3-server[1118]: 2026/09/20 08:10:08 INFO Completed upload id=475967worker1 # [ 162.215211] nix-grpc-daemon[1276]: time=2026-09-20T08:10:08.761Z level=INFO msg="Upload complete. (287ms)"5968lb # [ 162.171464] niks3-server[1118]: 2026/09/20 08:10:08 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5969worker2 # [ 162.198351] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:08Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15970worker1 # [ 162.224949] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=2 outputs=15971worker1 # [ 162.241081] nix-daemon[842]: reaped child process 1497, status = succeeded5972worker2 # [ 162.210963] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:08Z level=debug event=want client=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05973worker1 # [ 162.279536] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457205974worker1 # [ 162.294779] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457205975worker1 # [ 162.309217] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457205976worker1 # [ 162.323401] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5977worker1 # [ 162.530205] nix-daemon[842]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5978worker1 # [ 162.548322] nix-daemon[842]: reaped child process 1524, status = succeeded5979worker1 # [ 162.721090] nix-daemon[842]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)5980worker1 # [ 162.737967] nix-daemon[842]: reaped child process 1529, status = succeeded5981lb # [ 162.701915] niks3-server[1118]: 2026/09/20 08:10:09 INFO Received uploads request method=POST path=/api/pending_closures5982worker1 # [ 162.759585] nix-grpc-daemon[1276]: time=2026-09-20T08:10:09.305Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5983worker1 # [ 162.761176] nix-grpc-daemon[1276]: time=2026-09-20T08:10:09.305Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5984lb # [ 162.733527] niks3-server[1118]: 2026/09/20 08:10:09 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5985worker1 # [ 162.794089] nix-grpc-daemon[1276]: time=2026-09-20T08:10:09.340Z level=INFO msg="Uploading 1 narinfos"5986lb # [ 162.750236] niks3-server[1118]: 2026/09/20 08:10:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5987lb # [ 162.758741] niks3-server[1118]: 2026/09/20 08:10:09 INFO Signed narinfos id=48 count=15988worker1 # [ 162.814819] nix-grpc-daemon[1276]: time=2026-09-20T08:10:09.361Z level=INFO msg="Upload complete. (476ms)"5989lb # [ 162.769134] niks3-server[1118]: 2026/09/20 08:10:09 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5990worker1 # [ 162.820218] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=0 paths=1 nar_bytes_in=5125991lb # [ 162.773689] niks3-server[1118]: 2026/09/20 08:10:09 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5992lb # [ 162.779068] niks3-server[1118]: 2026/09/20 08:10:09 INFO Completed upload id=485993lb # [ 162.781412] niks3-server[1118]: 2026/09/20 08:10:09 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5994worker1 # [ 162.832980] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457205995worker1 # [ 162.838923] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5996worker1 # [ 162.843246] nix-daemon[842]: reaped child process 1519, status = succeeded5997worker1 # [ 162.855332] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5998worker1 # [ 164.497315] nix-daemon[842]: reaped child process 1533, status = succeeded5999worker1 # [ 164.681165] nix-daemon[842]: accepted connection from pid 1548, user nix-grpc-daemon (trusted)6000worker1 # [ 164.698496] nix-daemon[842]: reaped child process 1551, status = succeeded6001lb # [ 164.665217] niks3-server[1118]: 2026/09/20 08:10:11 INFO Received uploads request method=POST path=/api/pending_closures6002worker1 # [ 164.721977] nix-grpc-daemon[1276]: time=2026-09-20T08:10:11.266Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6003worker1 # [ 164.723437] nix-grpc-daemon[1276]: time=2026-09-20T08:10:11.266Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"6004lb # [ 164.700471] niks3-server[1118]: 2026/09/20 08:10:11 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv6005lb # [ 164.715312] niks3-server[1118]: 2026/09/20 08:10:11 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6006lb # [ 164.725115] niks3-server[1118]: 2026/09/20 08:10:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6007worker1 # [ 164.777453] nix-grpc-daemon[1276]: time=2026-09-20T08:10:11.323Z level=INFO msg="Uploading 1 narinfos"6008lb # [ 164.732357] niks3-server[1118]: 2026/09/20 08:10:11 INFO Signed narinfos id=49 count=16009lb # [ 164.734866] niks3-server[1118]: 2026/09/20 08:10:11 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls6010lb # [ 164.744105] niks3-server[1118]: 2026/09/20 08:10:11 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6011lb # [ 164.752438] niks3-server[1118]: 2026/09/20 08:10:11 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo6012lb # [ 164.757962] niks3-server[1118]: 2026/09/20 08:10:11 INFO Completed upload id=496013worker1 # [ 164.805319] nix-grpc-daemon[1276]: time=2026-09-20T08:10:11.351Z level=INFO msg="Upload complete. (340ms)"6014worker2 # [ 164.786423] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:11Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=16015worker1 # [ 164.817092] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=3 outputs=16016worker2 # [ 164.798748] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:11Z level=debug event=want client=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=06017worker1 # [ 164.838012] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457206018worker1 # [ 164.845613] nix-daemon[842]: reaped child process 1531, status = succeeded6019worker1 # [ 164.853334] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457206020worker1 # [ 164.866639] nix-grpc-daemon[1276]: time=2026-09-20T08:10:11.412Z level=INFO msg="All 1 paths already cached"6021worker1 # [ 164.875346] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457206022worker1 # [ 164.888406] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6023worker1 # [ 165.092070] nix-daemon[842]: accepted connection from pid 1555, user nix-grpc-daemon (trusted)6024worker1 # [ 165.107367] nix-daemon[842]: reaped child process 1558, status = succeeded6025worker1 # [ 165.279799] nix-daemon[842]: accepted connection from pid 1560, user nix-grpc-daemon (trusted)6026worker1 # [ 165.295462] nix-daemon[842]: reaped child process 1563, status = succeeded6027lb # [ 165.259853] niks3-server[1118]: 2026/09/20 08:10:11 INFO Received uploads request method=POST path=/api/pending_closures6028worker1 # [ 165.316055] nix-grpc-daemon[1276]: time=2026-09-20T08:10:11.862Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6029worker1 # [ 165.317508] nix-grpc-daemon[1276]: time=2026-09-20T08:10:11.862Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"6030lb # [ 165.290994] niks3-server[1118]: 2026/09/20 08:10:11 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst6031lb # [ 165.303360] niks3-server[1118]: 2026/09/20 08:10:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6032worker1 # [ 165.358176] nix-grpc-daemon[1276]: time=2026-09-20T08:10:11.904Z level=INFO msg="Uploading 1 narinfos"6033lb # [ 165.311116] niks3-server[1118]: 2026/09/20 08:10:11 INFO Signed narinfos id=50 count=16034lb # [ 165.319999] niks3-server[1118]: 2026/09/20 08:10:11 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls6035lb # [ 165.331035] niks3-server[1118]: 2026/09/20 08:10:11 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6036worker1 # [ 165.388537] nix-grpc-daemon[1276]: time=2026-09-20T08:10:11.934Z level=INFO msg="Upload complete. (485ms)"6037lb # [ 165.341289] niks3-server[1118]: 2026/09/20 08:10:11 INFO Completed upload id=506038lb # [ 165.346255] niks3-server[1118]: 2026/09/20 08:10:11 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo6039worker1 # [ 165.396169] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=0 paths=1 nar_bytes_in=6246040worker1 # [ 165.409005] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457206041worker1 # [ 165.416240] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6042worker1 # [ 165.424240] nix-daemon[842]: reaped child process 1553, status = succeeded6043worker1 # [ 165.433808] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6044worker1 # [ 166.877325] nix-daemon[842]: reaped child process 1567, status = succeeded6045worker1 # [ 167.054698] nix-daemon[842]: accepted connection from pid 1582, user nix-grpc-daemon (trusted)6046worker1 # [ 167.071574] nix-daemon[842]: reaped child process 1585, status = succeeded6047lb # [ 167.040845] niks3-server[1118]: 2026/09/20 08:10:13 INFO Received uploads request method=POST path=/api/pending_closures6048worker1 # [ 167.097996] nix-grpc-daemon[1276]: time=2026-09-20T08:10:13.643Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6049worker1 # [ 167.103746] nix-grpc-daemon[1276]: time=2026-09-20T08:10:13.646Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"6050lb # [ 167.080433] niks3-server[1118]: 2026/09/20 08:10:13 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv6051lb # [ 167.091746] niks3-server[1118]: 2026/09/20 08:10:13 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst6052lb # [ 167.104849] niks3-server[1118]: 2026/09/20 08:10:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6053lb # [ 167.112032] niks3-server[1118]: 2026/09/20 08:10:13 INFO Signed narinfos id=51 count=16054worker1 # [ 167.159373] nix-grpc-daemon[1276]: time=2026-09-20T08:10:13.705Z level=INFO msg="Uploading 1 narinfos"6055lb # [ 167.117720] niks3-server[1118]: 2026/09/20 08:10:13 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls6056lb # [ 167.128551] niks3-server[1118]: 2026/09/20 08:10:13 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6057worker1 # [ 167.183460] nix-grpc-daemon[1276]: time=2026-09-20T08:10:13.729Z level=INFO msg="Upload complete. (338ms)"6058lb # [ 167.137885] niks3-server[1118]: 2026/09/20 08:10:13 INFO Completed upload id=516059lb # [ 167.143092] niks3-server[1118]: 2026/09/20 08:10:13 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo6060worker2 # [ 167.164956] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:13Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=16061worker1 # [ 167.196735] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=4 outputs=16062worker2 # [ 167.177783] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:13Z level=debug event=want client=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=06063worker1 # [ 167.216454] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457206064worker1 # [ 167.222954] nix-daemon[842]: reaped child process 1565, status = succeeded6065worker1 # [ 167.230996] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457206066worker1 # [ 167.245810] nix-grpc-daemon[1276]: time=2026-09-20T08:10:13.791Z level=INFO msg="All 1 paths already cached"6067worker1 # [ 167.254080] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457206068worker1 # [ 167.266293] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6069worker1 # [ 167.460390] nix-daemon[842]: accepted connection from pid 1589, user nix-grpc-daemon (trusted)6070worker1 # [ 167.479092] nix-daemon[842]: reaped child process 1592, status = succeeded6071worker1 # [ 167.646170] nix-daemon[842]: accepted connection from pid 1594, user nix-grpc-daemon (trusted)6072worker1 # [ 167.663388] nix-daemon[842]: reaped child process 1597, status = succeeded6073lb # [ 167.627889] niks3-server[1118]: 2026/09/20 08:10:14 INFO Received uploads request method=POST path=/api/pending_closures6074worker1 # [ 167.683849] nix-grpc-daemon[1276]: time=2026-09-20T08:10:14.229Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6075worker1 # [ 167.685444] nix-grpc-daemon[1276]: time=2026-09-20T08:10:14.229Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"6076lb # [ 167.652643] niks3-server[1118]: 2026/09/20 08:10:14 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst6077lb # [ 167.668083] niks3-server[1118]: 2026/09/20 08:10:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6078worker1 # [ 167.721348] nix-grpc-daemon[1276]: time=2026-09-20T08:10:14.267Z level=INFO msg="Uploading 1 narinfos"6079lb # [ 167.679950] niks3-server[1118]: 2026/09/20 08:10:14 INFO Signed narinfos id=52 count=16080lb # [ 167.683257] niks3-server[1118]: 2026/09/20 08:10:14 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls6081lb # [ 167.694273] niks3-server[1118]: 2026/09/20 08:10:14 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6082lb # [ 167.700724] niks3-server[1118]: 2026/09/20 08:10:14 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo6083lb # [ 167.705804] niks3-server[1118]: 2026/09/20 08:10:14 INFO Completed upload id=526084worker1 # [ 167.753044] nix-grpc-daemon[1276]: time=2026-09-20T08:10:14.299Z level=INFO msg="Upload complete. (472ms)"6085worker1 # [ 167.760086] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=0 paths=1 nar_bytes_in=6246086worker1 # [ 167.763951] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457206087worker1 # [ 167.777331] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6088worker1 # [ 167.782131] nix-daemon[842]: reaped child process 1587, status = succeeded6089worker1 # [ 167.795141] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6090worker1 # [ 168.614468] nix-daemon[842]: reaped child process 1601, status = succeeded6091worker1 # [ 168.772000] nix-daemon[842]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)6092worker1 # [ 168.789015] nix-daemon[842]: reaped child process 1619, status = succeeded6093lb # [ 168.755846] niks3-server[1118]: 2026/09/20 08:10:15 INFO Received uploads request method=POST path=/api/pending_closures6094worker1 # [ 168.812479] nix-grpc-daemon[1276]: time=2026-09-20T08:10:15.358Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6095worker1 # [ 168.813939] nix-grpc-daemon[1276]: time=2026-09-20T08:10:15.358Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"6096lb # [ 168.797410] niks3-server[1118]: 2026/09/20 08:10:15 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst6097worker1 # [ 168.855214] nix-grpc-daemon[1276]: time=2026-09-20T08:10:15.401Z level=INFO msg="Uploading 1 narinfos"6098lb # [ 168.812293] niks3-server[1118]: 2026/09/20 08:10:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6099lb # [ 168.821862] niks3-server[1118]: 2026/09/20 08:10:15 INFO Signed narinfos id=53 count=16100lb # [ 168.826327] niks3-server[1118]: 2026/09/20 08:10:15 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls6101worker1 # [ 168.880966] nix-grpc-daemon[1276]: time=2026-09-20T08:10:15.427Z level=INFO msg="Upload complete. (276ms)"6102lb # [ 168.834389] niks3-server[1118]: 2026/09/20 08:10:15 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv6103lb # [ 168.839349] niks3-server[1118]: 2026/09/20 08:10:15 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6104lb # [ 168.843091] niks3-server[1118]: 2026/09/20 08:10:15 INFO Completed upload id=536105worker2 # [ 168.860851] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:15Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=16106worker1 # [ 168.888837] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=5 outputs=16107lb # [ 168.845177] niks3-server[1118]: 2026/09/20 08:10:15 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo6108worker1 # [ 168.902187] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457206109worker1 # [ 168.909909] nix-daemon[842]: reaped child process 1599, status = succeeded6110worker2 # [ 168.879370] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:15Z level=debug event=want client=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=06111worker1 # [ 168.943065] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457206112worker1 # [ 168.956985] nix-grpc-daemon[1276]: time=2026-09-20T08:10:15.503Z level=INFO msg="All 1 paths already cached"6113worker1 # [ 168.965634] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457206114worker1 # [ 168.979475] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6115worker1 # [ 169.174038] nix-daemon[842]: accepted connection from pid 1623, user nix-grpc-daemon (trusted)6116worker1 # [ 169.190358] nix-daemon[842]: reaped child process 1626, status = succeeded6117worker1 # [ 169.371791] nix-daemon[842]: accepted connection from pid 1628, user nix-grpc-daemon (trusted)6118worker1 # [ 169.387962] nix-daemon[842]: reaped child process 1631, status = succeeded6119lb # [ 169.354934] niks3-server[1118]: 2026/09/20 08:10:15 INFO Received uploads request method=POST path=/api/pending_closures6120worker1 # [ 169.411123] nix-grpc-daemon[1276]: time=2026-09-20T08:10:15.957Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6121worker1 # [ 169.412778] nix-grpc-daemon[1276]: time=2026-09-20T08:10:15.957Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6122lb # [ 169.383617] niks3-server[1118]: 2026/09/20 08:10:15 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6123worker1 # [ 169.441447] nix-grpc-daemon[1276]: time=2026-09-20T08:10:15.987Z level=INFO msg="Uploading 1 narinfos"6124lb # [ 169.399280] niks3-server[1118]: 2026/09/20 08:10:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6125lb # [ 169.410301] niks3-server[1118]: 2026/09/20 08:10:15 INFO Signed narinfos id=54 count=16126lb # [ 169.414377] niks3-server[1118]: 2026/09/20 08:10:15 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6127worker1 # [ 169.472186] nix-grpc-daemon[1276]: time=2026-09-20T08:10:16.018Z level=INFO msg="Upload complete. (477ms)"6128lb # [ 169.424304] niks3-server[1118]: 2026/09/20 08:10:15 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6129lb # [ 169.430775] niks3-server[1118]: 2026/09/20 08:10:15 INFO Completed upload id=546130worker1 # [ 169.480146] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=0 paths=1 nar_bytes_in=6246131lb # [ 169.434867] niks3-server[1118]: 2026/09/20 08:10:15 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6132worker1 # [ 169.492183] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457206133worker1 # [ 169.497610] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6134worker1 # [ 169.502331] nix-daemon[842]: reaped child process 1621, status = succeeded6135worker1 # [ 169.514982] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6136worker1 # [ 170.357408] nix-daemon[842]: reaped child process 1635, status = succeeded6137worker1 # [ 170.533875] nix-daemon[842]: accepted connection from pid 1650, user nix-grpc-daemon (trusted)6138worker1 # [ 170.549778] nix-daemon[842]: reaped child process 1653, status = succeeded6139lb # [ 170.515608] niks3-server[1118]: 2026/09/20 08:10:17 INFO Received uploads request method=POST path=/api/pending_closures6140worker1 # [ 170.576620] nix-grpc-daemon[1276]: time=2026-09-20T08:10:17.119Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6141worker1 # [ 170.578111] nix-grpc-daemon[1276]: time=2026-09-20T08:10:17.119Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6142lb # [ 170.564184] niks3-server[1118]: 2026/09/20 08:10:17 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6143worker1 # [ 170.625798] nix-grpc-daemon[1276]: time=2026-09-20T08:10:17.171Z level=INFO msg="Uploading 1 narinfos"6144lb # [ 170.578650] niks3-server[1118]: 2026/09/20 08:10:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6145lb # [ 170.589076] niks3-server[1118]: 2026/09/20 08:10:17 INFO Signed narinfos id=55 count=16146lb # [ 170.591453] niks3-server[1118]: 2026/09/20 08:10:17 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6147worker1 # [ 170.648175] nix-grpc-daemon[1276]: time=2026-09-20T08:10:17.194Z level=INFO msg="Upload complete. (323ms)"6148lb # [ 170.598820] niks3-server[1118]: 2026/09/20 08:10:17 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6149lb # [ 170.607522] niks3-server[1118]: 2026/09/20 08:10:17 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6150lb # [ 170.610877] niks3-server[1118]: 2026/09/20 08:10:17 INFO Completed upload id=556151worker2 # [ 170.629240] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:17Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16152lb # [ 170.612710] niks3-server[1118]: 2026/09/20 08:10:17 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6153worker1 # [ 170.660856] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=6 outputs=16154worker1 # [ 170.676586] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457206155worker2 # [ 170.649073] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:17Z level=debug event=want client=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06156worker1 # [ 170.682994] nix-daemon[842]: reaped child process 1633, status = succeeded6157worker1 # [ 170.715086] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457206158worker1 # [ 170.729023] nix-grpc-daemon[1276]: time=2026-09-20T08:10:17.275Z level=INFO msg="All 2 paths already cached"6159worker1 # [ 170.737529] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457206160worker1 # [ 170.751405] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6161worker1 # [ 170.943871] nix-daemon[842]: accepted connection from pid 1657, user nix-grpc-daemon (trusted)6162worker1 # [ 170.961328] nix-daemon[842]: reaped child process 1660, status = succeeded6163worker1 # [ 171.133189] nix-daemon[842]: accepted connection from pid 1662, user nix-grpc-daemon (trusted)6164worker1 # [ 171.149282] nix-daemon[842]: reaped child process 1665, status = succeeded6165lb # [ 171.115185] niks3-server[1118]: 2026/09/20 08:10:17 INFO Received uploads request method=POST path=/api/pending_closures6166worker1 # [ 171.171366] nix-grpc-daemon[1276]: time=2026-09-20T08:10:17.717Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6167worker1 # [ 171.172959] nix-grpc-daemon[1276]: time=2026-09-20T08:10:17.717Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6168lb # [ 171.144530] niks3-server[1118]: 2026/09/20 08:10:17 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6169worker1 # [ 171.209552] nix-grpc-daemon[1276]: time=2026-09-20T08:10:17.755Z level=INFO msg="Uploading 1 narinfos"6170lb # [ 171.155907] niks3-server[1118]: 2026/09/20 08:10:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6171lb # [ 171.167911] niks3-server[1118]: 2026/09/20 08:10:17 INFO Signed narinfos id=56 count=16172lb # [ 171.175677] niks3-server[1118]: 2026/09/20 08:10:17 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6173worker1 # [ 171.232352] nix-grpc-daemon[1276]: time=2026-09-20T08:10:17.778Z level=INFO msg="Upload complete. (465ms)"6174lb # [ 171.186278] niks3-server[1118]: 2026/09/20 08:10:17 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6175lb # [ 171.192144] niks3-server[1118]: 2026/09/20 08:10:17 INFO Completed upload id=566176worker1 # [ 171.238664] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=0 paths=1 nar_bytes_in=7526177lb # [ 171.195821] niks3-server[1118]: 2026/09/20 08:10:17 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6178worker1 # [ 171.251499] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457206179worker1 # [ 171.257932] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6180worker1 # [ 171.262492] nix-daemon[842]: reaped child process 1655, status = succeeded6181worker1 # [ 171.275407] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6182worker1 # [ 172.326109] nix-daemon[842]: reaped child process 1669, status = succeeded6183worker1 # [ 172.505802] nix-daemon[842]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)6184worker1 # [ 172.524971] nix-daemon[842]: reaped child process 1687, status = succeeded6185lb # [ 172.490430] niks3-server[1118]: 2026/09/20 08:10:19 INFO Received uploads request method=POST path=/api/pending_closures6186worker1 # [ 172.547625] nix-grpc-daemon[1276]: time=2026-09-20T08:10:19.092Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6187worker1 # [ 172.549792] nix-grpc-daemon[1276]: time=2026-09-20T08:10:19.092Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6188lb # [ 172.527760] niks3-server[1118]: 2026/09/20 08:10:19 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6189lb # [ 172.539850] niks3-server[1118]: 2026/09/20 08:10:19 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6190worker1 # [ 172.600251] nix-grpc-daemon[1276]: time=2026-09-20T08:10:19.145Z level=INFO msg="Uploading 1 narinfos"6191lb # [ 172.554141] niks3-server[1118]: 2026/09/20 08:10:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6192lb # [ 172.562303] niks3-server[1118]: 2026/09/20 08:10:19 INFO Signed narinfos id=57 count=16193lb # [ 172.568876] niks3-server[1118]: 2026/09/20 08:10:19 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6194lb # [ 172.571706] niks3-server[1118]: 2026/09/20 08:10:19 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6195lb # [ 172.577155] niks3-server[1118]: 2026/09/20 08:10:19 INFO Completed upload id=576196worker1 # [ 172.624035] nix-grpc-daemon[1276]: time=2026-09-20T08:10:19.170Z level=INFO msg="Upload complete. (337ms)"6197lb # [ 172.579407] niks3-server[1118]: 2026/09/20 08:10:19 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6198worker2 # [ 172.604758] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:19Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16199worker1 # [ 172.637030] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=7 outputs=16200worker1 # [ 172.652497] nix-daemon[842]: reaped child process 1667, status = succeeded6201worker1 # [ 172.676330] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457206202worker1 # [ 172.691577] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457206203worker1 # [ 172.706947] nix-grpc-daemon[1276]: time=2026-09-20T08:10:19.253Z level=INFO msg="All 2 paths already cached"6204worker1 # [ 172.715871] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457206205worker1 # [ 172.729143] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6206worker1 # [ 172.930155] nix-daemon[842]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)6207worker1 # [ 172.947672] nix-daemon[842]: reaped child process 1694, status = succeeded6208worker1 # [ 173.122852] nix-daemon[842]: accepted connection from pid 1696, user nix-grpc-daemon (trusted)6209worker1 # [ 173.138472] nix-daemon[842]: reaped child process 1699, status = succeeded6210lb # [ 173.103364] niks3-server[1118]: 2026/09/20 08:10:19 INFO Received uploads request method=POST path=/api/pending_closures6211worker1 # [ 173.160097] nix-grpc-daemon[1276]: time=2026-09-20T08:10:19.706Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6212worker1 # [ 173.161542] nix-grpc-daemon[1276]: time=2026-09-20T08:10:19.706Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6213lb # [ 173.135260] niks3-server[1118]: 2026/09/20 08:10:19 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6214lb # [ 173.149083] niks3-server[1118]: 2026/09/20 08:10:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6215worker1 # [ 173.202602] nix-grpc-daemon[1276]: time=2026-09-20T08:10:19.748Z level=INFO msg="Uploading 1 narinfos"6216lb # [ 173.159834] niks3-server[1118]: 2026/09/20 08:10:19 INFO Signed narinfos id=58 count=16217lb # [ 173.167006] niks3-server[1118]: 2026/09/20 08:10:19 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6218lb # [ 173.174859] niks3-server[1118]: 2026/09/20 08:10:19 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6219lb # [ 173.181658] niks3-server[1118]: 2026/09/20 08:10:19 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6220lb # [ 173.186241] niks3-server[1118]: 2026/09/20 08:10:19 INFO Completed upload id=586221worker1 # [ 173.233147] nix-grpc-daemon[1276]: time=2026-09-20T08:10:19.779Z level=INFO msg="Upload complete. (487ms)"6222worker1 # [ 173.240447] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=0 paths=1 nar_bytes_in=7526223worker1 # [ 173.253483] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457206224worker1 # [ 173.259396] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6225worker1 # [ 173.264526] nix-daemon[842]: reaped child process 1689, status = succeeded6226worker1 # [ 173.276211] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6227worker1 # [ 174.311365] nix-daemon[842]: reaped child process 1703, status = succeeded6228worker1 # [ 174.476450] nix-daemon[842]: accepted connection from pid 1718, user nix-grpc-daemon (trusted)6229worker1 # [ 174.493026] nix-daemon[842]: reaped child process 1721, status = succeeded6230lb # [ 174.461680] niks3-server[1118]: 2026/09/20 08:10:21 INFO Received uploads request method=POST path=/api/pending_closures6231worker1 # [ 174.518198] nix-grpc-daemon[1276]: time=2026-09-20T08:10:21.062Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6232worker1 # [ 174.519677] nix-grpc-daemon[1276]: time=2026-09-20T08:10:21.062Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6233lb # [ 174.498372] niks3-server[1118]: 2026/09/20 08:10:21 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6234lb # [ 174.511404] niks3-server[1118]: 2026/09/20 08:10:21 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6235lb # [ 174.519274] niks3-server[1118]: 2026/09/20 08:10:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6236worker1 # [ 174.571707] nix-grpc-daemon[1276]: time=2026-09-20T08:10:21.117Z level=INFO msg="Uploading 1 narinfos"6237lb # [ 174.528400] niks3-server[1118]: 2026/09/20 08:10:21 INFO Signed narinfos id=59 count=16238lb # [ 174.530925] niks3-server[1118]: 2026/09/20 08:10:21 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6239lb # [ 174.540451] niks3-server[1118]: 2026/09/20 08:10:21 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6240lb # [ 174.546243] niks3-server[1118]: 2026/09/20 08:10:21 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6241lb # [ 174.551605] niks3-server[1118]: 2026/09/20 08:10:21 INFO Completed upload id=596242worker1 # [ 174.598962] nix-grpc-daemon[1276]: time=2026-09-20T08:10:21.145Z level=INFO msg="Upload complete. (311ms)"6243worker2 # [ 174.579578] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:21Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16244worker1 # [ 174.613002] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=8 outputs=16245worker1 # [ 174.626226] nix-daemon[842]: reaped child process 1701, status = succeeded6246worker1 # [ 174.651612] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457206247worker1 # [ 174.666000] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:457206248worker1 # [ 174.679371] nix-grpc-daemon[1276]: time=2026-09-20T08:10:21.225Z level=INFO msg="All 2 paths already cached"6249worker1 # [ 174.687643] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:457206250worker1 # [ 174.700667] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6251worker1 # [ 174.892666] nix-daemon[842]: accepted connection from pid 1725, user nix-grpc-daemon (trusted)6252worker1 # [ 174.910638] nix-daemon[842]: reaped child process 1728, status = succeeded6253worker1 # [ 175.081467] nix-daemon[842]: accepted connection from pid 1730, user nix-grpc-daemon (trusted)6254worker1 # [ 175.097207] nix-daemon[842]: reaped child process 1733, status = succeeded6255lb # [ 175.061406] niks3-server[1118]: 2026/09/20 08:10:21 INFO Received uploads request method=POST path=/api/pending_closures6256worker1 # [ 175.117354] nix-grpc-daemon[1276]: time=2026-09-20T08:10:21.663Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6257worker1 # [ 175.118808] nix-grpc-daemon[1276]: time=2026-09-20T08:10:21.663Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6258lb # [ 175.089253] niks3-server[1118]: 2026/09/20 08:10:21 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6259worker1 # [ 175.147355] nix-grpc-daemon[1276]: time=2026-09-20T08:10:21.693Z level=INFO msg="Uploading 1 narinfos"6260lb # [ 175.101571] niks3-server[1118]: 2026/09/20 08:10:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6261lb # [ 175.112889] niks3-server[1118]: 2026/09/20 08:10:21 INFO Signed narinfos id=60 count=16262lb # [ 175.120165] niks3-server[1118]: 2026/09/20 08:10:21 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6263worker1 # [ 175.176305] nix-grpc-daemon[1276]: time=2026-09-20T08:10:21.722Z level=INFO msg="Upload complete. (460ms)"6264lb # [ 175.130145] niks3-server[1118]: 2026/09/20 08:10:21 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6265lb # [ 175.136161] niks3-server[1118]: 2026/09/20 08:10:21 INFO Completed upload id=606266worker1 # [ 175.182505] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=0 paths=1 nar_bytes_in=7526267lb # [ 175.139921] niks3-server[1118]: 2026/09/20 08:10:21 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6268worker1 # [ 175.192274] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:457206269worker1 # [ 175.200852] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6270worker1 # [ 175.203394] nix-daemon[842]: reaped child process 1723, status = succeeded6271worker1 # [ 175.213628] nix-daemon[842]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)6272worker1 # [ 176.037251] nix-daemon[842]: reaped child process 1737, status = succeeded6273worker1 # [ 176.195646] nix-daemon[842]: accepted connection from pid 1752, user nix-grpc-daemon (trusted)6274worker1 # [ 176.214600] nix-daemon[842]: reaped child process 1755, status = succeeded6275lb # [ 176.180759] niks3-server[1118]: 2026/09/20 08:10:22 INFO Received uploads request method=POST path=/api/pending_closures6276worker1 # [ 176.239634] nix-grpc-daemon[1276]: time=2026-09-20T08:10:22.784Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6277worker1 # [ 176.241273] nix-grpc-daemon[1276]: time=2026-09-20T08:10:22.784Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6278lb # [ 176.210139] niks3-server[1118]: 2026/09/20 08:10:22 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6279lb # [ 176.223582] niks3-server[1118]: 2026/09/20 08:10:22 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6280lb # [ 176.240794] niks3-server[1118]: 2026/09/20 08:10:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6281worker1 # [ 176.294474] nix-grpc-daemon[1276]: time=2026-09-20T08:10:22.840Z level=INFO msg="Uploading 1 narinfos"6282lb # [ 176.252813] niks3-server[1118]: 2026/09/20 08:10:22 INFO Signed narinfos id=61 count=16283lb # [ 176.255962] niks3-server[1118]: 2026/09/20 08:10:22 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6284worker1 # [ 176.315583] nix-grpc-daemon[1276]: time=2026-09-20T08:10:22.861Z level=INFO msg="Upload complete. (292ms)"6285lb # [ 176.268521] niks3-server[1118]: 2026/09/20 08:10:22 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6286lb # [ 176.274716] niks3-server[1118]: 2026/09/20 08:10:22 INFO Completed upload id=616287lb # [ 176.277350] niks3-server[1118]: 2026/09/20 08:10:22 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6288worker1 # [ 176.328956] nix-grpc-daemon[1134]: ts=2026-09-20T08:10:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45720 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=9 outputs=16289worker1 # [ 176.340693] nix-daemon[842]: reaped child process 1735, status = succeeded6290client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.20 seconds)6291worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6292worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.09 seconds)6293client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16294worker2 # [ 176.746282] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:400046295worker2 # [ 176.763106] nix-grpc-daemon[1922]: ts=2026-09-20T08:10:23Z level=debug event=want client=2 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06296lb # [ 181.083940] envoy[912]: conn peer=[2001:db8:1::1]:47670 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26923 tx=10729 ms=188916297client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 120.32 seconds)6298(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 139.61 seconds)6299subtest: low disk drains a worker and builds go to the other6300worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6301worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.13 seconds)6302worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6303worker1 # [ 298.230427] nix-grpc-daemon[1134]: ts=2026-09-20T08:12:24Z level=info event=unhealthy reason=min_free6304worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds)6305client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&26306client # don't know how to build these paths:6307client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6308worker2 # [ 299.334236] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:400046309worker2 # [ 299.354696] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:25Z level=debug event=want client=3 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06310worker2 # [ 299.361811] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:25Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16311worker2 # [ 299.401474] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:400046312worker2 # [ 299.425273] nix-grpc-daemon[1922]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 1 ms (attempt 1/5)6313worker2 # [ 299.434087] nix-grpc-daemon[1922]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 176 ms (attempt 2/5)6314worker2 # [ 299.610354] nix-grpc-daemon[1922]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 3/5)6315worker2 # [ 299.675784] nix-grpc-daemon[1922]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 757 ms (attempt 4/5)6316worker2 # [ 300.441998] nix-grpc-daemon[1922]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6317worker2 # [ 300.470958] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:400046318client # copying 1 paths to 'lb:50051'...6319worker2 # [ 300.486341] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:400046320client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6321worker2 # [ 300.507869] nix-daemon[839]: accepted connection from pid 1922, user nix-grpc-daemon (trusted)6322worker2 # [ 300.541181] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:27Z level=info event=niks3_push_started pid=20016323worker2 # [ 300.931916] nix-daemon[839]: accepted connection from pid 2014, user nix-grpc-daemon (trusted)6324worker2 # [ 300.953917] nix-daemon[839]: reaped child process 2017, status = succeeded6325lb # [ 301.087189] envoy[912]: conn peer=[2001:db8:1::1]:34532 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=727 tx=456 ms=1200436326worker2 # [ 301.121354] nix-daemon[839]: accepted connection from pid 2019, user nix-grpc-daemon (trusted)6327worker2 # [ 301.140668] nix-daemon[839]: reaped child process 2022, status = succeeded6328lb # [ 301.132517] niks3-server[1118]: 2026/09/20 08:12:27 INFO Received uploads request method=POST path=/api/pending_closures6329worker2 # [ 301.167397] nix-grpc-daemon[2001]: time=2026-09-20T08:12:27.700Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6330worker2 # [ 301.169351] nix-grpc-daemon[2001]: time=2026-09-20T08:12:27.700Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6331lb # [ 301.184089] niks3-server[1118]: 2026/09/20 08:12:27 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6332worker2 # [ 301.212778] nix-grpc-daemon[2001]: time=2026-09-20T08:12:27.747Z level=INFO msg="Uploading 1 narinfos"6333lb # [ 301.192893] niks3-server[1118]: 2026/09/20 08:12:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6334lb # [ 301.201161] niks3-server[1118]: 2026/09/20 08:12:27 INFO Signed narinfos id=62 count=16335lb # [ 301.210068] niks3-server[1118]: 2026/09/20 08:12:27 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6336lb # [ 301.216508] niks3-server[1118]: 2026/09/20 08:12:27 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6337lb # [ 301.227450] niks3-server[1118]: 2026/09/20 08:12:27 INFO Completed upload id=626338lb # [ 301.230807] niks3-server[1118]: 2026/09/20 08:12:27 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6339worker2 # [ 301.246954] nix-grpc-daemon[2001]: time=2026-09-20T08:12:27.781Z level=INFO msg="Upload complete. (483ms)"6340worker2 # [ 301.256659] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40004 duration_s=0 paths=1 nar_bytes_in=5126341worker2 # [ 301.268708] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:400046342worker2 # [ 301.278733] nix-daemon[839]: accepted connection from pid 1922, user nix-grpc-daemon (trusted)6343worker2 # [ 301.284990] nix-daemon[839]: reaped child process 1999, status = succeeded6344client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6345client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6346worker2 # [ 301.298108] nix-daemon[839]: accepted connection from pid 1922, user nix-grpc-daemon (trusted)6347client # farm-a> LOG-farm-a-drain6348worker2 # [ 302.726809] nix-daemon[839]: reaped child process 2026, status = succeeded6349worker2 # [ 302.892571] nix-daemon[839]: accepted connection from pid 2041, user nix-grpc-daemon (trusted)6350worker2 # [ 302.910362] nix-daemon[839]: reaped child process 2044, status = succeeded6351lb # [ 302.902475] niks3-server[1118]: 2026/09/20 08:12:29 INFO Received uploads request method=POST path=/api/pending_closures6352worker2 # [ 302.934641] nix-grpc-daemon[2001]: time=2026-09-20T08:12:29.467Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6353worker2 # [ 302.938621] nix-grpc-daemon[2001]: time=2026-09-20T08:12:29.467Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6354lb # [ 302.934755] niks3-server[1118]: 2026/09/20 08:12:29 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6355lb # [ 302.952671] niks3-server[1118]: 2026/09/20 08:12:29 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6356lb # [ 302.968124] niks3-server[1118]: 2026/09/20 08:12:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6357worker2 # [ 302.996200] nix-grpc-daemon[2001]: time=2026-09-20T08:12:29.529Z level=INFO msg="Uploading 1 narinfos"6358lb # [ 302.975723] niks3-server[1118]: 2026/09/20 08:12:29 INFO Signed narinfos id=63 count=16359lb # [ 302.983480] niks3-server[1118]: 2026/09/20 08:12:29 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6360lb # [ 302.998589] niks3-server[1118]: 2026/09/20 08:12:29 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6361lb # [ 303.005085] niks3-server[1118]: 2026/09/20 08:12:29 INFO Completed upload id=636362worker2 # [ 303.025276] nix-grpc-daemon[2001]: time=2026-09-20T08:12:29.560Z level=INFO msg="Upload complete. (316ms)"6363lb # [ 303.008461] niks3-server[1118]: 2026/09/20 08:12:29 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6364worker2 # [ 303.044445] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40004 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=10 outputs=16365worker2 # [ 303.059613] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:29Z level=debug event=want client=3 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06366worker2 # [ 303.063565] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:29Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16367worker2 # [ 303.067758] nix-daemon[839]: reaped child process 2024, status = succeeded6368worker2 # [ 303.088348] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:400046369worker2 # [ 303.103242] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:400046370worker2 # [ 303.117020] nix-grpc-daemon[2001]: time=2026-09-20T08:12:29.651Z level=INFO msg="All 1 paths already cached"6371client # copying 1 paths to 'lb:50051'...6372client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6373worker2 # [ 303.127182] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:400046374worker2 # [ 303.141952] nix-daemon[839]: accepted connection from pid 1922, user nix-grpc-daemon (trusted)6375worker2 # [ 303.339129] nix-daemon[839]: accepted connection from pid 2050, user nix-grpc-daemon (trusted)6376worker2 # [ 303.358382] nix-daemon[839]: reaped child process 2053, status = succeeded6377worker2 # [ 303.529897] nix-daemon[839]: accepted connection from pid 2055, user nix-grpc-daemon (trusted)6378worker2 # [ 303.546608] nix-daemon[839]: reaped child process 2058, status = succeeded6379lb # [ 303.537341] niks3-server[1118]: 2026/09/20 08:12:30 INFO Received uploads request method=POST path=/api/pending_closures6380worker2 # [ 303.566632] nix-grpc-daemon[2001]: time=2026-09-20T08:12:30.101Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6381worker2 # [ 303.568156] nix-grpc-daemon[2001]: time=2026-09-20T08:12:30.101Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6382lb # [ 303.566247] niks3-server[1118]: 2026/09/20 08:12:30 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6383worker2 # [ 303.595751] nix-grpc-daemon[2001]: time=2026-09-20T08:12:30.130Z level=INFO msg="Uploading 1 narinfos"6384lb # [ 303.579810] niks3-server[1118]: 2026/09/20 08:12:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6385lb # [ 303.590609] niks3-server[1118]: 2026/09/20 08:12:30 INFO Signed narinfos id=64 count=16386lb # [ 303.594646] niks3-server[1118]: 2026/09/20 08:12:30 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6387worker2 # [ 303.624341] nix-grpc-daemon[2001]: time=2026-09-20T08:12:30.159Z level=INFO msg="Upload complete. (466ms)"6388lb # [ 303.604082] niks3-server[1118]: 2026/09/20 08:12:30 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6389lb # [ 303.609450] niks3-server[1118]: 2026/09/20 08:12:30 INFO Completed upload id=646390worker2 # [ 303.632224] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40004 duration_s=0 paths=1 nar_bytes_in=6326391lb # [ 303.613271] niks3-server[1118]: 2026/09/20 08:12:30 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6392worker2 # [ 303.642862] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:400046393worker2 # [ 303.648216] nix-daemon[839]: accepted connection from pid 1922, user nix-grpc-daemon (trusted)6394worker2 # [ 303.652408] nix-daemon[839]: reaped child process 2048, status = succeeded6395client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6396worker2 # [ 303.664558] nix-daemon[839]: accepted connection from pid 1922, user nix-grpc-daemon (trusted)6397client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6398client # farm-b> LOG-farm-b-drain6399worker2 # [ 305.299556] nix-daemon[839]: reaped child process 2062, status = succeeded6400worker2 # [ 305.459608] nix-daemon[839]: accepted connection from pid 2077, user nix-grpc-daemon (trusted)6401worker2 # [ 305.478757] nix-daemon[839]: reaped child process 2080, status = succeeded6402lb # [ 305.470998] niks3-server[1118]: 2026/09/20 08:12:32 INFO Received uploads request method=POST path=/api/pending_closures6403worker2 # [ 305.500398] nix-grpc-daemon[2001]: time=2026-09-20T08:12:32.034Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6404worker2 # [ 305.501850] nix-grpc-daemon[2001]: time=2026-09-20T08:12:32.034Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6405lb # [ 305.520403] niks3-server[1118]: 2026/09/20 08:12:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6406worker2 # [ 305.548951] nix-grpc-daemon[2001]: time=2026-09-20T08:12:32.083Z level=INFO msg="Uploading 1 narinfos"6407lb # [ 305.531443] niks3-server[1118]: 2026/09/20 08:12:32 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6408lb # [ 305.540249] niks3-server[1118]: 2026/09/20 08:12:32 INFO Signed narinfos id=65 count=16409lb # [ 305.542525] niks3-server[1118]: 2026/09/20 08:12:32 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6410lb # [ 305.547854] niks3-server[1118]: 2026/09/20 08:12:32 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6411lb # [ 305.554764] niks3-server[1118]: 2026/09/20 08:12:32 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6412lb # [ 305.559210] niks3-server[1118]: 2026/09/20 08:12:32 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6413lb # [ 305.562804] niks3-server[1118]: 2026/09/20 08:12:32 INFO Completed upload id=656414worker2 # [ 305.582832] nix-grpc-daemon[2001]: time=2026-09-20T08:12:32.117Z level=INFO msg="Upload complete. (308ms)"6415worker2 # [ 305.596941] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40004 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=11 outputs=16416worker2 # [ 305.611307] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:32Z level=debug event=want client=3 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06417worker2 # [ 305.614992] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:32Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16418worker2 # [ 305.618843] nix-daemon[839]: reaped child process 2060, status = succeeded6419worker2 # [ 305.641361] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:400046420worker2 # [ 305.656606] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:400046421worker2 # [ 305.669993] nix-grpc-daemon[2001]: time=2026-09-20T08:12:32.204Z level=INFO msg="All 2 paths already cached"6422client # copying 1 paths to 'lb:50051'...6423client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6424worker2 # [ 305.679850] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:400046425worker2 # [ 305.693893] nix-daemon[839]: accepted connection from pid 1922, user nix-grpc-daemon (trusted)6426worker2 # [ 305.885780] nix-daemon[839]: accepted connection from pid 2086, user nix-grpc-daemon (trusted)6427worker2 # [ 305.903581] nix-daemon[839]: reaped child process 2089, status = succeeded6428worker2 # [ 306.076380] nix-daemon[839]: accepted connection from pid 2091, user nix-grpc-daemon (trusted)6429worker2 # [ 306.091747] nix-daemon[839]: reaped child process 2094, status = succeeded6430lb # [ 306.086067] niks3-server[1118]: 2026/09/20 08:12:32 INFO Received uploads request method=POST path=/api/pending_closures6431worker2 # [ 306.116995] nix-grpc-daemon[2001]: time=2026-09-20T08:12:32.651Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6432worker2 # [ 306.118500] nix-grpc-daemon[2001]: time=2026-09-20T08:12:32.651Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6433lb # [ 306.117683] niks3-server[1118]: 2026/09/20 08:12:32 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6434worker2 # [ 306.150578] nix-grpc-daemon[2001]: time=2026-09-20T08:12:32.685Z level=INFO msg="Uploading 1 narinfos"6435lb # [ 306.134817] niks3-server[1118]: 2026/09/20 08:12:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6436lb # [ 306.145261] niks3-server[1118]: 2026/09/20 08:12:32 INFO Signed narinfos id=66 count=16437lb # [ 306.147978] niks3-server[1118]: 2026/09/20 08:12:32 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6438lb # [ 306.157986] niks3-server[1118]: 2026/09/20 08:12:32 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6439lb # [ 306.163119] niks3-server[1118]: 2026/09/20 08:12:32 INFO Completed upload id=666440worker2 # [ 306.182809] nix-grpc-daemon[2001]: time=2026-09-20T08:12:32.717Z level=INFO msg="Upload complete. (474ms)"6441lb # [ 306.165420] niks3-server[1118]: 2026/09/20 08:12:32 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6442worker2 # [ 306.192168] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40004 duration_s=0 paths=1 nar_bytes_in=7606443worker2 # [ 306.200525] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:400046444worker2 # [ 306.210062] nix-daemon[839]: accepted connection from pid 1922, user nix-grpc-daemon (trusted)6445worker2 # [ 306.212853] nix-daemon[839]: reaped child process 2084, status = succeeded6446client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6447worker2 # [ 306.223767] nix-daemon[839]: accepted connection from pid 1922, user nix-grpc-daemon (trusted)6448client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6449client # farm-top> LOG-farm-top-drain6450worker2 # [ 307.048343] nix-daemon[839]: reaped child process 2098, status = succeeded6451worker2 # [ 307.206882] nix-daemon[839]: accepted connection from pid 2113, user nix-grpc-daemon (trusted)6452worker2 # [ 307.225870] nix-daemon[839]: reaped child process 2116, status = succeeded6453lb # [ 307.222072] niks3-server[1118]: 2026/09/20 08:12:33 INFO Received uploads request method=POST path=/api/pending_closures6454worker2 # [ 307.250311] nix-grpc-daemon[2001]: time=2026-09-20T08:12:33.784Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6455worker2 # [ 307.253392] nix-grpc-daemon[2001]: time=2026-09-20T08:12:33.786Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6456lb # [ 307.258933] niks3-server[1118]: 2026/09/20 08:12:33 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6457lb # [ 307.270141] niks3-server[1118]: 2026/09/20 08:12:33 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6458worker2 # [ 307.301240] nix-grpc-daemon[2001]: time=2026-09-20T08:12:33.835Z level=INFO msg="Uploading 1 narinfos"6459lb # [ 307.280941] niks3-server[1118]: 2026/09/20 08:12:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6460lb # [ 307.289737] niks3-server[1118]: 2026/09/20 08:12:33 INFO Signed narinfos id=67 count=16461worker2 # [ 307.319031] nix-grpc-daemon[2001]: time=2026-09-20T08:12:33.853Z level=INFO msg="Upload complete. (283ms)"6462lb # [ 307.295807] niks3-server[1118]: 2026/09/20 08:12:33 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6463lb # [ 307.307207] niks3-server[1118]: 2026/09/20 08:12:33 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6464lb # [ 307.312238] niks3-server[1118]: 2026/09/20 08:12:33 INFO Completed upload id=676465worker2 # [ 307.328943] nix-grpc-daemon[1922]: ts=2026-09-20T08:12:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40004 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=12 outputs=16466lb # [ 307.314426] niks3-server[1118]: 2026/09/20 08:12:33 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6467worker2 # [ 307.343219] nix-daemon[839]: reaped child process 2096, status = succeeded6468client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&2, in 8.31 seconds)6469client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath6470client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath, in 0.23 seconds)6471worker1: must succeed: rm /nix/.rw-store/fill6472worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6473worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6474worker1 # [ 308.242619] nix-grpc-daemon[1134]: ts=2026-09-20T08:12:34Z level=info event=healthy reason=min_free6475worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.11 seconds)6476(finished: subtest: low disk drains a worker and builds go to the other, in 12.15 seconds)6477(finished: run the VM test script, in 309.94 seconds)6478test script finished in 310.22s6479cleanup6480kill QemuMachine (pid 49)6481client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6482kill QemuMachine (pid 50)6483lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6484kill QemuMachine (pid 52)6485worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6486kill QemuMachine (pid 51)6487worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6488(finished: cleanup, in 1.20 seconds)6489additionally exposed symbols:6490 client, lb, worker1, worker2,6491 vlan1,6492 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh