vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #419
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13worker1 # Disk image does not exist, creating the virtualisation disk image...14client # Formatting '/build/vm-state-client/tmp.SuEwRr62al', fmt=raw size=107374182415client: QEMU running (pid 49)16lb # Disk image does not exist, creating the virtualisation disk image...17lb # Formatting '/build/vm-state-lb/tmp.AuEKzAnMdb', fmt=raw size=107374182418worker1 # Formatting '/build/vm-state-worker1/tmp.VBuegUcxWb', fmt=raw size=107374182419worker1: QEMU running (pid 52)20client # mke2fs 1.47.4 (6-Mar-2025)21worker2: QEMU running (pid 51)22worker1 # mke2fs 1.47.4 (6-Mar-2025)23lb # mke2fs 1.47.4 (6-Mar-2025)24lb # Discarding device blocks: 0/262144 done25worker2 # Disk image does not exist, creating the virtualisation disk image...26worker1 # Discarding device blocks: 0/262144 done27lb: QEMU running (pid 50)28client # Discarding device blocks: 0/262144 done29lb # Creating filesystem with 262144 4k blocks and 65536 inodes30worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes31lb # Filesystem UUID: 1ad92573-7c09-4aaa-bcef-5bb997d44c3732worker1 # Filesystem UUID: f6a15bf6-91eb-45ba-9199-39e90c1f2deb33client # Creating filesystem with 262144 4k blocks and 65536 inodes34lb # Superblock backups stored on blocks:35worker1 # Superblock backups stored on blocks:36client # Filesystem UUID: 584fb091-e938-4e6f-8df8-db5944cbb7f237lb # 32768, 98304, 163840, 22937638worker1 # 32768, 98304, 163840, 22937639client # Superblock backups stored on blocks:40lb # 41worker1 # 42client # 32768, 98304, 163840, 22937643lb # Allocating group tables: 0/8 done44worker1 # Allocating group tables: 0/8 done45client # 46lb # Writing inode tables: 0/8 done47worker1 # Writing inode tables: 0/8 done48client # Allocating group tables: 0/8 done49lb # Creating journal (8192 blocks): done50worker1 # Creating journal (8192 blocks): done51client # Writing inode tables: 0/8 done52lb # Writing superblocks and filesystem accounting information: 0/8 done53worker1 # Writing superblocks and filesystem accounting information: 0/8 done54client # Creating journal (8192 blocks): done55lb # 56worker1 # 57client # Writing superblocks and filesystem accounting information: 0/8 done58lb # Virtualisation disk image created.59worker1 # Virtualisation disk image created.60client # 61(finished: start all VMs, in 0.52 seconds)62client # Virtualisation disk image created.63client: waiting for unit network-addresses-eth1.service64worker2 # Formatting '/build/vm-state-worker2/tmp.A30kHjPiqM', fmt=raw size=107374182465client: waiting for the VM to finish booting66worker2 # mke2fs 1.47.4 (6-Mar-2025)67worker2 # Discarding device blocks: 0/262144 done68worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes69worker2 # Filesystem UUID: 50b917be-b23f-4716-bbe5-8d3af0fec07d70worker2 # Superblock backups stored on blocks:71worker2 # 32768, 98304, 163840, 22937672worker2 # 73worker2 # Allocating group tables: 0/8 done74worker2 # Writing inode tables: 0/8 done75worker2 # Creating journal (8192 blocks): done76worker2 # Writing superblocks and filesystem accounting information: 0/8 done77worker2 # 78worker2 # Virtualisation disk image created.79worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681worker1 # [ 0.000000] KASLR enabled82worker1 # [ 0.000000] random: crng init done83worker1 # [ 0.000000] Machine model: linux,dummy-virt84worker1 # [ 0.000000] efi: UEFI not found.85worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88worker1 # [ 0.000000] Zone ranges:89worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90worker1 # [ 0.000000] DMA32 empty91worker1 # [ 0.000000] Normal empty92worker1 # [ 0.000000] Device empty93worker1 # [ 0.000000] Movable zone start for each node94worker1 # [ 0.000000] Early memory node ranges95worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098worker1 # [ 0.000000] psci: probing for conduit method from DT.99worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.100worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101worker1 # [ 0.000000] psci: Trusted OS migration not required102worker1 # [ 0.000000] psci: SMC Calling Convention v1.1103worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105worker1 # [ 0.000000] Detected PIPT I-cache on CPU0106worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface108worker1 # [ 0.000000] CPU features: detected: Spectre-v4109worker1 # [ 0.000000] CPU features: detected: Spectre-BHB110worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]112worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23113worker1 # [ 0.000000] alternatives: applying boot alternatives114client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026115client # [ 0.000000] KASLR enabled116client # [ 0.000000] random: crng init done117client # [ 0.000000] Machine model: linux,dummy-virt118client # [ 0.000000] efi: UEFI not found.119client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT120worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/wvalz6r5skvxvlhrfirgwz4wl61fm4va-nixos-system-worker1-test/init regInfo=/nix/store/gm51mxchc9khs4nzqasjsrv6m71341j2-closure-info/registration console=ttyAMA0,115200n8 console=tty0121client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]122client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]123client # [ 0.000000] Zone ranges:124worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/gm51mxchc9khs4nzqasjsrv6m71341j2-closure-info/registration", will be passed to user space.125client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]126client # [ 0.000000] DMA32 empty127worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes128client # [ 0.000000] Normal empty129client # [ 0.000000] Device empty130worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)131client # [ 0.000000] Movable zone start for each node132client # [ 0.000000] Early memory node ranges133worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)134client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]135worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB136lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]137worker1 # [ 0.000000] software IO TLB: area num 1.138client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]139client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000140worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB141lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026142worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]143client # [ 0.000000] psci: probing for conduit method from DT.144lb # [ 0.000000] KASLR enabled145worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)146client # [ 0.000000] psci: PSCIv1.3 detected in firmware.147lb # [ 0.000000] random: crng init done148worker1 # [ 0.000000] Fallback order for Node 0: 0149lb # [ 0.000000] Machine model: linux,dummy-virt150client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs151lb # [ 0.000000] efi: UEFI not found.152worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026153worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216154client # [ 0.000000] psci: Trusted OS migration not required155worker2 # [ 0.000000] KASLR enabled156worker1 # [ 0.000000] Policy zone: DMA157client # [ 0.000000] psci: SMC Calling Convention v1.1158worker2 # [ 0.000000] random: crng init done159lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT160worker2 # [ 0.000000] Machine model: linux,dummy-virt161worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off162lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]163worker2 # [ 0.000000] efi: UEFI not found.164client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)165worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1166lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]167worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT168client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296169worker1 # [ 0.000000] allocated 3145728 bytes of page_ext170lb # [ 0.000000] Zone ranges:171client # [ 0.000000] Detected PIPT I-cache on CPU0172worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages173worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]174lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]175lb # [ 0.000000] DMA32 empty176worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups177client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)178lb # [ 0.000000] Normal empty179worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]180lb # [ 0.000000] Device empty181worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.182worker2 # [ 0.000000] Zone ranges:183client # [ 0.000000] CPU features: detected: GICv3 CPU interface184lb # [ 0.000000] Movable zone start for each node185worker1 # [ 0.000000] rcu: RCU event tracing is enabled.186worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]187client # [ 0.000000] CPU features: detected: Spectre-v4188lb # [ 0.000000] Early memory node ranges189worker2 # [ 0.000000] DMA32 empty190worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.191client # [ 0.000000] CPU features: detected: Spectre-BHB192worker2 # [ 0.000000] Normal empty193lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]194worker2 # [ 0.000000] Device empty195worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.196client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38197worker2 # [ 0.000000] Movable zone start for each node198worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.199lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]200worker2 # [ 0.000000] Early memory node ranges201client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23202worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.203lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000204client # [ 0.000000] alternatives: applying boot alternatives205worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]206lb # [ 0.000000] psci: probing for conduit method from DT.207worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.208worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]209lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.210worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1211lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs212worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000213lb # [ 0.000000] psci: Trusted OS migration not required214worker2 # [ 0.000000] psci: probing for conduit method from DT.215worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.216lb # [ 0.000000] psci: SMC Calling Convention v1.1217worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.218worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs219worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.220lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)221client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test/init regInfo=/nix/store/rzniyzvnz3lr579n2zcxgfngii3jfr3p-closure-info/registration console=ttyAMA0,115200n8 console=tty0222worker2 # [ 0.000000] psci: Trusted OS migration not required223worker2 # [ 0.000000] psci: SMC Calling Convention v1.1224lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296225worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.226lb # [ 0.000000] Detected PIPT I-cache on CPU0227worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0228client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/rzniyzvnz3lr579n2zcxgfngii3jfr3p-closure-info/registration", will be passed to user space.229worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)230worker1 # [ 0.000000] GICv3: 256 SPIs implemented231lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)232worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented233client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes234worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296235lb # [ 0.000000] CPU features: detected: GICv3 CPU interface236worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq237worker2 # [ 0.000000] Detected PIPT I-cache on CPU0238lb # [ 0.000000] CPU features: detected: Spectre-v4239client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)240worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI241lb # [ 0.000000] CPU features: detected: Spectre-BHB242worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)243worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0244client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)245worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface246lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38247worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000248worker2 # [ 0.000000] CPU features: detected: Spectre-v4249client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB250lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23251client # [ 0.000000] software IO TLB: area num 1.252worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]253worker2 # [ 0.000000] CPU features: detected: Spectre-BHB254lb # [ 0.000000] alternatives: applying boot alternatives255client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB256worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38257worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)258worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23259client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)260worker2 # [ 0.000000] alternatives: applying boot alternatives261worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)262client # [ 0.000000] Fallback order for Node 0: 0263worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000264client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216265client # [ 0.000000] Policy zone: DMA266worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000267lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lai4n7chb0cnvnygfis27sipihspygia-nixos-system-lb-test/init regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration console=ttyAMA0,115200n8 console=tty0268client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off269worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.270client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1271client # [ 0.000000] allocated 3145728 bytes of page_ext272lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration", will be passed to user space.273worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns274worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/80z4xyfc602fv7k5faxlrpwh7krnsxf5-nixos-system-worker2-test/init regInfo=/nix/store/ghmnx54p4a7nm7im2fdspja68nj61lqr-closure-info/registration console=ttyAMA0,115200n8 console=tty0275client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages276worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).277lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes278client # [ 0.000000] ftrace: allocated 294 pages with 4 groups279client # [ 0.000000] rcu: Hierarchical RCU implementation.280lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)281worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/ghmnx54p4a7nm7im2fdspja68nj61lqr-closure-info/registration", will be passed to user space.282worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns283client # [ 0.000000] rcu: RCU event tracing is enabled.284lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)285worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes286client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.287worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns288worker1 # [ 0.000039] arm-pv: using stolen time PV289lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB290client # [ 0.000000] Trampoline variant of Tasks RCU enabled.291worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)292lb # [ 0.000000] software IO TLB: area num 1.293client # [ 0.000000] Rude variant of Tasks RCU enabled.294client # [ 0.000000] Tracing variant of Tasks RCU enabled.295worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)296worker1 # [ 0.000737] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)297lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB298worker1 # [ 0.000912] Console: colour dummy device 80x25299worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB300client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.301lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)302worker1 # [ 0.000919] printk: legacy console [tty0] enabled303worker2 # [ 0.000000] software IO TLB: area num 1.304lb # [ 0.000000] Fallback order for Node 0: 0305client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1306worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB307lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216308worker1 # [ 0.001112] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)309lb # [ 0.000000] Policy zone: DMA310client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.311worker1 # [ 0.001120] pid_max: default: 32768 minimum: 301312worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)313worker2 # [ 0.000000] Fallback order for Node 0: 0314lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off315worker1 # [ 0.001192] LSM: initializing lsm=capability,landlock,yama,bpf,ima316client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.317worker1 # [ 0.001376] landlock: Up and running.318lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1319worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216320worker1 # [ 0.001378] Yama: becoming mindful.321worker2 # [ 0.000000] Policy zone: DMA322lb # [ 0.000000] allocated 3145728 bytes of page_ext323worker1 # [ 0.002093] LSM support for eBPF active324client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.325lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages326worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off327client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0328lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups329worker1 # [ 0.002301] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)330client # [ 0.000000] GICv3: 256 SPIs implemented331worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1332lb # [ 0.000000] rcu: Hierarchical RCU implementation.333client # [ 0.000000] GICv3: 0 Extended SPIs implemented334worker1 # [ 0.002335] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)335worker2 # [ 0.000000] allocated 3145728 bytes of page_ext336lb # [ 0.000000] rcu: RCU event tracing is enabled.337client # [ 0.000000] Root IRQ handler: gic_handle_irq338worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages339worker1 # [ 0.003571] cacheinfo: Unable to detect cache hierarchy for CPU 0340client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI341lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.342worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups343worker1 # [ 0.004368] rcu: Hierarchical SRCU implementation.344client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0345lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.346worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.347worker1 # [ 0.004372] rcu: Max phase no-delay instances is 1000.348lb # [ 0.000000] Rude variant of Tasks RCU enabled.349worker2 # [ 0.000000] rcu: RCU event tracing is enabled.350client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000351worker1 # [ 0.005609] fsl-mc MSI: its@8080000 domain created352client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]353lb # [ 0.000000] Tracing variant of Tasks RCU enabled.354worker1 # [ 0.005698] EFI services will not be available.355worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.356worker1 # [ 0.005782] smp: Bringing up secondary CPUs ...357worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.358lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.359client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)360worker1 # [ 0.005791] smp: Brought up 1 node, 1 CPU361worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.362lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1363worker1 # [ 0.005794] SMP: Total of 1 processors activated.364worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.365worker1 # [ 0.005801] CPU: All CPU(s) started at EL1366client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)367lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.368worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.369client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000370worker1 # [ 0.005812] CPU features: detected: Branch Target Identification371worker1 # [ 0.005817] CPU features: detected: ARMv8.4 Translation Table Level372worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1373client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000374lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.375client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.376worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.377lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.378worker1 # [ 0.005820] CPU features: detected: Instruction cache invalidation not required for I/D coherence379lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0380worker1 # [ 0.005823] CPU features: detected: Data cache clean to the PoU not required for I/D coherence381client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns382worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.383lb # [ 0.000000] GICv3: 256 SPIs implemented384worker1 # [ 0.005827] CPU features: detected: Common not Private translations385lb # [ 0.000000] GICv3: 0 Extended SPIs implemented386client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).387worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.388lb # [ 0.000000] Root IRQ handler: gic_handle_irq389worker1 # [ 0.005830] CPU features: detected: CRC32 instructions390worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0391lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI392client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns393worker2 # [ 0.000000] GICv3: 256 SPIs implemented394worker1 # [ 0.005833] CPU features: detected: Data cache clean to Point of Deep Persistence395lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0396worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented397client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns398worker1 # [ 0.005837] CPU features: detected: Data cache clean to Point of Persistence399lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000400worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq401client # [ 0.000036] arm-pv: using stolen time PV402lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]403worker1 # [ 0.005840] CPU features: detected: Data independent timing control (DIT)404worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI405worker1 # [ 0.005843] CPU features: detected: E0PD406worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0407client # [ 0.000597] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)408lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)409worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000410worker1 # [ 0.005845] CPU features: detected: Enhanced Counter Virtualization411client # [ 0.000769] Console: colour dummy device 80x25412worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]413client # [ 0.000777] printk: legacy console [tty0] enabled414worker1 # [ 0.005848] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)415lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)416worker1 # [ 0.005851] CPU features: detected: Enhanced Virtualization Traps417lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000418worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)419client # [ 0.001002] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)420worker1 # [ 0.005855] CPU features: detected: Fine Grained Traps421client # [ 0.001011] pid_max: default: 32768 minimum: 301422lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000423worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)424worker1 # [ 0.005858] CPU features: detected: Generic authentication (architected QARMA5 algorithm)425client # [ 0.001086] LSM: initializing lsm=capability,landlock,yama,bpf,ima426lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.427worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000428client # [ 0.001212] landlock: Up and running.429worker1 # [ 0.005863] CPU features: detected: RCpc load-acquire (LDAPR)430client # [ 0.001215] Yama: becoming mindful.431worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000432lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns433worker1 # [ 0.005866] CPU features: detected: LSE atomic instructions434client # [ 0.001702] LSM support for eBPF active435worker1 # [ 0.005870] CPU features: detected: Privileged Access Never436worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.437lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).438client # [ 0.001839] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)439worker1 # [ 0.005872] CPU features: detected: PMUv3440worker1 # [ 0.005874] CPU features: detected: RAS Extension Support441client # [ 0.001872] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)442worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns443lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns444worker1 # [ 0.005877] CPU features: detected: RASv1p1 Extension Support445client # [ 0.003060] cacheinfo: Unable to detect cache hierarchy for CPU 0446worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).447lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns448worker1 # [ 0.005880] CPU features: detected: Random Number Generator449client # [ 0.003849] rcu: Hierarchical SRCU implementation.450lb # [ 0.000033] arm-pv: using stolen time PV451worker1 # [ 0.005882] CPU features: detected: Speculation barrier (SB)452client # [ 0.003854] rcu: Max phase no-delay instances is 1000.453worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns454worker1 # [ 0.005885] CPU features: detected: Stage-2 Force Write-Back455lb # [ 0.000445] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)456client # [ 0.005096] fsl-mc MSI: its@8080000 domain created457worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns458client # [ 0.005189] EFI services will not be available.459lb # [ 0.000602] Console: colour dummy device 80x25460worker1 # [ 0.005888] CPU features: detected: TLB range maintenance instructions461worker2 # [ 0.000034] arm-pv: using stolen time PV462client # [ 0.005271] smp: Bringing up secondary CPUs ...463lb # [ 0.000610] printk: legacy console [tty0] enabled464worker1 # [ 0.005893] CPU features: detected: Speculative Store Bypassing Safe (SSBS)465client # [ 0.005281] smp: Brought up 1 node, 1 CPU466worker2 # [ 0.000504] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)467client # [ 0.005284] SMP: Total of 1 processors activated.468worker1 # [ 0.005944] alternatives: applying system-wide alternatives469lb # [ 0.000805] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)470worker2 # [ 0.000731] Console: colour dummy device 80x25471client # [ 0.005289] CPU: All CPU(s) started at EL1472lb # [ 0.000813] pid_max: default: 32768 minimum: 301473worker1 # [ 0.009112] CPU features: detected: BBM Level 2 without TLB conflict abort474worker2 # [ 0.000739] printk: legacy console [tty0] enabled475client # [ 0.005300] CPU features: detected: Branch Target Identification476lb # [ 0.000886] LSM: initializing lsm=capability,landlock,yama,bpf,ima477lb # [ 0.001025] landlock: Up and running.478client # [ 0.005305] CPU features: detected: ARMv8.4 Translation Table Level479worker2 # [ 0.000936] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)480lb # [ 0.001028] Yama: becoming mindful.481worker1 # [ 0.009284] Memory: 1406564K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)482worker2 # [ 0.000944] pid_max: default: 32768 minimum: 301483worker1 # [ 0.009722] devtmpfs: initialized484client # [ 0.005312] CPU features: detected: Instruction cache invalidation not required for I/D coherence485lb # [ 0.001572] LSM support for eBPF active486worker2 # [ 0.001023] LSM: initializing lsm=capability,landlock,yama,bpf,ima487lb # [ 0.001733] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)488worker1 # [ 0.011716] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)489client # [ 0.005317] CPU features: detected: Data cache clean to the PoU not required for I/D coherence490worker2 # [ 0.001190] landlock: Up and running.491worker2 # [ 0.001195] Yama: becoming mindful.492lb # [ 0.001776] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)493client # [ 0.005321] CPU features: detected: Common not Private translations494worker1 # [ 0.011740] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).495worker2 # [ 0.001683] LSM support for eBPF active496client # [ 0.005324] CPU features: detected: CRC32 instructions497lb # [ 0.002994] cacheinfo: Unable to detect cache hierarchy for CPU 0498worker1 # [ 0.011935] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL499worker2 # [ 0.001841] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)500lb # [ 0.003782] rcu: Hierarchical SRCU implementation.501worker1 # [ 0.011940] 0 pages in range for non-PLT usage502client # [ 0.005327] CPU features: detected: Data cache clean to Point of Deep Persistence503worker1 # [ 0.011941] 508288 pages in range for PLT usage504lb # [ 0.003786] rcu: Max phase no-delay instances is 1000.505worker2 # [ 0.001876] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)506client # [ 0.005331] CPU features: detected: Data cache clean to Point of Persistence507worker1 # [ 0.012040] pinctrl core: initialized pinctrl subsystem508lb # [ 0.005017] fsl-mc MSI: its@8080000 domain created509worker2 # [ 0.003049] cacheinfo: Unable to detect cache hierarchy for CPU 0510lb # [ 0.005119] EFI services will not be available.511worker1 # [ 0.012837] DMI not present or invalid.512client # [ 0.005334] CPU features: detected: Data independent timing control (DIT)513worker2 # [ 0.003817] rcu: Hierarchical SRCU implementation.514lb # [ 0.005187] smp: Bringing up secondary CPUs ...515worker1 # [ 0.016515] NET: Registered PF_NETLINK/PF_ROUTE protocol family516client # [ 0.005337] CPU features: detected: E0PD517worker2 # [ 0.003823] rcu: Max phase no-delay instances is 1000.518lb # [ 0.005196] smp: Brought up 1 node, 1 CPU519client # [ 0.005340] CPU features: detected: Enhanced Counter Virtualization520worker1 # [ 0.019334] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations521worker2 # [ 0.005100] fsl-mc MSI: its@8080000 domain created522lb # [ 0.005199] SMP: Total of 1 processors activated.523lb # [ 0.005204] CPU: All CPU(s) started at EL1524worker2 # [ 0.005193] EFI services will not be available.525client # [ 0.005343] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)526worker1 # [ 0.019546] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations527worker2 # [ 0.005311] smp: Bringing up secondary CPUs ...528lb # [ 0.005216] CPU features: detected: Branch Target Identification529client # [ 0.005346] CPU features: detected: Enhanced Virtualization Traps530worker2 # [ 0.005320] smp: Brought up 1 node, 1 CPU531worker1 # [ 0.019754] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations532lb # [ 0.005221] CPU features: detected: ARMv8.4 Translation Table Level533client # [ 0.005349] CPU features: detected: Fine Grained Traps534worker2 # [ 0.005323] SMP: Total of 1 processors activated.535worker1 # [ 0.019781] audit: initializing netlink subsys (disabled)536worker2 # [ 0.005329] CPU: All CPU(s) started at EL1537lb # [ 0.005224] CPU features: detected: Instruction cache invalidation not required for I/D coherence538client # [ 0.005352] CPU features: detected: Generic authentication (architected QARMA5 algorithm)539worker1 # [ 0.020421] thermal_sys: Registered thermal governor 'fair_share'540worker2 # [ 0.005341] CPU features: detected: Branch Target Identification541client # [ 0.005357] CPU features: detected: RCpc load-acquire (LDAPR)542worker1 # [ 0.020423] thermal_sys: Registered thermal governor 'bang_bang'543lb # [ 0.005227] CPU features: detected: Data cache clean to the PoU not required for I/D coherence544worker2 # [ 0.005346] CPU features: detected: ARMv8.4 Translation Table Level545client # [ 0.005360] CPU features: detected: LSE atomic instructions546lb # [ 0.005231] CPU features: detected: Common not Private translations547client # [ 0.005363] CPU features: detected: Privileged Access Never548worker2 # [ 0.005349] CPU features: detected: Instruction cache invalidation not required for I/D coherence549worker1 # [ 0.020427] thermal_sys: Registered thermal governor 'step_wise'550client # [ 0.005366] CPU features: detected: PMUv3551lb # [ 0.005234] CPU features: detected: CRC32 instructions552worker1 # [ 0.020432] thermal_sys: Registered thermal governor 'user_space'553worker2 # [ 0.005353] CPU features: detected: Data cache clean to the PoU not required for I/D coherence554lb # [ 0.005237] CPU features: detected: Data cache clean to Point of Deep Persistence555client # [ 0.005368] CPU features: detected: RAS Extension Support556worker2 # [ 0.005356] CPU features: detected: Common not Private translations557worker1 # [ 0.020435] thermal_sys: Registered thermal governor 'power_allocator'558lb # [ 0.005241] CPU features: detected: Data cache clean to Point of Persistence559worker2 # [ 0.005360] CPU features: detected: CRC32 instructions560client # [ 0.005371] CPU features: detected: RASv1p1 Extension Support561worker1 # [ 0.020478] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1562lb # [ 0.005244] CPU features: detected: Data independent timing control (DIT)563worker1 # [ 0.020487] cpuidle: using governor ladder564lb # [ 0.005247] CPU features: detected: E0PD565client # [ 0.005374] CPU features: detected: Random Number Generator566worker2 # [ 0.005362] CPU features: detected: Data cache clean to Point of Deep Persistence567worker1 # [ 0.020493] cpuidle: using governor menu568client # [ 0.005376] CPU features: detected: Speculation barrier (SB)569lb # [ 0.005249] CPU features: detected: Enhanced Counter Virtualization570worker2 # [ 0.005366] CPU features: detected: Data cache clean to Point of Persistence571worker1 # [ 0.020700] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.572client # [ 0.005379] CPU features: detected: Stage-2 Force Write-Back573lb # [ 0.005252] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)574worker2 # [ 0.005369] CPU features: detected: Data independent timing control (DIT)575worker1 # [ 0.020718] ASID allocator initialised with 65536 entries576client # [ 0.005382] CPU features: detected: TLB range maintenance instructions577worker2 # [ 0.005372] CPU features: detected: E0PD578lb # [ 0.005255] CPU features: detected: Enhanced Virtualization Traps579worker1 # [ 0.022020] Serial: AMBA PL011 UART driver580worker2 # [ 0.005374] CPU features: detected: Enhanced Counter Virtualization581lb # [ 0.005258] CPU features: detected: Fine Grained Traps582client # [ 0.005387] CPU features: detected: Speculative Store Bypassing Safe (SSBS)583worker1 # [ 0.027380] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1584client # [ 0.005427] alternatives: applying system-wide alternatives585worker2 # [ 0.005378] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)586lb # [ 0.005262] CPU features: detected: Generic authentication (architected QARMA5 algorithm)587worker1 # [ 0.027517] printk: console [ttyAMA0] enabled588client # [ 0.008505] CPU features: detected: BBM Level 2 without TLB conflict abort589lb # [ 0.005267] CPU features: detected: RCpc load-acquire (LDAPR)590worker2 # [ 0.005381] CPU features: detected: Enhanced Virtualization Traps591worker2 # [ 0.005384] CPU features: detected: Fine Grained Traps592lb # [ 0.005270] CPU features: detected: LSE atomic instructions593lb # [ 0.005272] CPU features: detected: Privileged Access Never594worker2 # [ 0.005388] CPU features: detected: Generic authentication (architected QARMA5 algorithm)595client # [ 0.008731] Memory: 1406512K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)596lb # [ 0.005275] CPU features: detected: PMUv3597client # [ 0.009133] devtmpfs: initialized598worker2 # [ 0.005393] CPU features: detected: RCpc load-acquire (LDAPR)599lb # [ 0.005278] CPU features: detected: RAS Extension Support600client # [ 0.011135] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)601worker2 # [ 0.005396] CPU features: detected: LSE atomic instructions602lb # [ 0.005281] CPU features: detected: RASv1p1 Extension Support603worker2 # [ 0.005399] CPU features: detected: Privileged Access Never604lb # [ 0.005283] CPU features: detected: Random Number Generator605client # [ 0.011166] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).606worker2 # [ 0.005402] CPU features: detected: PMUv3607lb # [ 0.005286] CPU features: detected: Speculation barrier (SB)608client # [ 0.011399] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL609worker2 # [ 0.005404] CPU features: detected: RAS Extension Support610client # [ 0.011403] 0 pages in range for non-PLT usage611lb # [ 0.005289] CPU features: detected: Stage-2 Force Write-Back612worker2 # [ 0.005407] CPU features: detected: RASv1p1 Extension Support613client # [ 0.011404] 508288 pages in range for PLT usage614lb # [ 0.005292] CPU features: detected: TLB range maintenance instructions615worker2 # [ 0.005410] CPU features: detected: Random Number Generator616client # [ 0.011527] pinctrl core: initialized pinctrl subsystem617worker2 # [ 0.005412] CPU features: detected: Speculation barrier (SB)618lb # [ 0.005296] CPU features: detected: Speculative Store Bypassing Safe (SSBS)619client # [ 0.012344] DMI not present or invalid.620worker2 # [ 0.005415] CPU features: detected: Stage-2 Force Write-Back621lb # [ 0.005335] alternatives: applying system-wide alternatives622client # [ 0.015637] NET: Registered PF_NETLINK/PF_ROUTE protocol family623worker2 # [ 0.005418] CPU features: detected: TLB range maintenance instructions624lb # [ 0.008495] CPU features: detected: BBM Level 2 without TLB conflict abort625client # [ 0.018092] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations626worker2 # [ 0.005423] CPU features: detected: Speculative Store Bypassing Safe (SSBS)627client # [ 0.018287] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations628worker1 # [ 0.149997] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages629worker2 # [ 0.005461] alternatives: applying system-wide alternatives630lb # [ 0.008719] Memory: 1406552K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)631worker1 # [ 0.150021] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page632client # [ 0.018488] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations633lb # [ 0.009163] devtmpfs: initialized634worker2 # [ 0.008541] CPU features: detected: BBM Level 2 without TLB conflict abort635client # [ 0.018511] audit: initializing netlink subsys (disabled)636worker1 # [ 0.150026] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages637lb # [ 0.011098] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)638client # [ 0.019102] thermal_sys: Registered thermal governor 'fair_share'639worker1 # [ 0.150031] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page640worker2 # [ 0.008778] Memory: 1406524K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)641client # [ 0.019104] thermal_sys: Registered thermal governor 'bang_bang'642worker1 # [ 0.150035] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages643worker2 # [ 0.009217] devtmpfs: initialized644client # [ 0.019108] thermal_sys: Registered thermal governor 'step_wise'645lb # [ 0.011129] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).646worker1 # [ 0.150039] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page647worker2 # [ 0.011233] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)648lb # [ 0.011323] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL649client # [ 0.019113] thermal_sys: Registered thermal governor 'user_space'650worker1 # [ 0.150044] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages651lb # [ 0.011328] 0 pages in range for non-PLT usage652client # [ 0.019116] thermal_sys: Registered thermal governor 'power_allocator'653worker2 # [ 0.011257] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).654worker1 # [ 0.150048] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page655lb # [ 0.011329] 508288 pages in range for PLT usage656worker2 # [ 0.011459] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL657client # [ 0.019141] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1658lb # [ 0.011447] pinctrl core: initialized pinctrl subsystem659worker2 # [ 0.011463] 0 pages in range for non-PLT usage660client # [ 0.019150] cpuidle: using governor ladder661lb # [ 0.012227] DMI not present or invalid.662client # [ 0.019156] cpuidle: using governor menu663worker2 # [ 0.011464] 508288 pages in range for PLT usage664lb # [ 0.015888] NET: Registered PF_NETLINK/PF_ROUTE protocol family665worker2 # [ 0.011562] pinctrl core: initialized pinctrl subsystem666worker1 # [ 0.157477] fbcon: Taking over console667client # [ 0.019344] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.668worker2 # [ 0.012366] DMI not present or invalid.669lb # [ 0.018252] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations670worker1 # [ 0.157494] ACPI: Interpreter disabled.671client # [ 0.019360] ASID allocator initialised with 65536 entries672worker2 # [ 0.015733] NET: Registered PF_NETLINK/PF_ROUTE protocol family673client # [ 0.020573] Serial: AMBA PL011 UART driver674lb # [ 0.018442] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations675worker2 # [ 0.018160] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations676client # [ 0.025892] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1677lb # [ 0.018654] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations678client # [ 0.026042] printk: console [ttyAMA0] enabled679worker2 # [ 0.018342] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations680lb # [ 0.018679] audit: initializing netlink subsys (disabled)681lb # [ 0.019268] thermal_sys: Registered thermal governor 'fair_share'682worker2 # [ 0.018551] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations683lb # [ 0.019270] thermal_sys: Registered thermal governor 'bang_bang'684worker2 # [ 0.018574] audit: initializing netlink subsys (disabled)685lb # [ 0.019273] thermal_sys: Registered thermal governor 'step_wise'686worker2 # [ 0.019180] thermal_sys: Registered thermal governor 'fair_share'687lb # [ 0.019279] thermal_sys: Registered thermal governor 'user_space'688worker2 # [ 0.019183] thermal_sys: Registered thermal governor 'bang_bang'689lb # [ 0.019281] thermal_sys: Registered thermal governor 'power_allocator'690worker2 # [ 0.019187] thermal_sys: Registered thermal governor 'step_wise'691worker2 # [ 0.019192] thermal_sys: Registered thermal governor 'user_space'692lb # [ 0.019314] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1693lb # [ 0.019322] cpuidle: using governor ladder694worker2 # [ 0.019195] thermal_sys: Registered thermal governor 'power_allocator'695lb # [ 0.019328] cpuidle: using governor menu696worker1 # [ 0.166283] iommu: Default domain type: Translated697worker2 # [ 0.019233] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1698worker1 # [ 0.166297] iommu: DMA domain TLB invalidation policy: strict mode699lb # [ 0.019519] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.700worker2 # [ 0.019241] cpuidle: using governor ladder701worker1 # [ 0.166691] SCSI subsystem initialized702lb # [ 0.019535] ASID allocator initialised with 65536 entries703worker2 # [ 0.019247] cpuidle: using governor menu704lb # [ 0.020752] Serial: AMBA PL011 UART driver705worker2 # [ 0.019449] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.706worker1 # [ 0.168692] usbcore: registered new interface driver usbfs707lb # [ 0.026140] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1708worker2 # [ 0.019466] ASID allocator initialised with 65536 entries709worker1 # [ 0.168726] usbcore: registered new interface driver hub710lb # [ 0.026337] printk: console [ttyAMA0] enabled711worker2 # [ 0.020777] Serial: AMBA PL011 UART driver712client # [ 0.147982] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages713worker1 # [ 0.168745] usbcore: registered new device driver usb714client # [ 0.148004] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page715worker1 # [ 0.169035] pps_core: LinuxPPS API ver. 1 registered716worker2 # [ 0.026594] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1717worker2 # [ 0.026779] printk: console [ttyAMA0] enabled718client # [ 0.148009] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages719worker1 # [ 0.169041] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>720client # [ 0.148013] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page721worker1 # [ 0.169051] PTP clock support registered722worker1 # [ 0.169099] EDAC MC: Ver: 3.0.0723client # [ 0.148018] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages724worker1 # [ 0.173703] scmi_core: SCMI protocol bus registered725client # [ 0.148022] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page726worker1 # [ 0.174783] FPGA manager framework727client # [ 0.148027] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages728worker1 # [ 0.175732] vgaarb: loaded729client # [ 0.148031] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page730worker1 # [ 0.176374] clocksource: Switched to clocksource arch_sys_counter731client # [ 0.155688] fbcon: Taking over console732worker1 # [ 0.178098] VFS: Disk quotas dquot_6.6.0733client # [ 0.155707] ACPI: Interpreter disabled.734worker1 # [ 0.178136] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)735lb # [ 0.147390] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages736lb # [ 0.147411] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page737worker2 # [ 0.147809] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages738lb # [ 0.147416] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages739worker2 # [ 0.147831] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page740lb # [ 0.147420] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page741worker1 # [ 0.182150] netfs: FS-Cache loaded742worker1 # [ 0.182294] pnp: PnP ACPI: disabled743worker2 # [ 0.147837] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages744lb # [ 0.147424] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages745lb # [ 0.147429] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page746worker2 # [ 0.147841] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page747lb # [ 0.147433] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages748worker2 # [ 0.147846] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages749lb # [ 0.147437] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page750worker2 # [ 0.147850] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page751worker2 # [ 0.147854] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages752client # [ 0.164298] iommu: Default domain type: Translated753worker2 # [ 0.147858] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page754client # [ 0.164311] iommu: DMA domain TLB invalidation policy: strict mode755lb # [ 0.155205] fbcon: Taking over console756client # [ 0.164736] SCSI subsystem initialized757lb # [ 0.155222] ACPI: Interpreter disabled.758worker1 # [ 0.186402] NET: Registered PF_INET protocol family759client # [ 0.166771] usbcore: registered new interface driver usbfs760worker1 # [ 0.186685] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)761worker2 # [ 0.155925] fbcon: Taking over console762client # [ 0.166805] usbcore: registered new interface driver hub763worker2 # [ 0.155943] ACPI: Interpreter disabled.764client # [ 0.166823] usbcore: registered new device driver usb765client # [ 0.167132] pps_core: LinuxPPS API ver. 1 registered766client # [ 0.167138] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>767client # [ 0.167147] PTP clock support registered768client # [ 0.167198] EDAC MC: Ver: 3.0.0769client # [ 0.172051] scmi_core: SCMI protocol bus registered770client # [ 0.173093] FPGA manager framework771client # [ 0.174128] vgaarb: loaded772lb # [ 0.163803] iommu: Default domain type: Translated773client # [ 0.174808] clocksource: Switched to clocksource arch_sys_counter774lb # [ 0.163816] iommu: DMA domain TLB invalidation policy: strict mode775worker2 # [ 0.163572] iommu: Default domain type: Translated776lb # [ 0.164246] SCSI subsystem initialized777worker2 # [ 0.163584] iommu: DMA domain TLB invalidation policy: strict mode778worker2 # [ 0.163982] SCSI subsystem initialized779lb # [ 0.166315] usbcore: registered new interface driver usbfs780client # [ 0.176868] VFS: Disk quotas dquot_6.6.0781lb # [ 0.166349] usbcore: registered new interface driver hub782client # [ 0.176906] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)783worker2 # [ 0.166097] usbcore: registered new interface driver usbfs784lb # [ 0.166374] usbcore: registered new device driver usb785worker2 # [ 0.166129] usbcore: registered new interface driver hub786lb # [ 0.166677] pps_core: LinuxPPS API ver. 1 registered787worker2 # [ 0.166148] usbcore: registered new device driver usb788worker2 # [ 0.166498] pps_core: LinuxPPS API ver. 1 registered789lb # [ 0.166683] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>790lb # [ 0.166694] PTP clock support registered791lb # [ 0.166763] EDAC MC: Ver: 3.0.0792client # [ 0.180736] netfs: FS-Cache loaded793worker2 # [ 0.166508] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>794client # [ 0.180875] pnp: PnP ACPI: disabled795worker2 # [ 0.166519] PTP clock support registered796lb # [ 0.171501] scmi_core: SCMI protocol bus registered797worker2 # [ 0.166572] EDAC MC: Ver: 3.0.0798worker2 # [ 0.171347] scmi_core: SCMI protocol bus registered799lb # [ 0.172541] FPGA manager framework800lb # [ 0.173581] vgaarb: loaded801worker2 # [ 0.172375] FPGA manager framework802worker2 # [ 0.173424] vgaarb: loaded803lb # [ 0.174280] clocksource: Switched to clocksource arch_sys_counter804worker2 # [ 0.174115] clocksource: Switched to clocksource arch_sys_counter805lb # [ 0.176228] VFS: Disk quotas dquot_6.6.0806client # [ 0.184840] NET: Registered PF_INET protocol family807lb # [ 0.176273] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)808client # [ 0.185127] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)809worker2 # [ 0.178023] VFS: Disk quotas dquot_6.6.0810worker2 # [ 0.178063] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)811lb # [ 0.180135] netfs: FS-Cache loaded812lb # [ 0.180277] pnp: PnP ACPI: disabled813worker2 # [ 0.181868] netfs: FS-Cache loaded814worker2 # [ 0.182003] pnp: PnP ACPI: disabled815lb # [ 0.184356] NET: Registered PF_INET protocol family816lb # [ 0.184628] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)817worker2 # [ 0.186066] NET: Registered PF_INET protocol family818worker2 # [ 0.187009] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)819worker1 # [ 0.217128] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)820worker1 # [ 0.217189] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)821worker1 # [ 0.217226] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)822worker1 # [ 0.217306] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)823worker1 # [ 0.217452] TCP: Hash tables configured (established 16384 bind 16384)824worker1 # [ 0.217557] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)825worker1 # [ 0.217594] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)826worker1 # [ 0.217631] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)827worker1 # [ 0.217746] NET: Registered PF_UNIX/PF_LOCAL protocol family828worker1 # [ 0.217800] NET: Registered PF_XDP protocol family829worker1 # [ 0.217819] PCI: CLS 0 bytes, default 64830worker1 # [ 0.218097] Trying to unpack rootfs image as initramfs...831worker1 # [ 0.234278] kvm [1]: HYP mode not available832client # [ 0.215494] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833client # [ 0.215555] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834client # [ 0.215588] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835client # [ 0.215675] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)836client # [ 0.215821] TCP: Hash tables configured (established 16384 bind 16384)837client # [ 0.215930] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)838client # [ 0.215972] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)839client # [ 0.216009] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)840client # [ 0.216127] NET: Registered PF_UNIX/PF_LOCAL protocol family841client # [ 0.216166] NET: Registered PF_XDP protocol family842client # [ 0.216207] PCI: CLS 0 bytes, default 64843client # [ 0.216461] Trying to unpack rootfs image as initramfs...844lb # [ 0.215596] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)845lb # [ 0.215661] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)846lb # [ 0.215694] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)847lb # [ 0.215788] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)848lb # [ 0.215932] TCP: Hash tables configured (established 16384 bind 16384)849lb # [ 0.216047] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)850worker2 # [ 0.216908] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)851lb # [ 0.216091] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)852worker2 # [ 0.216969] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)853client # [ 0.232719] kvm [1]: HYP mode not available854lb # [ 0.216130] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)855worker2 # [ 0.217001] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)856lb # [ 0.216226] NET: Registered PF_UNIX/PF_LOCAL protocol family857lb # [ 0.216257] NET: Registered PF_XDP protocol family858worker2 # [ 0.217114] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)859lb # [ 0.216277] PCI: CLS 0 bytes, default 64860worker2 # [ 0.217265] TCP: Hash tables configured (established 16384 bind 16384)861lb # [ 0.216548] Trying to unpack rootfs image as initramfs...862worker2 # [ 0.217364] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)863worker2 # [ 0.217404] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)864worker2 # [ 0.217440] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)865worker2 # [ 0.217556] NET: Registered PF_UNIX/PF_LOCAL protocol family866worker2 # [ 0.217579] NET: Registered PF_XDP protocol family867worker2 # [ 0.217600] PCI: CLS 0 bytes, default 64868worker2 # [ 0.217930] Trying to unpack rootfs image as initramfs...869lb # [ 0.232186] kvm [1]: HYP mode not available870worker2 # [ 0.235908] kvm [1]: HYP mode not available871worker1 # [ 0.364117] Initialise system trusted keyrings872worker1 # [ 0.364968] workingset: timestamp_bits=42 max_order=19 bucket_order=0873worker1 # [ 0.366364] squashfs: version 4.0 (2009/01/31) Phillip Lougher874client # [ 0.355437] Initialise system trusted keyrings875client # [ 0.356237] workingset: timestamp_bits=42 max_order=19 bucket_order=0876client # [ 0.357620] squashfs: version 4.0 (2009/01/31) Phillip Lougher877worker1 # [ 0.372436] 9p: Installing v9fs 9p2000 file system support878client # [ 0.358427] 9p: Installing v9fs 9p2000 file system support879worker2 # [ 0.358748] Initialise system trusted keyrings880lb # [ 0.360071] Initialise system trusted keyrings881worker1 # [ 0.392533] Key type asymmetric registered882worker2 # [ 0.359547] workingset: timestamp_bits=42 max_order=19 bucket_order=0883lb # [ 0.360846] workingset: timestamp_bits=42 max_order=19 bucket_order=0884worker1 # [ 0.392562] Asymmetric key parser 'x509' registered885worker2 # [ 0.360937] squashfs: version 4.0 (2009/01/31) Phillip Lougher886lb # [ 0.362174] squashfs: version 4.0 (2009/01/31) Phillip Lougher887worker1 # [ 0.392647] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)888worker1 # [ 0.394859] io scheduler mq-deadline registered889worker2 # [ 0.361735] 9p: Installing v9fs 9p2000 file system support890worker1 # [ 0.394870] io scheduler kyber registered891lb # [ 0.363029] 9p: Installing v9fs 9p2000 file system support892worker1 # [ 0.404493] pl061_gpio 9030000.pl061: PL061 GPIO chip registered893client # [ 0.387190] Key type asymmetric registered894client # [ 0.387222] Asymmetric key parser 'x509' registered895client # [ 0.387301] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)896client # [ 0.389512] io scheduler mq-deadline registered897client # [ 0.389523] io scheduler kyber registered898lb # [ 0.382987] Key type asymmetric registered899lb # [ 0.383016] Asymmetric key parser 'x509' registered900lb # [ 0.383097] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)901worker1 # [ 0.412575] ledtrig-cpu: registered to indicate activity on CPUs902worker1 # [ 0.413031] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:903client # [ 0.398971] pl061_gpio 9030000.pl061: PL061 GPIO chip registered904lb # [ 0.390358] io scheduler mq-deadline registered905worker1 # [ 0.413052] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000906lb # [ 0.390382] io scheduler kyber registered907worker2 # [ 0.390458] Key type asymmetric registered908worker1 # [ 0.413064] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000909worker2 # [ 0.390492] Asymmetric key parser 'x509' registered910worker1 # [ 0.413072] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000911client # [ 0.400435] ledtrig-cpu: registered to indicate activity on CPUs912worker2 # [ 0.390570] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)913client # [ 0.400841] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:914worker2 # [ 0.392732] io scheduler mq-deadline registered915worker1 # [ 0.413097] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits916worker2 # [ 0.392743] io scheduler kyber registered917client # [ 0.400862] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000918worker1 # [ 0.413122] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]919worker1 # [ 0.413227] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00920client # [ 0.400874] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000921worker1 # [ 0.413237] pci_bus 0000:00: root bus resource [bus 00-ff]922client # [ 0.400882] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000923worker1 # [ 0.413243] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]924worker1 # [ 0.413248] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]925client # [ 0.400902] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits926worker1 # [ 0.413253] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]927client # [ 0.400926] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]928worker1 # [ 0.413333] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint929client # [ 0.401008] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00930client # [ 0.401017] pci_bus 0000:00: root bus resource [bus 00-ff]931worker1 # [ 0.413794] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint932client # [ 0.401023] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]933worker1 # [ 0.413984] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]934worker1 # [ 0.414001] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]935client # [ 0.401029] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]936worker1 # [ 0.414030] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]937client # [ 0.401033] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]938lb # [ 0.402472] pl061_gpio 9030000.pl061: PL061 GPIO chip registered939worker1 # [ 0.414046] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]940worker2 # [ 0.402268] pl061_gpio 9030000.pl061: PL061 GPIO chip registered941client # [ 0.401090] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint942worker1 # [ 0.414536] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint943client # [ 0.401566] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint944worker1 # [ 0.414727] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]945client # [ 0.401755] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]946worker1 # [ 0.414743] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]947lb # [ 0.404081] ledtrig-cpu: registered to indicate activity on CPUs948client # [ 0.401772] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]949worker1 # [ 0.414772] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]950lb # [ 0.404506] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:951worker2 # [ 0.403653] ledtrig-cpu: registered to indicate activity on CPUs952client # [ 0.401801] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]953worker1 # [ 0.415224] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint954client # [ 0.401818] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]955worker2 # [ 0.404080] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:956lb # [ 0.404529] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000957worker1 # [ 0.415410] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]958lb # [ 0.404541] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000959client # [ 0.402277] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint960worker2 # [ 0.404103] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000961worker1 # [ 0.415425] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]962client # [ 0.402464] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]963worker1 # [ 0.415455] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]964worker2 # [ 0.404115] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000965lb # [ 0.404549] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000966client # [ 0.402480] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]967worker1 # [ 0.415920] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint968lb # [ 0.404571] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits969client # [ 0.402510] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]970worker2 # [ 0.404123] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000971worker1 # [ 0.416103] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]972lb # [ 0.404601] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]973worker2 # [ 0.404144] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits974worker1 # [ 0.416119] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]975lb # [ 0.404680] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00976worker1 # [ 0.416152] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]977worker2 # [ 0.404167] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]978lb # [ 0.404690] pci_bus 0000:00: root bus resource [bus 00-ff]979worker1 # [ 0.416641] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint980worker2 # [ 0.404248] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00981lb # [ 0.404696] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]982worker1 # [ 0.416826] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]983worker2 # [ 0.404283] pci_bus 0000:00: root bus resource [bus 00-ff]984lb # [ 0.404701] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]985worker1 # [ 0.416842] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]986worker2 # [ 0.404289] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]987lb # [ 0.404706] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]988worker1 # [ 0.416872] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]989worker2 # [ 0.404294] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]990lb # [ 0.404768] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint991worker1 # [ 0.417328] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint992worker2 # [ 0.404300] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]993worker1 # [ 0.417511] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]994lb # [ 0.405228] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint995worker2 # [ 0.404402] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint996worker1 # [ 0.417526] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]997lb # [ 0.405416] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]998worker2 # [ 0.404857] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint999lb # [ 0.405433] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1000worker1 # [ 0.417555] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1001worker2 # [ 0.405049] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1002lb # [ 0.405463] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1003worker1 # [ 0.418021] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1004worker2 # [ 0.405078] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1005lb # [ 0.405479] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1006worker1 # [ 0.418231] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1007worker2 # [ 0.405110] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1008worker1 # [ 0.418247] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1009lb # [ 0.405943] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1010worker2 # [ 0.405125] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1011lb # [ 0.406129] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1012worker1 # [ 0.418277] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1013worker2 # [ 0.405595] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1014lb # [ 0.406144] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1015worker1 # [ 0.418293] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1016worker2 # [ 0.405781] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1017lb # [ 0.406174] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1018worker1 # [ 0.418789] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1019worker2 # [ 0.405797] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1020worker1 # [ 0.418979] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1021client # [ 0.427050] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1022worker2 # [ 0.405827] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1023client # [ 0.427251] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1024worker1 # [ 0.419009] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1025client # [ 0.427268] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1026lb # [ 0.425160] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1027worker1 # [ 0.419461] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1028lb # [ 0.425349] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1029client # [ 0.427298] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1030worker1 # [ 0.419652] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1031worker2 # [ 0.425045] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1032lb # [ 0.425365] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1033worker2 # [ 0.425240] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1034client # [ 0.427758] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1035worker1 # [ 0.419682] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1036lb # [ 0.425394] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1037client # [ 0.427942] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1038worker2 # [ 0.425256] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1039worker1 # [ 0.420077] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1040client # [ 0.427958] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1041lb # [ 0.425848] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1042worker2 # [ 0.425285] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1043worker1 # [ 0.420260] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1044lb # [ 0.426029] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1045client # [ 0.427991] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1046worker2 # [ 0.425747] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1047lb # [ 0.426045] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1048worker2 # [ 0.425931] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1049client # [ 0.428475] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1050lb # [ 0.426077] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1051client # [ 0.428663] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1052worker2 # [ 0.425947] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1053client # [ 0.428679] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1054worker2 # [ 0.425978] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1055client # [ 0.428709] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1056client # [ 0.429194] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1057client # [ 0.429380] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1058client # [ 0.429396] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1059client # [ 0.429427] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1060client # [ 0.429889] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1061client # [ 0.430073] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1062client # [ 0.430089] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1063client # [ 0.430119] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1064client # [ 0.430136] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1065worker1 # [ 0.468612] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1066worker1 # [ 0.468949] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1067client # [ 0.430595] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1068worker1 # [ 0.468968] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1069client # [ 0.430783] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1070worker1 # [ 0.468999] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1071client # [ 0.430827] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1072worker1 # [ 0.469481] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1073client # [ 0.431283] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1074worker1 # [ 0.469673] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1075client # [ 0.431477] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1076worker1 # [ 0.469689] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1077client # [ 0.431508] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1078worker1 # [ 0.469719] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1079lb # [ 0.438636] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1080client # [ 0.431910] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1081lb # [ 0.438840] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1082worker1 # [ 0.470339] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1083client # [ 0.432094] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1084worker2 # [ 0.438529] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1085lb # [ 0.438857] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1086worker1 # [ 0.470351] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1087worker2 # [ 0.438737] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1088client # [ 0.432347] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1089lb # [ 0.438886] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1090worker2 # [ 0.438754] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1091worker1 # [ 0.470356] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1092client # [ 0.432645] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1093lb # [ 0.439381] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1094worker2 # [ 0.438784] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1095client # [ 0.432663] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1096worker1 # [ 0.470407] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1097lb # [ 0.439568] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1098client # [ 0.432693] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1099worker2 # [ 0.439241] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1100worker1 # [ 0.470455] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1101lb # [ 0.439584] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1102worker2 # [ 0.439426] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1103client # [ 0.433152] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1104worker1 # [ 0.470503] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1105lb # [ 0.439613] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1106worker2 # [ 0.439442] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1107client # [ 0.433337] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1108worker1 # [ 0.470552] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1109lb # [ 0.440070] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1110client # [ 0.433353] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1111worker2 # [ 0.439478] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1112lb # [ 0.440255] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1113client # [ 0.433383] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1114worker1 # [ 0.470600] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1115worker2 # [ 0.439936] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1116lb # [ 0.440270] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1117worker2 # [ 0.440122] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1118client # [ 0.433957] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1119worker1 # [ 0.470652] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1120lb # [ 0.440300] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1121worker2 # [ 0.440138] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1122client # [ 0.433968] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1123worker1 # [ 0.470700] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1124lb # [ 0.440316] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1125worker2 # [ 0.440167] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1126client # [ 0.433973] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1127worker1 # [ 0.470749] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1128lb # [ 0.440773] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1129worker2 # [ 0.440183] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1130client # [ 0.434016] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1131lb # [ 0.440962] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1132worker1 # [ 0.470798] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1133worker2 # [ 0.440681] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1134lb # [ 0.440992] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1135client # [ 0.434069] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1136worker2 # [ 0.440872] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1137worker1 # [ 0.470880] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1138lb # [ 0.441453] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1139client # [ 0.434115] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1140worker1 # [ 0.470927] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1141worker2 # [ 0.440902] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1142lb # [ 0.441641] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1143worker1 # [ 0.470949] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1144client # [ 0.434161] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1145worker2 # [ 0.441372] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1146lb # [ 0.441670] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1147worker1 # [ 0.470971] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1148client # [ 0.434207] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1149worker2 # [ 0.441562] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1150lb # [ 0.442056] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1151worker1 # [ 0.470993] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1152worker2 # [ 0.441592] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1153client # [ 0.434254] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1154lb # [ 0.442245] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1155worker1 # [ 0.471019] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1156worker2 # [ 0.441999] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1157client # [ 0.434302] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1158worker1 # [ 0.471041] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1159lb # [ 0.442508] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1160worker2 # [ 0.442197] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1161lb # [ 0.442806] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1162client # [ 0.434349] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1163worker1 # [ 0.471064] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1164worker2 # [ 0.442458] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1165lb # [ 0.442823] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1166worker1 # [ 0.471085] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1167client # [ 0.434396] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1168worker2 # [ 0.442750] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1169lb # [ 0.442852] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1170worker1 # [ 0.471107] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1171worker2 # [ 0.442768] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1172client # [ 0.434472] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1173lb # [ 0.443339] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1174worker1 # [ 0.471130] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1175worker2 # [ 0.442797] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1176client # [ 0.434518] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1177lb # [ 0.443523] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1178worker1 # [ 0.471153] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1179client # [ 0.434540] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1180worker2 # [ 0.443268] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1181lb # [ 0.443539] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1182worker1 # [ 0.471175] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1183client # [ 0.434562] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1184worker2 # [ 0.443454] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1185lb # [ 0.443568] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1186worker1 # [ 0.471197] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1187worker2 # [ 0.443469] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1188client # [ 0.434584] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1189lb # [ 0.444148] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1190worker1 # [ 0.471218] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1191worker2 # [ 0.443500] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1192client # [ 0.434609] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1193lb # [ 0.444159] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1194worker1 # [ 0.471240] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1195worker2 # [ 0.444108] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1196client # [ 0.434631] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1197worker1 # [ 0.471265] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1198lb # [ 0.444165] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1199client # [ 0.434653] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1200worker2 # [ 0.444119] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1201worker1 # [ 0.471287] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1202lb # [ 0.444208] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1203worker1 # [ 0.471309] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1204worker2 # [ 0.444125] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1205client # [ 0.434675] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1206lb # [ 0.444255] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1207worker1 # [ 0.471331] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1208client # [ 0.434697] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1209worker2 # [ 0.444170] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1210worker1 # [ 0.471353] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1211lb # [ 0.444301] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1212client # [ 0.434719] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1213worker2 # [ 0.444218] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1214worker1 # [ 0.471375] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1215client # [ 0.434744] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1216lb # [ 0.444347] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1217worker2 # [ 0.444266] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1218worker1 # [ 0.471403] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1219client # [ 0.434767] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1220lb # [ 0.444393] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1221worker1 # [ 0.471413] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1222client # [ 0.434789] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1223worker2 # [ 0.444313] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1224worker1 # [ 0.471418] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1225lb # [ 0.444439] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1226worker2 # [ 0.444360] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1227lb # [ 0.444487] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1228worker2 # [ 0.444408] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1229lb # [ 0.444533] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1230worker2 # [ 0.444455] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1231worker1 # [ 0.509176] pci 0000:00:0a.0: enabling device (0000 -> 0002)1232lb # [ 0.444579] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1233worker2 # [ 0.444502] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1234lb # [ 0.444651] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1235worker2 # [ 0.444551] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1236lb # [ 0.444697] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1237worker2 # [ 0.444630] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1238lb # [ 0.444723] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1239worker2 # [ 0.444677] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1240lb # [ 0.444746] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1241worker2 # [ 0.444699] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1242lb # [ 0.444767] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1243client # [ 0.490839] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1244worker2 # [ 0.444720] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1245lb # [ 0.444793] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1246client # [ 0.490895] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1247lb # [ 0.444815] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1248worker2 # [ 0.444742] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1249client # [ 0.490917] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1250worker2 # [ 0.444767] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1251lb # [ 0.444838] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1252client # [ 0.490940] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1253client # [ 0.490964] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1254lb # [ 0.444861] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1255worker2 # [ 0.444789] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1256client # [ 0.490987] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1257lb # [ 0.444884] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1258worker2 # [ 0.444810] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1259client # [ 0.491010] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1260worker2 # [ 0.444832] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1261lb # [ 0.444906] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1262client # [ 0.491033] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1263lb # [ 0.444928] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1264worker2 # [ 0.444855] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1265client # [ 0.491064] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1266lb # [ 0.444950] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1267worker2 # [ 0.444877] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1268client # [ 0.491073] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1269lb # [ 0.444971] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1270worker2 # [ 0.444899] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1271client # [ 0.491078] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1272lb # [ 0.444992] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1273worker2 # [ 0.444921] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1274client # [ 0.492278] pci 0000:00:0a.0: enabling device (0000 -> 0002)1275lb # [ 0.445013] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1276worker2 # [ 0.444943] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1277lb # [ 0.445034] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1278worker2 # [ 0.444965] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1279lb # [ 0.445055] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1280worker2 # [ 0.444986] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1281lb # [ 0.445076] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1282worker2 # [ 0.445007] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1283lb # [ 0.445097] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1284worker2 # [ 0.445029] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1285lb # [ 0.445119] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1286worker2 # [ 0.445051] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1287lb # [ 0.445141] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1288worker2 # [ 0.445081] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1289lb # [ 0.445166] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1290worker2 # [ 0.445104] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1291lb # [ 0.445176] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1292worker2 # [ 0.445126] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1293lb # [ 0.445181] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1294worker2 # [ 0.445153] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1295worker2 # [ 0.445163] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1296worker2 # [ 0.445167] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1297worker1 # [ 0.535270] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1298lb # [ 0.506444] pci 0000:00:0a.0: enabling device (0000 -> 0002)1299worker2 # [ 0.506447] pci 0000:00:0a.0: enabling device (0000 -> 0002)1300worker1 # [ 0.541741] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1301worker1 # [ 0.543812] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1302client # [ 0.525614] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1303worker1 # [ 0.554022] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1304client # [ 0.532068] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1305worker1 # [ 0.556136] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1306client # [ 0.534258] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1307lb # [ 0.527720] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1308worker2 # [ 0.528144] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1309lb # [ 0.530037] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1310worker1 # [ 0.567614] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1311client # [ 0.544452] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1312client # [ 0.546766] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1313lb # [ 0.541526] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1314worker2 # [ 0.538442] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1315client # [ 0.556829] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1316worker1 # [ 0.577851] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1317worker2 # [ 0.546368] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1318worker2 # [ 0.548845] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1319worker1 # [ 0.583105] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1320lb # [ 0.551811] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1321client # [ 0.563447] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1322client # [ 0.565786] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1323worker1 # [ 0.589385] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1324worker1 # [ 0.591390] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1325worker2 # [ 0.560521] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1326worker2 # [ 0.563585] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1327worker2 # [ 0.565906] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1328client # [ 0.576514] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1329client # [ 0.578540] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1330lb # [ 0.562941] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1331lb # [ 0.565361] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1332lb # [ 0.567639] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1333worker1 # [ 0.602454] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1334lb # [ 0.570039] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1335worker2 # [ 0.575720] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1336client # [ 0.590272] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1337lb # [ 0.580287] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1338worker1 # [ 0.615365] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1339worker1 # [ 0.617989] msm_serial: driver initialized1340worker2 # [ 0.582344] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1341worker1 # [ 0.618155] SuperH (H)SCI(F) driver initialized1342worker1 # [ 0.618209] STM32 USART driver initialized1343worker2 # [ 0.584380] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1344client # [ 0.603156] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1345client # [ 0.605860] msm_serial: driver initialized1346client # [ 0.606018] SuperH (H)SCI(F) driver initialized1347client # [ 0.606072] STM32 USART driver initialized1348worker2 # [ 0.594919] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1349lb # [ 0.594446] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1350lb # [ 0.597036] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1351lb # [ 0.606472] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1352lb # [ 0.609266] msm_serial: driver initialized1353lb # [ 0.609407] SuperH (H)SCI(F) driver initialized1354worker2 # [ 0.608848] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1355lb # [ 0.609469] STM32 USART driver initialized1356worker2 # [ 0.611618] msm_serial: driver initialized1357worker2 # [ 0.611774] SuperH (H)SCI(F) driver initialized1358worker2 # [ 0.611828] STM32 USART driver initialized1359worker1 # [ 0.649835] loop: module loaded1360worker1 # [ 0.650028] virtio_blk virtio5: 1/0/0 default/read/poll queues1361worker1 # [ 0.650793] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1362client # [ 0.647895] loop: module loaded1363client # [ 0.648121] virtio_blk virtio5: 1/0/0 default/read/poll queues1364worker1 # [ 0.665137] megasas: 07.734.00.00-rc11365client # [ 0.648928] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1366worker1 # [ 0.665920] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1367worker1 # [ 0.668020] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001368worker1 # [ 0.668050] Intel/Sharp Extended Query Table at 0x00311369worker1 # [ 0.669918] Using buffer write method1370worker1 # [ 0.669995] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1371lb # [ 0.645194] loop: module loaded1372lb # [ 0.645404] virtio_blk virtio5: 1/0/0 default/read/poll queues1373worker1 # [ 0.672110] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001374worker1 # [ 0.672144] Intel/Sharp Extended Query Table at 0x00311375lb # [ 0.646191] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1376worker2 # [ 0.647445] loop: module loaded1377worker2 # [ 0.647659] virtio_blk virtio5: 1/0/0 default/read/poll queues1378client # [ 0.655546] megasas: 07.734.00.00-rc11379worker2 # [ 0.648394] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1380client # [ 0.656339] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1381worker2 # [ 0.654888] megasas: 07.734.00.00-rc11382worker2 # [ 0.655619] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1383worker1 # [ 0.692905] Using buffer write method1384worker1 # [ 0.692945] Concatenating MTD devices:1385worker1 # [ 0.692949] (0): "0.flash"1386worker1 # [ 0.692953] (1): "0.flash"1387client # [ 0.668099] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001388worker1 # [ 0.692956] into device "0.flash"1389client # [ 0.668143] Intel/Sharp Extended Query Table at 0x00311390client # [ 0.670056] Using buffer write method1391client # [ 0.670142] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1392lb # [ 0.659064] megasas: 07.734.00.00-rc11393lb # [ 0.659857] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1394lb # [ 0.661988] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001395lb # [ 0.662049] Intel/Sharp Extended Query Table at 0x00311396lb # [ 0.664047] Using buffer write method1397lb # [ 0.664128] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1398worker2 # [ 0.666906] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001399worker2 # [ 0.666965] Intel/Sharp Extended Query Table at 0x00311400worker2 # [ 0.668596] Using buffer write method1401worker2 # [ 0.668697] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1402client # [ 0.685930] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001403client # [ 0.685991] Intel/Sharp Extended Query Table at 0x00311404worker2 # [ 0.675334] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001405worker2 # [ 0.675371] Intel/Sharp Extended Query Table at 0x00311406worker2 # [ 0.676865] Using buffer write method1407client # [ 0.689893] Using buffer write method1408worker2 # [ 0.676896] Concatenating MTD devices:1409client # [ 0.689940] Concatenating MTD devices:1410worker2 # [ 0.676900] (0): "0.flash"1411client # [ 0.689945] (0): "0.flash"1412worker2 # [ 0.676904] (1): "0.flash"1413client # [ 0.689949] (1): "0.flash"1414worker2 # [ 0.676907] into device "0.flash"1415client # [ 0.689952] into device "0.flash"1416lb # [ 0.678335] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001417lb # [ 0.678374] Intel/Sharp Extended Query Table at 0x00311418lb # [ 0.680121] Using buffer write method1419lb # [ 0.680154] Concatenating MTD devices:1420lb # [ 0.680158] (0): "0.flash"1421lb # [ 0.680163] (1): "0.flash"1422lb # [ 0.680166] into device "0.flash"1423worker1 # [ 0.976897] Freeing initrd memory: 26148K1424worker1 # [ 0.983301] tun: Universal TUN/TAP device driver, 1.61425worker1 # [ 0.987265] thunder_xcv, ver 1.01426worker1 # [ 0.987313] thunder_bgx, ver 1.01427worker1 # [ 0.987335] nicpf, ver 1.01428worker1 # [ 0.987885] e1000: Intel(R) PRO/1000 Network Driver1429worker1 # [ 0.987900] e1000: Copyright (c) 1999-2006 Intel Corporation.1430worker1 # [ 0.987926] e1000e: Intel(R) PRO/1000 Network Driver1431worker1 # [ 0.987933] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1432worker1 # [ 0.987961] igb: Intel(R) Gigabit Ethernet Network Driver1433worker1 # [ 0.987967] igb: Copyright (c) 2007-2014 Intel Corporation.1434worker1 # [ 0.987993] igbvf: Intel(R) Gigabit Virtual Function Network Driver1435worker1 # [ 0.987999] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1436worker1 # [ 0.988135] sky2: driver version 1.301437lb # [ 0.966896] Freeing initrd memory: 26140K1438worker1 # [ 0.997075] usbcore: registered new interface driver usb-storage1439worker1 # [ 0.997171] usbcore: registered new interface driver usbserial_generic1440worker2 # [ 0.966476] Freeing initrd memory: 26148K1441worker1 # [ 0.997187] usbserial: USB Serial support registered for generic1442worker1 # [ 0.997782] hv_vmbus: registering driver hyperv_keyboard1443worker1 # [ 0.999240] ehci-pci 0000:00:0a.0: EHCI Host Controller1444client # [ 0.981419] Freeing initrd memory: 26160K1445worker1 # [ 0.999270] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11446worker1 # [ 0.999540] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001447lb # [ 0.973206] tun: Universal TUN/TAP device driver, 1.61448worker2 # [ 0.972858] tun: Universal TUN/TAP device driver, 1.61449worker1 # [ 1.005076] rtc-pl031 9010000.pl031: registered as rtc01450worker1 # [ 1.005111] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T13:33:33 UTC (1789911213)1451worker1 # [ 1.005484] i2c_dev: i2c /dev entries driver1452worker1 # [ 1.008663] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001453client # [ 0.987688] tun: Universal TUN/TAP device driver, 1.61454lb # [ 0.977154] thunder_xcv, ver 1.01455worker1 # [ 1.008985] hub 1-0:1.0: USB hub found1456lb # [ 0.977202] thunder_bgx, ver 1.01457worker1 # [ 1.009007] hub 1-0:1.0: 6 ports detected1458lb # [ 0.977226] nicpf, ver 1.01459worker2 # [ 0.976887] thunder_xcv, ver 1.01460lb # [ 0.977798] e1000: Intel(R) PRO/1000 Network Driver1461worker2 # [ 0.976948] thunder_bgx, ver 1.01462worker2 # [ 0.976971] nicpf, ver 1.01463lb # [ 0.977809] e1000: Copyright (c) 1999-2006 Intel Corporation.1464worker2 # [ 0.977577] e1000: Intel(R) PRO/1000 Network Driver1465lb # [ 0.977833] e1000e: Intel(R) PRO/1000 Network Driver1466worker2 # [ 0.977588] e1000: Copyright (c) 1999-2006 Intel Corporation.1467lb # [ 0.977843] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1468worker2 # [ 0.977620] e1000e: Intel(R) PRO/1000 Network Driver1469lb # [ 0.977872] igb: Intel(R) Gigabit Ethernet Network Driver1470worker2 # [ 0.977630] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1471lb # [ 0.977877] igb: Copyright (c) 2007-2014 Intel Corporation.1472worker2 # [ 0.977662] igb: Intel(R) Gigabit Ethernet Network Driver1473lb # [ 0.977900] igbvf: Intel(R) Gigabit Virtual Function Network Driver1474worker2 # [ 0.977668] igb: Copyright (c) 2007-2014 Intel Corporation.1475lb # [ 0.977906] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1476worker1 # [ 1.013178] sdhci: Secure Digital Host Controller Interface driver1477lb # [ 0.978037] sky2: driver version 1.301478worker2 # [ 0.977689] igbvf: Intel(R) Gigabit Virtual Function Network Driver1479worker1 # [ 1.013189] sdhci: Copyright(c) Pierre Ossman1480worker2 # [ 0.977695] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1481client # [ 0.992228] thunder_xcv, ver 1.01482worker1 # [ 1.013453] Synopsys Designware Multimedia Card Interface Driver1483worker2 # [ 0.977828] sky2: driver version 1.301484client # [ 0.992279] thunder_bgx, ver 1.01485client # [ 0.992302] nicpf, ver 1.01486worker1 # [ 1.013831] sdhci-pltfm: SDHCI platform and OF driver helper1487client # [ 0.992871] e1000: Intel(R) PRO/1000 Network Driver1488worker1 # [ 1.015561] hid: raw HID events driver (C) Jiri Kosina1489client # [ 0.992883] e1000: Copyright (c) 1999-2006 Intel Corporation.1490worker1 # [ 1.015803] usbcore: registered new interface driver usbhid1491worker1 # [ 1.015815] usbhid: USB HID core driver1492client # [ 0.992908] e1000e: Intel(R) PRO/1000 Network Driver1493client # [ 0.992917] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1494lb # [ 0.987092] usbcore: registered new interface driver usb-storage1495client # [ 0.992945] igb: Intel(R) Gigabit Ethernet Network Driver1496lb # [ 0.987150] usbcore: registered new interface driver usbserial_generic1497client # [ 0.992951] igb: Copyright (c) 2007-2014 Intel Corporation.1498worker2 # [ 0.987128] usbcore: registered new interface driver usb-storage1499lb # [ 0.987165] usbserial: USB Serial support registered for generic1500client # [ 0.992974] igbvf: Intel(R) Gigabit Virtual Function Network Driver1501worker2 # [ 0.987201] usbcore: registered new interface driver usbserial_generic1502lb # [ 0.987773] hv_vmbus: registering driver hyperv_keyboard1503worker1 # [ 1.021632] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1504client # [ 0.992980] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1505lb # [ 0.989195] ehci-pci 0000:00:0a.0: EHCI Host Controller1506worker2 # [ 0.987220] usbserial: USB Serial support registered for generic1507client # [ 0.993114] sky2: driver version 1.301508worker1 # [ 1.023185] drop_monitor: Initializing network drop monitor service1509worker2 # [ 0.987846] hv_vmbus: registering driver hyperv_keyboard1510lb # [ 0.989223] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11511client # [ 0.994736] usbcore: registered new interface driver usb-storage1512worker1 # [ 1.023400] NET: Registered PF_INET6 protocol family1513worker2 # [ 0.989313] ehci-pci 0000:00:0a.0: EHCI Host Controller1514lb # [ 0.989436] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001515client # [ 0.995695] ehci-pci 0000:00:0a.0: EHCI Host Controller1516worker2 # [ 0.989341] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11517worker1 # [ 1.026475] Segment Routing with IPv61518client # [ 0.995728] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11519worker1 # [ 1.026495] In-situ OAM (IOAM) with IPv61520worker2 # [ 0.989580] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001521client # [ 0.995977] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001522worker1 # [ 1.026530] NET: Registered PF_PACKET protocol family1523lb # [ 0.994933] rtc-pl031 9010000.pl031: registered as rtc01524worker1 # [ 1.028151] 9pnet: Installing 9P2000 support1525lb # [ 0.994973] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T13:33:33 UTC (1789911213)1526worker2 # [ 0.995073] rtc-pl031 9010000.pl031: registered as rtc01527lb # [ 0.995330] i2c_dev: i2c /dev entries driver1528client # [ 1.006253] usbcore: registered new interface driver usbserial_generic1529worker2 # [ 0.995104] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T13:33:33 UTC (1789911213)1530client # [ 1.006274] usbserial: USB Serial support registered for generic1531worker2 # [ 0.995477] i2c_dev: i2c /dev entries driver1532lb # [ 0.998401] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001533client # [ 1.006877] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001534lb # [ 0.998720] hub 1-0:1.0: USB hub found1535client # [ 1.007237] hub 1-0:1.0: USB hub found1536lb # [ 0.998740] hub 1-0:1.0: 6 ports detected1537client # [ 1.007257] hub 1-0:1.0: 6 ports detected1538worker1 # [ 1.031015] Key type dns_resolver registered1539worker2 # [ 0.998645] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001540worker2 # [ 0.998983] hub 1-0:1.0: USB hub found1541worker2 # [ 0.999005] hub 1-0:1.0: 6 ports detected1542client # [ 1.011098] hv_vmbus: registering driver hyperv_keyboard1543client # [ 1.012721] rtc-pl031 9010000.pl031: registered as rtc01544client # [ 1.012751] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T13:33:33 UTC (1789911213)1545client # [ 1.013077] i2c_dev: i2c /dev entries driver1546lb # [ 1.002946] sdhci: Secure Digital Host Controller Interface driver1547lb # [ 1.002962] sdhci: Copyright(c) Pierre Ossman1548worker2 # [ 1.003338] sdhci: Secure Digital Host Controller Interface driver1549lb # [ 1.003326] Synopsys Designware Multimedia Card Interface Driver1550worker2 # [ 1.003353] sdhci: Copyright(c) Pierre Ossman1551lb # [ 1.003709] sdhci-pltfm: SDHCI platform and OF driver helper1552worker2 # [ 1.003633] Synopsys Designware Multimedia Card Interface Driver1553client # [ 1.018132] sdhci: Secure Digital Host Controller Interface driver1554lb # [ 1.005531] hid: raw HID events driver (C) Jiri Kosina1555worker1 # [ 1.037601] registered taskstats version 11556worker2 # [ 1.004023] sdhci-pltfm: SDHCI platform and OF driver helper1557client # [ 1.018148] sdhci: Copyright(c) Pierre Ossman1558worker1 # [ 1.037784] Loading compiled-in X.509 certificates1559lb # [ 1.005786] usbcore: registered new interface driver usbhid1560worker2 # [ 1.005863] hid: raw HID events driver (C) Jiri Kosina1561lb # [ 1.005793] usbhid: USB HID core driver1562client # [ 1.018414] Synopsys Designware Multimedia Card Interface Driver1563client # [ 1.018786] sdhci-pltfm: SDHCI platform and OF driver helper1564worker2 # [ 1.009487] usbcore: registered new interface driver usbhid1565worker2 # [ 1.009495] usbhid: USB HID core driver1566lb # [ 1.011486] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1567client # [ 1.023255] hid: raw HID events driver (C) Jiri Kosina1568lb # [ 1.013074] drop_monitor: Initializing network drop monitor service1569worker1 # [ 1.046473] Demotion targets for Node 0: null1570client # [ 1.023503] usbcore: registered new interface driver usbhid1571lb # [ 1.013283] NET: Registered PF_INET6 protocol family1572worker2 # [ 1.011888] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1573worker1 # [ 1.046593] Key type .fscrypt registered1574client # [ 1.023510] usbhid: USB HID core driver1575worker1 # [ 1.046600] Key type fscrypt-provisioning registered1576worker2 # [ 1.013519] drop_monitor: Initializing network drop monitor service1577lb # [ 1.016443] Segment Routing with IPv61578lb # [ 1.016463] In-situ OAM (IOAM) with IPv61579worker2 # [ 1.013718] NET: Registered PF_INET6 protocol family1580worker1 # [ 1.046712] ima: No TPM chip found, activating TPM-bypass!1581client # [ 1.026437] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1582worker1 # [ 1.046736] ima: Allocated hash algorithm: sha11583lb # [ 1.016504] NET: Registered PF_PACKET protocol family1584worker1 # [ 1.046759] ima: No architecture policies found1585worker2 # [ 1.016783] Segment Routing with IPv61586lb # [ 1.018115] 9pnet: Installing 9P2000 support1587worker2 # [ 1.016815] In-situ OAM (IOAM) with IPv61588worker2 # [ 1.016845] NET: Registered PF_PACKET protocol family1589worker1 # [ 1.050837] input: gpio-keys as /devices/platform/gpio-keys/input/input01590client # [ 1.029070] drop_monitor: Initializing network drop monitor service1591client # [ 1.029283] NET: Registered PF_INET6 protocol family1592client # [ 1.031482] Segment Routing with IPv61593client # [ 1.031504] In-situ OAM (IOAM) with IPv61594lb # [ 1.020869] Key type dns_resolver registered1595client # [ 1.031535] NET: Registered PF_PACKET protocol family1596worker2 # [ 1.018572] 9pnet: Installing 9P2000 support1597worker2 # [ 1.020865] Key type dns_resolver registered1598client # [ 1.033326] 9pnet: Installing 9P2000 support1599client # [ 1.036244] Key type dns_resolver registered1600lb # [ 1.027540] registered taskstats version 11601lb # [ 1.027734] Loading compiled-in X.509 certificates1602worker2 # [ 1.028228] registered taskstats version 11603worker2 # [ 1.028381] Loading compiled-in X.509 certificates1604client # [ 1.042660] registered taskstats version 11605client # [ 1.043389] Loading compiled-in X.509 certificates1606lb # [ 1.036777] Demotion targets for Node 0: null1607lb # [ 1.036903] Key type .fscrypt registered1608lb # [ 1.036910] Key type fscrypt-provisioning registered1609worker2 # [ 1.037246] Demotion targets for Node 0: null1610lb # [ 1.037027] ima: No TPM chip found, activating TPM-bypass!1611worker2 # [ 1.037377] Key type .fscrypt registered1612lb # [ 1.037055] ima: Allocated hash algorithm: sha11613worker1 # [ 1.069549] clk: Disabling unused clocks1614worker2 # [ 1.037383] Key type fscrypt-provisioning registered1615lb # [ 1.037081] ima: No architecture policies found1616worker1 # [ 1.069588] PM: genpd: Disabling unused power domains1617worker2 # [ 1.037495] ima: No TPM chip found, activating TPM-bypass!1618lb # [ 1.041356] input: gpio-keys as /devices/platform/gpio-keys/input/input01619worker2 # [ 1.037542] ima: Allocated hash algorithm: sha11620worker2 # [ 1.037574] ima: No architecture policies found1621client # [ 1.051956] Demotion targets for Node 0: null1622worker1 # [ 1.073966] Freeing unused kernel memory: 4736K1623client # [ 1.052091] Key type .fscrypt registered1624worker1 # [ 1.074213] Run /init as init process1625client # [ 1.052101] Key type fscrypt-provisioning registered1626worker2 # [ 1.042423] input: gpio-keys as /devices/platform/gpio-keys/input/input01627client # [ 1.052230] ima: No TPM chip found, activating TPM-bypass!1628client # [ 1.052251] ima: Allocated hash algorithm: sha11629client # [ 1.052278] ima: No architecture policies found1630client # [ 1.056638] input: gpio-keys as /devices/platform/gpio-keys/input/input01631worker1 # [ 1.091147] systemd[1]: Successfully made /usr/ read-only.1632lb # [ 1.060806] clk: Disabling unused clocks1633lb # [ 1.060842] PM: genpd: Disabling unused power domains1634worker2 # [ 1.061586] clk: Disabling unused clocks1635worker2 # [ 1.061620] PM: genpd: Disabling unused power domains1636lb # [ 1.065271] Freeing unused kernel memory: 4736K1637lb # [ 1.065489] Run /init as init process1638worker2 # [ 1.065958] Freeing unused kernel memory: 4736K1639worker2 # [ 1.066775] Run /init as init process1640client # [ 1.076006] clk: Disabling unused clocks1641client # [ 1.076047] PM: genpd: Disabling unused power domains1642client # [ 1.080475] Freeing unused kernel memory: 4736K1643client # [ 1.080684] Run /init as init process1644lb # [ 1.080699] systemd[1]: Successfully made /usr/ read-only.1645worker2 # [ 1.084563] systemd[1]: Successfully made /usr/ read-only.1646client # [ 1.097375] systemd[1]: Successfully made /usr/ read-only.1647worker1 # [ 1.256482] usb 1-1: new high-speed USB device number 2 using ehci-pci1648client # [ 1.254857] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker2 # [ 1.246193] usb 1-1: new high-speed USB device number 2 using ehci-pci1650lb # [ 1.246379] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker1 # [ 1.406308] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652worker1 # [ 1.426069] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1653lb # [ 1.396488] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11654worker1 # [ 1.433917] systemd[1]: Detected virtualization qemu.1655worker1 # [ 1.435271] systemd[1]: Detected architecture arm64.1656client # [ 1.409222] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11657worker1 # [ 1.436593] systemd[1]: Running in initrd.1658worker2 # [ 1.400347] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11659worker1 # [ 1.438287] systemd[1]: Initializing machine ID from random generator.1660worker1 # [ 1.440129] systemd[1]: Hostname set to <worker1>.1661worker2 # [ 1.419360] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1662lb # [ 1.415593] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1663worker2 # [ 1.425290] systemd[1]: Detected virtualization qemu.1664lb # [ 1.415653] systemd[1]: Detected virtualization qemu.1665worker2 # [ 1.426274] systemd[1]: Detected architecture arm64.1666client # [ 1.432171] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1667worker2 # [ 1.427219] systemd[1]: Running in initrd.1668lb # [ 1.415724] systemd[1]: Detected architecture arm64.1669client # [ 1.439139] systemd[1]: Detected virtualization qemu.1670lb # [ 1.415744] systemd[1]: Running in initrd.1671worker2 # [ 1.428538] systemd[1]: Initializing machine ID from random generator.1672client # [ 1.440257] systemd[1]: Detected architecture arm64.1673worker2 # [ 1.429894] systemd[1]: Hostname set to <worker2>.1674client # [ 1.441353] systemd[1]: Running in initrd.1675lb # [ 1.416556] systemd[1]: Initializing machine ID from random generator.1676lb # [ 1.416810] systemd[1]: Hostname set to <lb>.1677client # [ 1.442798] systemd[1]: Initializing machine ID from random generator.1678client # [ 1.444572] systemd[1]: Hostname set to <client>.1679worker1 # [ 1.492704] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01680lb # [ 1.482667] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681worker2 # [ 1.484201] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682client # [ 1.503065] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker1 # [ 1.612429] usb 1-2: new high-speed USB device number 3 using ehci-pci1684lb # [ 1.602335] usb 1-2: new high-speed USB device number 3 using ehci-pci1685worker2 # [ 1.602204] usb 1-2: new high-speed USB device number 3 using ehci-pci1686client # [ 1.626939] usb 1-2: new high-speed USB device number 3 using ehci-pci1687worker1 # [ 1.712286] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688worker2 # [ 1.702096] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689client # [ 1.739248] systemd[1]: bpf-restrict-fs: LSM BPF program attached1690worker1 # [ 1.765950] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21691lb # [ 1.735162] systemd[1]: bpf-restrict-fs: LSM BPF program attached1692worker1 # [ 1.769010] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01693worker2 # [ 1.759977] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21694worker2 # [ 1.763011] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01695lb # [ 1.765624] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21696lb # [ 1.770591] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01697worker1 # [ 1.807555] systemd[1]: Queued start job for default target Initrd Default Target.1698client # [ 1.785750] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21699client # [ 1.787703] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01700worker1 # [ 1.819009] systemd[1]: Created slice Slice /system/modprobe.1701worker1 # [ 1.820352] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1702worker1 # [ 1.821783] systemd[1]: Expecting device /dev/disk/by-label/nixos...1703worker1 # [ 1.822883] systemd[1]: Reached target Path Units.1704worker1 # [ 1.823705] systemd[1]: Reached target Slice Units.1705worker1 # [ 1.824583] systemd[1]: Reached target Swaps.1706worker1 # [ 1.825346] systemd[1]: Reached target Timer Units.1707client # [ 1.804043] systemd[1]: Queued start job for default target Initrd Default Target.1708worker1 # [ 1.826432] systemd[1]: Listening on D-Bus System Message Bus Socket.1709worker1 # [ 1.827772] systemd[1]: Listening on Journal Socket (/dev/log).1710worker1 # [ 1.828994] systemd[1]: Listening on Journal Sockets.1711worker1 # [ 1.829147] systemd[1]: Listening on udev Control Socket.1712worker2 # [ 1.798553] systemd[1]: Queued start job for default target Initrd Default Target.1713worker1 # [ 1.829269] systemd[1]: Listening on udev Kernel Socket.1714worker1 # [ 1.829293] systemd[1]: Reached target Socket Units.1715client # [ 1.812811] systemd[1]: Created slice Slice /system/modprobe.1716client # [ 1.813754] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1717worker1 # [ 1.834547] systemd[1]: Starting Create List of Static Device Nodes...1718client # [ 1.814917] systemd[1]: Expecting device /dev/disk/by-label/nixos...1719client # [ 1.815740] systemd[1]: Reached target Path Units.1720client # [ 1.816382] systemd[1]: Reached target Slice Units.1721client # [ 1.817027] systemd[1]: Reached target Swaps.1722client # [ 1.817740] systemd[1]: Reached target Timer Units.1723client # [ 1.818552] systemd[1]: Listening on D-Bus System Message Bus Socket.1724client # [ 1.819587] systemd[1]: Listening on Journal Socket (/dev/log).1725client # [ 1.820489] systemd[1]: Listening on Journal Sockets.1726worker2 # [ 1.809248] systemd[1]: Created slice Slice /system/modprobe.1727client # [ 1.821265] systemd[1]: Listening on udev Control Socket.1728client # [ 1.822120] systemd[1]: Listening on udev Kernel Socket.1729worker2 # [ 1.810520] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1730client # [ 1.822880] systemd[1]: Reached target Socket Units.1731worker1 # [ 1.844623] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1732worker2 # [ 1.811882] systemd[1]: Expecting device /dev/disk/by-label/nixos...1733worker2 # [ 1.812953] systemd[1]: Reached target Path Units.1734worker1 # [ 1.845803] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1735client # [ 1.824924] systemd[1]: Starting Create List of Static Device Nodes...1736worker2 # [ 1.813884] systemd[1]: Reached target Slice Units.1737worker2 # [ 1.814817] systemd[1]: Reached target Swaps.1738worker2 # [ 1.815585] systemd[1]: Reached target Timer Units.1739worker2 # [ 1.816628] systemd[1]: Listening on D-Bus System Message Bus Socket.1740worker2 # [ 1.817904] systemd[1]: Listening on Journal Socket (/dev/log).1741worker2 # [ 1.819164] systemd[1]: Listening on Journal Sockets.1742worker1 # [ 1.852677] systemd[1]: Mounting Kernel Configuration File System...1743worker2 # [ 1.820197] systemd[1]: Listening on udev Control Socket.1744worker2 # [ 1.821269] systemd[1]: Listening on udev Kernel Socket.1745client # [ 1.834165] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1746worker2 # [ 1.822341] systemd[1]: Reached target Socket Units.1747client # [ 1.835214] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1748worker2 # [ 1.825091] systemd[1]: Starting Create List of Static Device Nodes...1749worker2 # [ 1.834350] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1750worker2 # [ 1.834454] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1751client # [ 1.848504] systemd[1]: Mounting Kernel Configuration File System...1752worker1 # [ 1.872808] systemd[1]: Starting Journal Service...1753worker2 # [ 1.842422] systemd[1]: Mounting Kernel Configuration File System...1754lb # [ 1.845504] systemd[1]: Queued start job for default target Initrd Default Target.1755client # [ 1.863005] systemd[1]: Starting Journal Service...1756client # [ 1.865252] systemd[1]: Starting Load Kernel Modules...1757client # [ 1.866069] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1758lb # [ 1.857040] systemd[1]: Created slice Slice /system/modprobe.1759lb # [ 1.858577] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1760lb # [ 1.858629] systemd[1]: Expecting device /dev/disk/by-label/nixos...1761lb # [ 1.858665] systemd[1]: Reached target Path Units.1762worker1 # [ 1.896260] systemd[1]: Starting Load Kernel Modules...1763lb # [ 1.858688] systemd[1]: Reached target Slice Units.1764lb # [ 1.858712] systemd[1]: Reached target Swaps.1765lb # [ 1.858735] systemd[1]: Reached target Timer Units.1766worker1 # [ 1.897294] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1767lb # [ 1.858959] systemd[1]: Listening on D-Bus System Message Bus Socket.1768lb # [ 1.859130] systemd[1]: Listening on Journal Socket (/dev/log).1769client # [ 1.879453] systemd[1]: Starting Coldplug All udev Devices...1770lb # [ 1.859286] systemd[1]: Listening on Journal Sockets.1771lb # [ 1.859438] systemd[1]: Listening on udev Control Socket.1772lb # [ 1.859566] systemd[1]: Listening on udev Kernel Socket.1773lb # [ 1.859591] systemd[1]: Reached target Socket Units.1774lb # [ 1.873726] systemd[1]: Starting Create List of Static Device Nodes...1775worker1 # [ 1.904856] systemd[1]: Starting Coldplug All udev Devices...1776worker2 # [ 1.874429] systemd[1]: Starting Journal Service...1777worker2 # [ 1.876914] systemd[1]: Starting Load Kernel Modules...1778worker2 # [ 1.877824] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1779lb # [ 1.882544] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1780worker1 # [ 1.916678] systemd[1]: Finished Create List of Static Device Nodes.1781lb # [ 1.883882] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1782worker1 # [ 1.918506] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1783worker2 # [ 1.887473] systemd[1]: Starting Coldplug All udev Devices...1784worker1 # [ 1.922949] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1785client # [ 1.903120] systemd[1]: Finished Create List of Static Device Nodes.1786client # [ 1.904035] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1787worker1 # [ 1.928974] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1788client # [ 1.904363] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1789worker1 # [ 1.929338] systemd[1]: Mounted Kernel Configuration File System.1790client # [ 1.904603] systemd[1]: Mounted Kernel Configuration File System.1791lb # [ 1.902930] systemd[1]: Mounting Kernel Configuration File System...1792worker1 # [ 1.940856] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1793worker2 # [ 1.903623] systemd[1]: Finished Create List of Static Device Nodes.1794worker2 # [ 1.904666] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1795client # [ 1.919454] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1796worker2 # [ 1.904968] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1797worker2 # [ 1.905264] systemd[1]: Mounted Kernel Configuration File System.1798worker1 # [ 1.944757] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1799worker1 # [ 1.949701] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01800worker1 # [ 1.949943] [drm] features: -virgl +edid -resource_blob -host_visible1801worker1 # [ 1.949951] [drm] features: -context_init1802worker1 # [ 1.950691] [drm] number of scanouts: 11803worker1 # [ 1.950708] [drm] number of cap sets: 01804worker2 # [ 1.922434] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1805lb # [ 1.926559] systemd[1]: Starting Journal Service...1806lb # [ 1.934485] systemd[1]: Starting Load Kernel Modules...1807client # [ 1.944596] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1808lb # [ 1.935441] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1809worker1 # [ 1.966759] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1810worker1 # [ 1.966787] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01811client # [ 1.951495] systemd-journald[73]: Collecting audit messages is disabled.1812lb # [ 1.946432] systemd[1]: Starting Coldplug All udev Devices...1813worker2 # [ 1.951572] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1814worker1 # [ 1.987892] systemd-journald[73]: Collecting audit messages is disabled.1815client # [ 1.968783] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1816lb # [ 1.962660] systemd[1]: Finished Create List of Static Device Nodes.1817lb # [ 1.964549] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1818worker2 # [ 1.966564] systemd-journald[73]: Collecting audit messages is disabled.1819client # [ 1.978884] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01820client # [ 1.979184] [drm] features: -virgl +edid -resource_blob -host_visible1821client # [ 1.979194] [drm] features: -context_init1822client # [ 1.979950] [drm] number of scanouts: 11823client # [ 1.979968] [drm] number of cap sets: 01824worker1 # [ 2.001543] Console: switching to colour frame buffer device 160x501825worker1 # [ 2.010438] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1826lb # [ 1.978555] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1827lb # [ 1.981297] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1828lb # [ 1.982776] systemd[1]: Mounted Kernel Configuration File System.1829client # [ 1.991557] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1830client # [ 1.994362] systemd[1]: Starting Create Static Device Nodes in /dev...1831worker2 # [ 1.978180] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1832worker2 # [ 1.983050] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01833worker2 # [ 1.983284] [drm] features: -virgl +edid -resource_blob -host_visible1834worker2 # [ 1.983293] [drm] features: -context_init1835worker2 # [ 1.984060] [drm] number of scanouts: 11836worker2 # [ 1.984077] [drm] number of cap sets: 01837worker1 # [ 2.020938] systemd[1]: Starting Create Static Device Nodes in /dev...1838lb # [ 1.990012] systemd-journald[73]: Collecting audit messages is disabled.1839client # [ 2.003327] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1840worker2 # [ 1.998796] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1841client # [ 2.003352] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01842worker2 # [ 2.001571] systemd[1]: Starting Create Static Device Nodes in /dev...1843worker1 # [ 2.033696] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1844worker2 # [ 2.006496] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1845worker2 # [ 2.006519] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01846worker1 # [ 2.048759] systemd[1]: Finished Load Kernel Modules.1847worker1 # [ 2.052549] systemd[1]: Starting Apply Kernel Variables...1848lb # [ 2.021748] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1849client # [ 2.032271] Console: switching to colour frame buffer device 160x501850lb # [ 2.030447] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1851worker2 # [ 2.032095] Console: switching to colour frame buffer device 160x501852lb # [ 2.042563] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01853lb # [ 2.042815] [drm] features: -virgl +edid -resource_blob -host_visible1854lb # [ 2.042826] [drm] features: -context_init1855lb # [ 2.043582] [drm] number of scanouts: 11856lb # [ 2.043599] [drm] number of cap sets: 01857client # [ 2.059676] systemd[1]: Finished Create Static Device Nodes in /dev.1858client # [ 2.060057] systemd[1]: Reached target Preparation for Local File Systems.1859client # [ 2.060084] systemd[1]: Reached target Local File Systems.1860worker1 # [ 2.084541] systemd[1]: Finished Create Static Device Nodes in /dev.1861client # [ 2.064277] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1862lb # [ 2.055027] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1863worker1 # [ 2.084825] systemd[1]: Reached target Preparation for Local File Systems.1864worker1 # [ 2.084864] systemd[1]: Reached target Local File Systems.1865client # [ 2.067015] systemd[1]: Starting Rule-based Manager for Device Events and Files...1866worker1 # [ 2.090423] systemd[1]: Starting Rule-based Manager for Device Events and Files...1867lb # [ 2.062720] systemd[1]: Starting Create Static Device Nodes in /dev...1868worker2 # [ 2.064137] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1869lb # [ 2.067745] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1870lb # [ 2.067775] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01871worker2 # [ 2.070795] systemd[1]: Finished Create Static Device Nodes in /dev.1872worker2 # [ 2.071036] systemd[1]: Reached target Preparation for Local File Systems.1873worker2 # [ 2.071070] systemd[1]: Reached target Local File Systems.1874worker2 # [ 2.076441] systemd[1]: Starting Rule-based Manager for Device Events and Files...1875client # [ 2.087466] systemd[1]: Finished Load Kernel Modules.1876worker2 # [ 2.094825] systemd[1]: Finished Load Kernel Modules.1877worker1 # [ 2.128866] systemd[1]: Finished Apply Kernel Variables.1878client # [ 2.106997] systemd[1]: Starting Apply Kernel Variables...1879lb # [ 2.094566] Console: switching to colour frame buffer device 160x501880lb # [ 2.101486] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1881worker2 # [ 2.106692] systemd[1]: Starting Apply Kernel Variables...1882client # [ 2.135176] systemd[1]: Started Journal Service.1883client # [ 2.123644] systemd-modules-load[74]: Inserted module 'dm_mod'1884client # [ 2.124975] systemd-modules-load[74]: Module 'virtio_balloon' is built in1885client # [ 2.126095] systemd-modules-load[74]: Module 'virtio_console' is built in1886client # [ 2.127176] systemd-modules-load[74]: Inserted module 'virtio_gpu'1887lb # [ 2.131711] systemd[1]: Finished Create Static Device Nodes in /dev.1888lb # [ 2.131961] systemd[1]: Reached target Preparation for Local File Systems.1889lb # [ 2.131999] systemd[1]: Reached target Local File Systems.1890lb # [ 2.137358] systemd[1]: Starting Rule-based Manager for Device Events and Files...1891worker1 # [ 2.168618] systemd[1]: Started Journal Service.1892worker1 # [ 2.160217] systemd-modules-load[74]: Inserted module 'dm_mod'1893worker1 # [ 2.161531] systemd-modules-load[74]: Module 'virtio_balloon' is built in1894client # [ 2.144495] systemd-modules-load[74]: Module 'virtio_rng' is built in1895client # [ 2.145610] systemd[1]: Starting Create System Files and Directories...1896worker1 # [ 2.168450] systemd-modules-load[74]: Module 'virtio_console' is built in1897worker2 # [ 2.150308] systemd[1]: Finished Apply Kernel Variables.1898worker2 # [ 2.150642] systemd[1]: Started Journal Service.1899worker1 # [ 2.173021] systemd-modules-load[74]: Inserted module 'virtio_gpu'1900client # [ 2.153042] systemd[1]: Finished Apply Kernel Variables.1901worker1 # [ 2.175198] systemd-modules-load[74]: Module 'virtio_rng' is built in1902worker2 # [ 2.148257] systemd-modules-load[74]: Inserted module 'dm_mod'1903lb # [ 2.162598] systemd[1]: Finished Load Kernel Modules.1904worker2 # [ 2.149472] systemd-modules-load[74]: Module 'virtio_balloon' is built in1905worker2 # [ 2.150658] systemd-modules-load[74]: Module 'virtio_console' is built in1906worker2 # [ 2.156309] systemd-modules-load[74]: Inserted module 'virtio_gpu'1907client # [ 2.170553] systemd-udevd[80]: Using default interface naming scheme 'v261'.1908lb # [ 2.175790] systemd[1]: Starting Apply Kernel Variables...1909worker2 # [ 2.161636] systemd-modules-load[74]: Module 'virtio_rng' is built in1910worker1 # [ 2.192436] systemd[1]: Starting Create System Files and Directories...1911worker2 # [ 2.163688] systemd[1]: Starting Create System Files and Directories...1912lb # [ 2.168514] systemd-modules-load[74]: Inserted module 'dm_mod'1913worker1 # [ 2.200758] systemd-udevd[81]: Using default interface naming scheme 'v261'.1914lb # [ 2.172327] systemd-modules-load[74]: Module 'virtio_balloon' is built in1915lb # [ 2.176319] systemd-modules-load[74]: Module 'virtio_console' is built in1916lb # [ 2.180269] systemd-modules-load[74]: Inserted module 'virtio_gpu'1917worker1 # [ 2.213353] systemd[1]: Finished Create System Files and Directories.1918lb # [ 2.198530] systemd[1]: Started Journal Service.1919lb # [ 2.187675] systemd-modules-load[74]: Module 'virtio_rng' is built in1920client # [ 2.203511] systemd[1]: Finished Create System Files and Directories.1921worker2 # [ 2.193796] systemd-udevd[79]: Using default interface naming scheme 'v261'.1922worker1 # [ 2.231647] systemd[1]: Started Rule-based Manager for Device Events and Files.1923client # [ 2.214345] systemd[1]: Started Rule-based Manager for Device Events and Files.1924worker2 # [ 2.208619] systemd[1]: Finished Create System Files and Directories.1925lb # [ 2.220123] systemd[1]: Starting Create System Files and Directories...1926worker2 # [ 2.229821] systemd[1]: Started Rule-based Manager for Device Events and Files.1927lb # [ 2.232637] systemd[1]: Finished Apply Kernel Variables.1928lb # [ 2.236360] systemd-udevd[79]: Using default interface naming scheme 'v261'.1929client # [ 2.274595] systemd[1]: Starting Virtual Console Setup...1930worker1 # [ 2.300136] systemd[1]: Starting Virtual Console Setup...1931lb # [ 2.274661] systemd[1]: Finished Create System Files and Directories.1932lb # [ 2.280971] systemd[1]: Started Rule-based Manager for Device Events and Files.1933worker2 # [ 2.290260] systemd[1]: Starting Virtual Console Setup...1934worker1 # [ 2.348631] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1935client # [ 2.328586] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1936worker1 # [ 2.352259] systemd[1]: Finished Virtual Console Setup.1937client # [ 2.332132] systemd[1]: Finished Virtual Console Setup.1938lb # [ 2.333884] systemd[1]: Starting Virtual Console Setup...1939worker2 # [ 2.340497] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1940worker2 # [ 2.343839] systemd[1]: Finished Virtual Console Setup.1941lb # [ 2.389348] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1942lb # [ 2.392143] systemd[1]: Finished Virtual Console Setup.1943worker1 # [ 2.942715] systemd[1]: Finished Coldplug All udev Devices.1944worker1 # [ 2.948414] systemd[1]: Reached target System Initialization.1945client # [ 2.928772] systemd[1]: Finished Coldplug All udev Devices.1946worker1 # [ 2.949397] systemd[1]: Reached target Basic System.1947client # [ 2.929921] systemd[1]: Reached target System Initialization.1948client # [ 2.930757] systemd[1]: Reached target Basic System.1949worker2 # [ 2.932738] systemd[1]: Finished Coldplug All udev Devices.1950worker2 # [ 2.936935] systemd[1]: Reached target System Initialization.1951worker2 # [ 2.938736] systemd[1]: Reached target Basic System.1952lb # [ 3.009574] systemd[1]: Finished Coldplug All udev Devices.1953lb # [ 3.010535] systemd[1]: Reached target System Initialization.1954lb # [ 3.011353] systemd[1]: Reached target Basic System.1955worker1 # [ 3.106407] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1956client # [ 3.086327] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1957worker2 # [ 3.080333] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1958client # [ 3.105562] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1959client # [ 3.110463] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1960worker1 # [ 3.130609] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1961worker1 # [ 3.134951] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1962worker2 # [ 3.120585] (udev-worker)[106]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1963worker2 # [ 3.124843] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line.1964lb # [ 3.135885] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1965client # [ 3.169950] systemd[1]: Found device /dev/disk/by-label/nixos.1966client # [ 3.173139] systemd[1]: Reached target Initrd Root Device.1967client # [ 3.176991] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1968worker1 # [ 3.211571] systemd[1]: Found device /dev/disk/by-label/nixos.1969worker2 # [ 3.185452] systemd[1]: Found device /dev/disk/by-label/nixos.1970worker1 # [ 3.216254] systemd[1]: Reached target Initrd Root Device.1971lb # [ 3.188717] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1972worker1 # [ 3.220195] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1973worker2 # [ 3.190833] systemd[1]: Reached target Initrd Root Device.1974lb # [ 3.193465] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1975worker2 # [ 3.195488] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1976client # [ 3.235622] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1977client # [ 3.243798] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1978worker1 # [ 3.267488] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1979client # [ 3.249231] systemd[1]: Mounting /sysroot...1980worker1 # [ 3.275406] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1981worker1 # [ 3.278043] systemd[1]: Mounting /sysroot...1982worker2 # [ 3.255050] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1983worker2 # [ 3.264185] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1984worker2 # [ 3.266756] systemd[1]: Mounting /sysroot...1985lb # [ 3.282591] systemd[1]: Found device /dev/disk/by-label/nixos.1986lb # [ 3.284702] systemd[1]: Reached target Initrd Root Device.1987client # [ 3.309083] EXT4-fs (vda): mounted filesystem 584fb091-e938-4e6f-8df8-db5944cbb7f2 r/w with ordered data mode. Quota mode: none.1988worker1 # [ 3.333680] EXT4-fs (vda): mounted filesystem f6a15bf6-91eb-45ba-9199-39e90c1f2deb r/w with ordered data mode. Quota mode: none.1989client # [ 3.301017] systemd[1]: Mounted /sysroot.1990lb # [ 3.292132] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1991client # [ 3.303364] systemd[1]: Reached target Initrd Root File System.1992worker1 # [ 3.324608] systemd[1]: Mounted /sysroot.1993worker1 # [ 3.326218] systemd[1]: Reached target Initrd Root File System.1994client # [ 3.308637] systemd[1]: Starting Mountpoints Configured in the Real Root...1995worker1 # [ 3.331312] systemd[1]: Starting Mountpoints Configured in the Real Root...1996worker2 # [ 3.321525] EXT4-fs (vda): mounted filesystem 50b917be-b23f-4716-bbe5-8d3af0fec07d r/w with ordered data mode. Quota mode: none.1997worker2 # [ 3.313893] systemd[1]: Mounted /sysroot.1998worker2 # [ 3.315004] systemd[1]: Reached target Initrd Root File System.1999worker2 # [ 3.319167] systemd[1]: Starting Mountpoints Configured in the Real Root...2000client # [ 3.339763] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.
loading 1,464 hidden lines…
3465lb # [ 20.671991] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3466lb # [ 20.675108] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3467lb # [ 20.679809] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3468lb # [ 20.683358] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23469lb # [ 20.688756] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3470lb # [ 20.691051] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3471lb # [ 20.695646] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3472lb # [ 20.702563] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3473lb # [ 20.711593] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3474lb # [ 20.716533] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3475lb # [ 20.721457] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3476lb # [ 20.727635] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3477lb # [ 20.732388] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3478lb # [ 20.740520] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3479lb # [ 20.744104] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3480lb # [ 20.746317] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3481lb # [ 20.749397] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3482lb # [ 20.753129] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3483lb # [ 20.755462] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3484lb # [ 20.758079] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3485lb # [ 20.761228] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23486lb # [ 20.766706] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3487lb # [ 20.774181] envoy[921]: [2026-09-20 13:33:53.135][921][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3488lb # [ 20.779021] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3489lb # [ 20.784943] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3490lb # [ 20.788882] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3491lb # [ 20.791106] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3492lb # [ 20.794728] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3493lb # [ 20.802914] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3494lb # [ 20.806412] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3495lb # [ 20.808689] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3496lb # [ 20.810875] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3497lb # [ 20.814672] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3498lb # [ 20.847042] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3499lb # [ 20.856043] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3500lb # [ 20.858071] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3501lb # [ 20.862587] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3502lb # [ 20.864820] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3503lb # [ 20.867560] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3504lb # [ 20.870653] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3505lb # [ 20.873361] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3506lb # [ 20.876538] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3507lb # [ 20.878749] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3508lb # [ 20.880704] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3509lb # [ 20.882334] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3510lb # [ 20.884655] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3511lb # [ 20.888514] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3512lb # [ 20.891252] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3513lb # [ 20.898214] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3514lb # [ 20.900071] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3515lb # [ 20.902905] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3516lb # [ 20.914739] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3517lb # [ 20.916941] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3518lb # [ 20.919276] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3519lb # [ 20.921651] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3520lb # [ 20.925229] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3521lb # [ 20.927861] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3522lb # [ 20.933614] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3523lb # [ 20.938511] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3524lb # [ 20.946406] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3525lb # [ 20.948588] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3526lb # [ 20.950302] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13527lb # [ 20.952748] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3528lb # [ 20.954995] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3529lb # [ 20.957192] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83530lb # [ 20.959197] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3531lb # [ 20.961484] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3532lb # [ 20.964471] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3533lb # [ 20.967603] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3534lb # [ 20.969639] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3535lb # [ 20.972547] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3536lb # [ 20.974338] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3537lb # [ 20.979820] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3538lb # [ 20.994076] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3539lb # [ 20.995946] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23540lb # [ 20.998011] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3541lb # [ 21.000456] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3542lb # [ 21.002727] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3543lb # [ 21.005162] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3544lb # [ 21.007212] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3545lb # [ 21.010007] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3546lb # [ 21.017521] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3547lb # [ 21.020029] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3548lb # [ 21.021922] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3549lb # [ 21.024932] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3550lb # [ 21.027170] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3551lb # [ 21.029402] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3552lb # [ 21.031855] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3553lb # [ 21.035892] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3554lb # [ 21.038352] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3555lb # [ 21.042059] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3556lb # [ 21.045056] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3557lb # [ 21.047882] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3558lb # [ 21.050782] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3559lb # [ 21.055773] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3560lb # [ 21.058477] envoy[921]: [2026-09-20 13:33:53.136][921][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3561lb # [ 21.063534] envoy[921]: [2026-09-20 13:33:53.166][921][info][main] [source/server/server.cc:531] HTTP header map info:3562lb # [ 21.066650] envoy[921]: [2026-09-20 13:33:53.171][921][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3563lb # [ 21.083007] envoy[921]: [2026-09-20 13:33:53.171][921][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3564lb # [ 21.084974] envoy[921]: [2026-09-20 13:33:53.171][921][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3565lb # [ 21.094414] envoy[921]: [2026-09-20 13:33:53.171][921][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3566lb # [ 21.096646] envoy[921]: [2026-09-20 13:33:53.321][921][info][main] [source/server/server.cc:968] runtime: {}3567lb # [ 21.098075] envoy[921]: [2026-09-20 13:33:53.333][921][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3568lb # [ 21.099882] envoy[921]: [2026-09-20 13:33:53.333][921][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013569lb # [ 21.101961] envoy[921]: [2026-09-20 13:33:53.333][921][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013570lb # [ 21.103705] envoy[921]: [2026-09-20 13:33:53.374][921][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3571lb # [ 21.105796] envoy[921]: [2026-09-20 13:33:53.375][921][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3572lb # [ 21.107457] envoy[921]: [2026-09-20 13:33:53.375][921][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3573lb # [ 21.123145] envoy[921]: [2026-09-20 13:33:53.642][921][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3574worker2 # [ 21.125818] systemd[1]: Reached target Network is Online.3575lb # [ 21.135084] envoy[921]: [2026-09-20 13:33:53.654][921][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3576worker2 # [ 21.137789] systemd[1]: Starting scheduler-token.service...3577worker1 # [ 21.165585] systemd[1]: Starting Nix worker-protocol over gRPC...3578lb # [ 21.138260] envoy[921]: [2026-09-20 13:33:53.657][921][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3579lb # [ 21.141722] envoy[921]: [2026-09-20 13:33:53.657][921][info][main] [source/server/server.cc:1077] starting main dispatch loop3580worker2 # [ 21.283316] systemd[1]: scheduler-token.service: Deactivated successfully.3581worker2 # [ 21.287372] systemd[1]: Finished scheduler-token.service.3582worker2 # [ 21.293213] systemd[1]: scheduler-token.service: Consumed 59ms CPU time over 148ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3583worker2 # [ 21.299443] systemd[1]: Starting Nix worker-protocol over gRPC...3584worker1 # [ 21.408942] nix-grpc-daemon[775]: ts=2026-09-20T13:33:53Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3585worker1 # [ 21.422118] nix-grpc-daemon[775]: ts=2026-09-20T13:33:53Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3586worker1 # [ 21.424666] nix-grpc-daemon[775]: ts=2026-09-20T13:33:53Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13587worker1 # [ 21.463307] nix-grpc-daemon[775]: ts=2026-09-20T13:33:53Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3588worker1 # [ 21.468733] systemd[1]: Started Nix worker-protocol over gRPC.3589worker1 # [ 21.497313] nix-grpc-daemon[775]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3590lb # [ 21.469507] envoy[921]: [2026-09-20 13:33:53.987][921][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3591lb # [ 21.477419] envoy[921]: [2026-09-20 13:33:53.987][921][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3592lb # [ 21.484206] envoy[921]: [2026-09-20 13:33:53.987][921][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3593lb # [ 21.489445] envoy[921]: [2026-09-20 13:33:53.988][921][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3594worker2 # [ 21.533549] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3595worker2 # [ 21.546948] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3596worker2 # [ 21.549214] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13597worker2 # [ 21.593101] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3598worker2 # [ 21.600347] systemd[1]: Started Nix worker-protocol over gRPC.3599worker2 # [ 21.647064] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_connected addr=lb:500513600worker2 # [ 21.653064] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3601worker1 # [ 21.698415] nix-grpc-daemon[775]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3602worker2 # [ 21.855285] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_connected addr=lb:500513603worker2 # [ 21.861050] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3604worker2 # [ 22.062058] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_connected addr=lb:500513605worker2 # [ 22.065092] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3606worker1 # [ 22.099172] nix-grpc-daemon[775]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3607worker2 # [ 22.266886] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_connected addr=lb:500513608worker2 # [ 22.272900] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3609worker2 # [ 22.474183] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_connected addr=lb:500513610worker2 # [ 22.479824] nix-grpc-daemon[778]: ts=2026-09-20T13:33:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3611worker2 # [ 22.683066] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513612worker2 # [ 22.687398] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3613worker1 # [ 22.902796] nix-grpc-daemon[775]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513614worker1 # [ 22.903249] nix-grpc-daemon[775]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3615worker2 # [ 22.884332] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513616worker2 # [ 22.889985] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3617worker1 # [ 23.103770] nix-grpc-daemon[775]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513618worker1 # [ 23.108095] nix-grpc-daemon[775]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3619worker2 # [ 23.091412] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513620worker2 # [ 23.096282] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3621worker1 # [ 23.309150] nix-grpc-daemon[775]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513622worker1 # [ 23.315636] nix-grpc-daemon[775]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3623worker2 # [ 23.297629] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_connected addr=lb:500513624worker2 # [ 23.303269] nix-grpc-daemon[778]: ts=2026-09-20T13:33:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3625worker1 # [ 23.516439] nix-grpc-daemon[775]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513626worker1 # [ 23.521883] nix-grpc-daemon[775]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3627worker2 # [ 23.504644] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513628worker2 # [ 23.508223] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3629worker1 # [ 23.723331] nix-grpc-daemon[775]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513630worker1 # [ 23.729272] nix-grpc-daemon[775]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3631worker2 # [ 23.711737] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513632worker2 # [ 23.716330] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3633worker1 # [ 23.932257] nix-grpc-daemon[775]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513634worker1 # [ 23.936516] nix-grpc-daemon[775]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3635worker2 # [ 23.912513] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513636worker2 # [ 23.917419] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3637worker1 # [ 24.133262] nix-grpc-daemon[775]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513638worker1 # [ 24.138888] nix-grpc-daemon[775]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3639worker2 # [ 24.118998] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513640worker2 # [ 24.124584] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3641worker1 # [ 24.339642] nix-grpc-daemon[775]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513642worker1 # [ 24.343480] nix-grpc-daemon[775]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3643worker2 # [ 24.326347] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_connected addr=lb:500513644worker2 # [ 24.332096] nix-grpc-daemon[778]: ts=2026-09-20T13:33:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3645worker1 # [ 24.545221] nix-grpc-daemon[775]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513646worker1 # [ 24.550683] nix-grpc-daemon[775]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3647worker2 # [ 24.533484] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513648worker2 # [ 24.539319] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3649worker1 # [ 24.747671] nix-grpc-daemon[775]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513650worker1 # [ 24.753563] nix-grpc-daemon[775]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3651worker2 # [ 24.743137] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513652worker2 # [ 24.747830] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3653worker1 # [ 24.957111] nix-grpc-daemon[775]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513654worker1 # [ 24.961663] nix-grpc-daemon[775]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3655worker2 # [ 24.944085] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513656worker2 # [ 24.949897] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3657worker1 # [ 25.158063] nix-grpc-daemon[775]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513658worker1 # [ 25.163913] nix-grpc-daemon[775]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3659worker2 # [ 25.152315] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513660worker2 # [ 25.158690] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3661worker1 # [ 25.365149] nix-grpc-daemon[775]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513662worker1 # [ 25.370996] nix-grpc-daemon[775]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3663worker2 # [ 25.360218] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_connected addr=lb:500513664worker2 # [ 25.366021] nix-grpc-daemon[778]: ts=2026-09-20T13:33:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3665worker1 # [ 25.572116] nix-grpc-daemon[775]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513666worker1 # [ 25.577930] nix-grpc-daemon[775]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3667worker2 # [ 25.567819] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513668worker2 # [ 25.573854] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3669worker1 # [ 25.779049] nix-grpc-daemon[775]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513670worker1 # [ 25.784987] nix-grpc-daemon[775]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3671worker2 # [ 25.777079] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513672worker2 # [ 25.782392] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3673worker1 # [ 25.988345] nix-grpc-daemon[775]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513674worker1 # [ 25.992737] nix-grpc-daemon[775]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3675worker2 # [ 25.983262] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513676worker2 # [ 25.985685] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3677worker1 # [ 26.189341] nix-grpc-daemon[775]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513678worker1 # [ 26.195195] nix-grpc-daemon[775]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3679worker2 # [ 26.187413] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513680worker2 # [ 26.193248] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3681worker1 # [ 26.396147] nix-grpc-daemon[775]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513682worker1 # [ 26.403863] nix-grpc-daemon[775]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3683worker2 # [ 26.394562] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_connected addr=lb:500513684worker2 # [ 26.406217] nix-grpc-daemon[778]: ts=2026-09-20T13:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3685worker1 # [ 26.603026] nix-grpc-daemon[775]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513686worker1 # [ 26.608663] nix-grpc-daemon[775]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3687worker2 # [ 26.603622] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513688worker2 # [ 26.609428] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3689worker1 # [ 26.809848] nix-grpc-daemon[775]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513690worker1 # [ 26.815287] nix-grpc-daemon[775]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3691worker2 # [ 26.813004] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513692worker2 # [ 26.817279] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3693worker1 # [ 27.018452] nix-grpc-daemon[775]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513694worker1 # [ 27.022899] nix-grpc-daemon[775]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3695worker2 # [ 27.013984] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513696worker2 # [ 27.019498] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3697worker1 # [ 27.219304] nix-grpc-daemon[775]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513698worker1 # [ 27.224836] nix-grpc-daemon[775]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3699worker2 # [ 27.221142] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513700worker2 # [ 27.226649] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3701worker1 # [ 27.425819] nix-grpc-daemon[775]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513702worker1 # [ 27.431360] nix-grpc-daemon[775]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3703worker2 # [ 27.428403] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_connected addr=lb:500513704worker2 # [ 27.433995] nix-grpc-daemon[778]: ts=2026-09-20T13:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3705worker1 # [ 27.632393] nix-grpc-daemon[775]: ts=2026-09-20T13:34:00Z level=info event=scheduler_connected addr=lb:500513706worker1 # [ 27.638216] nix-grpc-daemon[775]: ts=2026-09-20T13:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3707worker2 # [ 27.635714] nix-grpc-daemon[778]: ts=2026-09-20T13:34:00Z level=info event=scheduler_connected addr=lb:500513708worker2 # [ 27.642160] nix-grpc-daemon[778]: ts=2026-09-20T13:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3709worker1 # [ 27.839517] nix-grpc-daemon[775]: ts=2026-09-20T13:34:00Z level=info event=scheduler_connected addr=lb:500513710worker1 # [ 27.846281] nix-grpc-daemon[775]: ts=2026-09-20T13:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3711worker2 # [ 27.845546] nix-grpc-daemon[778]: ts=2026-09-20T13:34:00Z level=info event=scheduler_connected addr=lb:500513712worker2 # [ 27.850979] nix-grpc-daemon[778]: ts=2026-09-20T13:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3713worker1 # [ 28.047064] nix-grpc-daemon[775]: ts=2026-09-20T13:34:00Z level=info event=scheduler_connected addr=lb:500513714worker1 # [ 28.051289] nix-grpc-daemon[775]: ts=2026-09-20T13:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3715worker2 # [ 28.052559] nix-grpc-daemon[778]: ts=2026-09-20T13:34:00Z level=info event=scheduler_connected addr=lb:500513716worker2 # [ 28.058450] nix-grpc-daemon[778]: ts=2026-09-20T13:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3717worker1 # [ 28.252705] nix-grpc-daemon[775]: ts=2026-09-20T13:34:00Z level=info event=scheduler_connected addr=lb:500513718worker1 # [ 28.259641] nix-grpc-daemon[775]: ts=2026-09-20T13:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3719worker2 # [ 28.260140] nix-grpc-daemon[778]: ts=2026-09-20T13:34:00Z level=info event=scheduler_connected addr=lb:500513720worker2 # [ 28.266014] nix-grpc-daemon[778]: ts=2026-09-20T13:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3721worker1 # [ 28.460627] nix-grpc-daemon[775]: ts=2026-09-20T13:34:00Z level=info event=scheduler_connected addr=lb:500513722worker1 # [ 28.466074] nix-grpc-daemon[775]: ts=2026-09-20T13:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3723worker2 # [ 28.467406] nix-grpc-daemon[778]: ts=2026-09-20T13:34:00Z level=info event=scheduler_connected addr=lb:500513724worker2 # [ 28.473140] nix-grpc-daemon[778]: ts=2026-09-20T13:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3725worker1 # [ 28.667183] nix-grpc-daemon[775]: ts=2026-09-20T13:34:01Z level=info event=scheduler_connected addr=lb:500513726worker1 # [ 28.672856] nix-grpc-daemon[775]: ts=2026-09-20T13:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3727worker2 # [ 28.674251] nix-grpc-daemon[778]: ts=2026-09-20T13:34:01Z level=info event=scheduler_connected addr=lb:500513728worker2 # [ 28.679981] nix-grpc-daemon[778]: ts=2026-09-20T13:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3729worker1 # [ 28.873535] nix-grpc-daemon[775]: ts=2026-09-20T13:34:01Z level=info event=scheduler_connected addr=lb:500513730worker1 # [ 28.877346] nix-grpc-daemon[775]: ts=2026-09-20T13:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3731worker2 # [ 28.883603] nix-grpc-daemon[778]: ts=2026-09-20T13:34:01Z level=info event=scheduler_connected addr=lb:500513732worker2 # [ 28.888113] nix-grpc-daemon[778]: ts=2026-09-20T13:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3733worker1 # [ 29.079734] nix-grpc-daemon[775]: ts=2026-09-20T13:34:01Z level=info event=scheduler_connected addr=lb:500513734worker1 # [ 29.085258] nix-grpc-daemon[775]: ts=2026-09-20T13:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3735worker2 # [ 29.084248] nix-grpc-daemon[778]: ts=2026-09-20T13:34:01Z level=info event=scheduler_connected addr=lb:500513736worker2 # [ 29.089732] nix-grpc-daemon[778]: ts=2026-09-20T13:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3737worker1 # [ 29.286157] nix-grpc-daemon[775]: ts=2026-09-20T13:34:01Z level=info event=scheduler_connected addr=lb:500513738worker1 # [ 29.291492] nix-grpc-daemon[775]: ts=2026-09-20T13:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3739worker2 # [ 29.290604] nix-grpc-daemon[778]: ts=2026-09-20T13:34:01Z level=info event=scheduler_connected addr=lb:500513740worker2 # [ 29.293268] nix-grpc-daemon[778]: ts=2026-09-20T13:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3741worker1 # [ 29.492549] nix-grpc-daemon[775]: ts=2026-09-20T13:34:02Z level=info event=scheduler_connected addr=lb:500513742worker1 # [ 29.498076] nix-grpc-daemon[775]: ts=2026-09-20T13:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3743worker2 # [ 29.494880] nix-grpc-daemon[778]: ts=2026-09-20T13:34:02Z level=info event=scheduler_connected addr=lb:500513744worker2 # [ 29.500559] nix-grpc-daemon[778]: ts=2026-09-20T13:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3745worker1 # [ 29.702703] nix-grpc-daemon[775]: ts=2026-09-20T13:34:02Z level=info event=scheduler_connected addr=lb:500513746worker1 # [ 29.707785] nix-grpc-daemon[775]: ts=2026-09-20T13:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3747worker2 # [ 29.701995] nix-grpc-daemon[778]: ts=2026-09-20T13:34:02Z level=info event=scheduler_connected addr=lb:500513748worker2 # [ 29.709560] nix-grpc-daemon[778]: ts=2026-09-20T13:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3749worker1 # [ 29.903797] nix-grpc-daemon[775]: ts=2026-09-20T13:34:02Z level=info event=scheduler_connected addr=lb:500513750worker1 # [ 29.909382] nix-grpc-daemon[775]: ts=2026-09-20T13:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3751worker2 # [ 29.910925] nix-grpc-daemon[778]: ts=2026-09-20T13:34:02Z level=info event=scheduler_connected addr=lb:500513752worker2 # [ 29.915297] nix-grpc-daemon[778]: ts=2026-09-20T13:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3753worker1 # [ 30.112409] nix-grpc-daemon[775]: ts=2026-09-20T13:34:02Z level=info event=scheduler_connected addr=lb:500513754worker1 # [ 30.116620] nix-grpc-daemon[775]: ts=2026-09-20T13:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3755worker2 # [ 30.112142] nix-grpc-daemon[778]: ts=2026-09-20T13:34:02Z level=info event=scheduler_connected addr=lb:500513756worker2 # [ 30.117600] nix-grpc-daemon[778]: ts=2026-09-20T13:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3757worker1 # [ 30.313320] nix-grpc-daemon[775]: ts=2026-09-20T13:34:02Z level=info event=scheduler_connected addr=lb:500513758worker1 # [ 30.318755] nix-grpc-daemon[775]: ts=2026-09-20T13:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3759worker2 # [ 30.318936] nix-grpc-daemon[778]: ts=2026-09-20T13:34:02Z level=info event=scheduler_connected addr=lb:500513760worker2 # [ 30.324515] nix-grpc-daemon[778]: ts=2026-09-20T13:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3761worker1 # [ 30.519826] nix-grpc-daemon[775]: ts=2026-09-20T13:34:03Z level=info event=scheduler_connected addr=lb:500513762worker1 # [ 30.527288] nix-grpc-daemon[775]: ts=2026-09-20T13:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3763worker2 # [ 30.526076] nix-grpc-daemon[778]: ts=2026-09-20T13:34:03Z level=info event=scheduler_connected addr=lb:500513764worker2 # [ 30.531764] nix-grpc-daemon[778]: ts=2026-09-20T13:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3765worker1 # [ 30.727356] nix-grpc-daemon[775]: ts=2026-09-20T13:34:03Z level=info event=scheduler_connected addr=lb:500513766worker1 # [ 30.732895] nix-grpc-daemon[775]: ts=2026-09-20T13:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3767worker2 # [ 30.733136] nix-grpc-daemon[778]: ts=2026-09-20T13:34:03Z level=info event=scheduler_connected addr=lb:500513768worker2 # [ 30.738670] nix-grpc-daemon[778]: ts=2026-09-20T13:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3769worker1 # [ 30.933884] nix-grpc-daemon[775]: ts=2026-09-20T13:34:03Z level=info event=scheduler_connected addr=lb:500513770worker1 # [ 30.939359] nix-grpc-daemon[775]: ts=2026-09-20T13:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3771worker2 # [ 30.942167] nix-grpc-daemon[778]: ts=2026-09-20T13:34:03Z level=info event=scheduler_connected addr=lb:500513772worker2 # [ 30.946632] nix-grpc-daemon[778]: ts=2026-09-20T13:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3773worker1 # [ 31.142563] nix-grpc-daemon[775]: ts=2026-09-20T13:34:03Z level=info event=scheduler_connected addr=lb:500513774worker1 # [ 31.146912] nix-grpc-daemon[775]: ts=2026-09-20T13:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3775worker2 # [ 31.143069] nix-grpc-daemon[778]: ts=2026-09-20T13:34:03Z level=info event=scheduler_connected addr=lb:500513776worker2 # [ 31.148779] nix-grpc-daemon[778]: ts=2026-09-20T13:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3777worker1 # [ 31.343225] nix-grpc-daemon[775]: ts=2026-09-20T13:34:03Z level=info event=scheduler_connected addr=lb:500513778worker1 # [ 31.348731] nix-grpc-daemon[775]: ts=2026-09-20T13:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3779worker2 # [ 31.350061] nix-grpc-daemon[778]: ts=2026-09-20T13:34:03Z level=info event=scheduler_connected addr=lb:500513780worker2 # [ 31.355668] nix-grpc-daemon[778]: ts=2026-09-20T13:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3781worker1 # [ 31.549421] nix-grpc-daemon[775]: ts=2026-09-20T13:34:04Z level=info event=scheduler_connected addr=lb:500513782worker1 # [ 31.554929] nix-grpc-daemon[775]: ts=2026-09-20T13:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3783worker2 # [ 31.556898] nix-grpc-daemon[778]: ts=2026-09-20T13:34:04Z level=info event=scheduler_connected addr=lb:500513784lb # [ 31.561940] rustfs-bucket-start[1032]: mb s3://farm3785worker2 # [ 31.562247] nix-grpc-daemon[778]: ts=2026-09-20T13:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3786lb # [ 31.573726] systemd[1]: Finished rustfs-bucket.service.3787lb # [ 31.584738] systemd[1]: Starting niks3 server...3788worker1 # [ 31.755397] nix-grpc-daemon[775]: ts=2026-09-20T13:34:04Z level=info event=scheduler_connected addr=lb:500513789worker1 # [ 31.759052] nix-grpc-daemon[775]: ts=2026-09-20T13:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3790worker2 # [ 31.763665] nix-grpc-daemon[778]: ts=2026-09-20T13:34:04Z level=info event=scheduler_connected addr=lb:500513791worker2 # [ 31.769362] nix-grpc-daemon[778]: ts=2026-09-20T13:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3792lb # [ 31.809008] postgres[1048]: [1048] ERROR: relation "goose_db_version" does not exist at character 363793lb # [ 31.810307] postgres[1048]: [1048] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3794lb # [ 31.843991] niks3-server[1041]: 2026/09/20 13:34:04 OK 20241026095416_initial_model.sql (20.63ms)3795lb # [ 31.847394] niks3-server[1041]: 2026/09/20 13:34:04 OK 20251210153512_drop_unused_gin_index.sql (3.8ms)3796lb # [ 31.853223] niks3-server[1041]: 2026/09/20 13:34:04 OK 20251218171726_add_pins.sql (5.79ms)3797lb # [ 31.857968] niks3-server[1041]: 2026/09/20 13:34:04 OK 20260628120000_add_object_size_and_stats.sql (4.7ms)3798lb # [ 31.862893] niks3-server[1041]: 2026/09/20 13:34:04 OK 20260905000000_add_claims.sql (4.89ms)3799lb # [ 31.867626] niks3-server[1041]: 2026/09/20 13:34:04 OK 20260920000000_drop_claims.sql (4.6ms)3800lb # [ 31.869764] niks3-server[1041]: 2026/09/20 13:34:04 goose: successfully migrated database to version: 202609200000003801lb # [ 31.874159] niks3-server[1041]: 2026/09/20 13:34:04 OK 1_commit_pending_closure.sql (6.5ms)3802lb # [ 31.876896] niks3-server[1041]: 2026/09/20 13:34:04 OK 2_object_stats_trigger.sql (2.59ms)3803lb # [ 31.878286] niks3-server[1041]: 2026/09/20 13:34:04 goose: up to current file version: 23804lb # [ 31.883404] niks3-server[1041]: 2026/09/20 13:34:04 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3805lb # [ 31.929175] niks3-server[1041]: 2026/09/20 13:34:04 INFO Read proxy enabled — serving cache objects from S33806lb # [ 31.931796] niks3-server[1041]: 2026/09/20 13:34:04 INFO Using socket-activated listener address=0.0.0.0:57513807worker1 # [ 31.959974] nix-grpc-daemon[775]: ts=2026-09-20T13:34:04Z level=info event=scheduler_connected addr=lb:500513808lb # [ 31.935716] niks3-server[1041]: 2026/09/20 13:34:04 INFO systemd watchdog enabled interval=15s3809worker1 # [ 31.965214] nix-grpc-daemon[775]: ts=2026-09-20T13:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3810lb # [ 31.941833] systemd[1]: Started niks3 server.3811lb # [ 31.942494] niks3-server[1041]: 2026/09/20 13:34:04 INFO Starting HTTP server address=0.0.0.0:57513812lb # [ 31.947914] systemd[1]: Reached target Multi-User System.3813lb # [ 31.952356] niks3-server[1041]: 2026/09/20 13:34:04 INFO lead: acquired remote=192.168.1.4:597563814lb # [ 31.956486] systemd[1]: Startup finished in 1.056s (kernel) + 5.540s (initrd) + 25.343s (userspace) = 31.940s.3815worker2 # [ 31.956836] nix-grpc-daemon[778]: ts=2026-09-20T13:34:04Z level=info event=scheduler_take_over3816worker2 # [ 31.970551] nix-grpc-daemon[778]: ts=2026-09-20T13:34:04Z level=info event=scheduler_connected addr=lb:500513817worker2 # [ 31.976155] nix-grpc-daemon[778]: ts=2026-09-20T13:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3818lb: (finished: waiting for unit niks3.service, in 17.21 seconds)3819lb: waiting for TCP port 5751 on localhost3820lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3821lb: (finished: waiting for TCP port 5751 on localhost, in 0.06 seconds)3822lb: waiting for unit envoy.service3823worker1 # [ 32.167883] nix-grpc-daemon[775]: ts=2026-09-20T13:34:04Z level=info event=scheduler_connected addr=lb:500513824worker1 # [ 32.172227] nix-grpc-daemon[775]: ts=2026-09-20T13:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3825lb: (finished: waiting for unit envoy.service, in 0.06 seconds)3826lb: waiting for TCP port 50051 on localhost3827worker2 # [ 32.177613] nix-grpc-daemon[778]: ts=2026-09-20T13:34:04Z level=info event=scheduler_connected addr=lb:500513828worker2 # [ 32.183124] nix-grpc-daemon[778]: ts=2026-09-20T13:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3829lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3830lb # [ 32.212127] envoy[921]: conn peer=[::1]:50676 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33831lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)3832worker1 # [ 32.368825] nix-grpc-daemon[775]: ts=2026-09-20T13:34:04Z level=info event=scheduler_connected addr=lb:500513833worker1 # [ 32.374119] nix-grpc-daemon[775]: ts=2026-09-20T13:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3834worker2 # [ 32.386113] nix-grpc-daemon[778]: ts=2026-09-20T13:34:04Z level=info event=scheduler_connected addr=lb:500513835worker2 # [ 32.390314] nix-grpc-daemon[778]: ts=2026-09-20T13:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3836worker2 # [ 32.406112] systemd[1]: Starting scheduler-token.service...3837worker2 # [ 32.501773] systemd[1]: scheduler-token.service: Deactivated successfully.3838worker2 # [ 32.506931] systemd[1]: Finished scheduler-token.service.3839worker2 # [ 32.508891] systemd[1]: scheduler-token.service: Consumed 41ms CPU time over 108ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3840lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3841??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3842 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283843lb: must succeed: curl -sf localhost:9901/clusters3844worker1 # [ 32.574729] nix-grpc-daemon[775]: ts=2026-09-20T13:34:05Z level=info event=scheduler_connected addr=lb:500513845worker1 # [ 32.580350] nix-grpc-daemon[775]: ts=2026-09-20T13:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3846worker2 # [ 32.587532] nix-grpc-daemon[778]: ts=2026-09-20T13:34:05Z level=info event=scheduler_connected addr=lb:500513847worker2 # [ 32.593066] nix-grpc-daemon[778]: ts=2026-09-20T13:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3848lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)3849lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds)3850subtest: one node schedules and both builders hold a WorkerSession on it3851lb: must succeed: curl -sf localhost:9901/clusters3852lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3853worker1 # [ 32.781142] nix-grpc-daemon[775]: ts=2026-09-20T13:34:05Z level=info event=scheduler_connected addr=lb:500513854worker2 # [ 32.756761] nix-grpc-daemon[778]: ts=2026-09-20T13:34:05Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:416383855worker2 # [ 32.763078] nix-grpc-daemon[778]: ts=2026-09-20T13:34:05Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03856worker2 # [ 32.794012] nix-grpc-daemon[778]: ts=2026-09-20T13:34:05Z level=info event=scheduler_connected addr=lb:500513857worker2 # [ 32.812152] nix-grpc-daemon[778]: ts=2026-09-20T13:34:05Z level=info event=oidc_jwks provider=mock keys=13858worker2 # [ 32.817127] nix-grpc-daemon[778]: ts=2026-09-20T13:34:05Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:416383859worker2 # [ 32.824157] nix-grpc-daemon[778]: ts=2026-09-20T13:34:05Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03860lb: must succeed: curl -sf localhost:9901/clusters3861lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)3862worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3863worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)3864lb: must succeed: curl -sf localhost:9901/clusters3865lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)3866lb: must succeed: curl -sf localhost:9901/clusters3867lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3868worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open'3869worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.07 seconds)3870(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 1.47 seconds)3871subtest: balancer auth: client cert, bearer token, nothing, unknown CN3872worker1 # [ 34.493449] nix-grpc-daemon[775]: ts=2026-09-20T13:34:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:427723873worker1 # [ 34.513717] systemd[1]: Started Nix Daemon.3874worker1 # [ 34.880843] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3875worker1 # [ 34.928163] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 96 ms (attempt 1/5)3876worker1 # [ 35.028882] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 107 ms (attempt 2/5)3877worker1 # [ 35.144196] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 3/5)3878worker1 # [ 35.231270] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 371 ms (attempt 4/5)3879worker1 # [ 35.614258] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3880worker2 # [ 35.637617] nix-grpc-daemon[778]: ts=2026-09-20T13:34:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:416543881worker2 # [ 35.653324] systemd[1]: Started Nix Daemon.3882worker2 # [ 35.985321] nix-daemon[847]: accepted connection from pid 778, user nix-grpc-daemon (trusted)3883worker2 # [ 36.015827] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 1/5)3884worker2 # [ 36.102513] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 27 ms (attempt 2/5)3885worker2 # [ 36.137442] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 175 ms (attempt 3/5)3886worker2 # [ 36.322079] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 726 ms (attempt 4/5)3887worker2 # [ 37.052936] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3888worker2 # [ 37.074539] nix-grpc-daemon[778]: ts=2026-09-20T13:34:09Z level=debug event=path_info_miss path=b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test error="error: path '/nix/store/b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test' is required, but there is no substituter that can build it"3889worker2 # [ 37.090186] nix-grpc-daemon[778]: ts=2026-09-20T13:34:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:416543890worker2 # [ 37.105914] nix-grpc-daemon[778]: ts=2026-09-20T13:34:09Z level=debug event=path_info_miss path=b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test error="error: path '/nix/store/b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test' is required, but there is no substituter that can build it"3891client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3892client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds)3893client: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3894client: (finished: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3895worker1 # [ 37.614130] nix-grpc-daemon[775]: ts=2026-09-20T13:34:10Z level=info event=oidc_jwks provider=mock keys=13896worker1 # [ 37.614635] nix-grpc-daemon[775]: ts=2026-09-20T13:34:10Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:427723897worker2 # [ 37.608246] nix-grpc-daemon[778]: ts=2026-09-20T13:34:10Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:416543898worker2 # [ 37.624968] nix-grpc-daemon[778]: ts=2026-09-20T13:34:10Z level=debug event=path_info_miss path=b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test error="error: path '/nix/store/b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test' is required, but there is no substituter that can build it"3899worker2 # [ 37.641510] nix-grpc-daemon[778]: ts=2026-09-20T13:34:10Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:416543900worker2 # [ 37.651063] nix-grpc-daemon[778]: ts=2026-09-20T13:34:10Z level=debug event=path_info_miss path=b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test error="error: path '/nix/store/b28gwi5wgrhykr5b1hwypq5zc6p40hm2-nixos-system-client-test' is required, but there is no substituter that can build it"3901client: must succeed: rm -r /var/lib/nix-grpc-store3902client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds)3903worker1 # [ 38.043748] nix-grpc-daemon[775]: ts=2026-09-20T13:34:10Z level=info event=denied method=QueryMissing cn=- role=none3904worker2 # [ 38.326473] nix-grpc-daemon[778]: ts=2026-09-20T13:34:10Z level=info event=denied method=QueryMissing cn=stranger role=none3905(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 4.28 seconds)3906subtest: DAG build is scheduled across workers and lands in the cache3907client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23908worker2 # [ 38.616790] nix-grpc-daemon[778]: ts=2026-09-20T13:34:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:416543909client # don't know how to build these paths:3910client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3911worker2 # [ 38.634793] nix-grpc-daemon[778]: ts=2026-09-20T13:34:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416543912worker2 # [ 38.683301] nix-grpc-daemon[778]: ts=2026-09-20T13:34:11Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03913worker2 # [ 38.690518] nix-grpc-daemon[778]: ts=2026-09-20T13:34:11Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13914worker1 # [ 38.779208] nix-grpc-daemon[775]: ts=2026-09-20T13:34:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:427723915worker1 # [ 38.802832] nix-grpc-daemon[775]: ts=2026-09-20T13:34:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:427723916client # copying 1 paths to 'lb:50051'...3917worker1 # [ 38.821456] nix-grpc-daemon[775]: ts=2026-09-20T13:34:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:427723918client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3919worker1 # [ 38.847409] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3920worker1 # [ 38.872550] nix-grpc-daemon[775]: ts=2026-09-20T13:34:11Z level=info event=niks3_push_started pid=8433921worker1 # [ 39.179650] nix-grpc-daemon[843]: time=2026-09-20T13:34:11.688Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""3922worker1 # [ 39.399322] nix-daemon[833]: accepted connection from pid 856, user nix-grpc-daemon (trusted)3923worker1 # [ 39.421093] nix-daemon[833]: reaped child process 859, status = succeeded3924worker1 # [ 39.630393] nix-daemon[833]: accepted connection from pid 861, user nix-grpc-daemon (trusted)3925worker1 # [ 39.653440] nix-daemon[833]: reaped child process 864, status = succeeded3926lb # [ 39.638995] niks3-server[1041]: 2026/09/20 13:34:12 INFO Received uploads request method=POST path=/api/pending_closures3927worker1 # [ 39.706831] nix-grpc-daemon[843]: time=2026-09-20T13:34:12.217Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3928worker1 # [ 39.711197] nix-grpc-daemon[843]: time=2026-09-20T13:34:12.219Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3929lb # [ 39.735283] niks3-server[1041]: 2026/09/20 13:34:12 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3930lb # [ 39.745954] niks3-server[1041]: 2026/09/20 13:34:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3931lb # [ 39.755940] niks3-server[1041]: 2026/09/20 13:34:12 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3932lb # [ 39.780492] niks3-server[1041]: 2026/09/20 13:34:12 INFO Signed narinfos id=1 count=13933worker1 # [ 39.813475] nix-grpc-daemon[843]: time=2026-09-20T13:34:12.323Z level=INFO msg="Uploading 1 narinfos"3934lb # [ 39.797412] niks3-server[1041]: 2026/09/20 13:34:12 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3935lb # [ 39.806503] niks3-server[1041]: 2026/09/20 13:34:12 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3936lb # [ 39.827545] niks3-server[1041]: 2026/09/20 13:34:12 INFO Completed upload id=13937worker1 # [ 39.859454] nix-grpc-daemon[843]: time=2026-09-20T13:34:12.370Z level=INFO msg="Upload complete. (671ms)"3938worker1 # [ 39.870148] nix-grpc-daemon[775]: ts=2026-09-20T13:34:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=1 paths=1 nar_bytes_in=5043939worker1 # [ 39.882761] nix-grpc-daemon[775]: ts=2026-09-20T13:34:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:427723940worker1 # [ 39.890284] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3941worker1 # [ 39.895319] nix-daemon[833]: reaped child process 841, status = succeeded3942worker1 # [ 39.907009] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3943client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3944client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3945client # farm-a> LOG-farm-a-t13946worker1 # [ 41.137294] nix-daemon[833]: reaped child process 869, status = succeeded3947lb # [ 41.132452] envoy[921]: conn peer=[2001:db8:1::1]:33426 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=27023948lb # [ 41.134376] envoy[921]: conn peer=[2001:db8:1::1]:33428 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=1043949lb # [ 41.135857] envoy[921]: conn peer=[2001:db8:1::1]:33436 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=213950lb # [ 41.137495] envoy[921]: conn peer=[2001:db8:1::1]:33450 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=203951worker1 # [ 41.369535] nix-daemon[833]: accepted connection from pid 884, user nix-grpc-daemon (trusted)3952worker1 # [ 41.391244] nix-daemon[833]: reaped child process 887, status = succeeded3953lb # [ 41.378607] niks3-server[1041]: 2026/09/20 13:34:13 INFO Received uploads request method=POST path=/api/pending_closures3954worker1 # [ 41.434408] nix-grpc-daemon[843]: time=2026-09-20T13:34:13.943Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3955worker1 # [ 41.436878] nix-grpc-daemon[843]: time=2026-09-20T13:34:13.943Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3956lb # [ 41.450919] niks3-server[1041]: 2026/09/20 13:34:13 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3957lb # [ 41.455416] niks3-server[1041]: 2026/09/20 13:34:13 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3958lb # [ 41.459910] niks3-server[1041]: 2026/09/20 13:34:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3959worker1 # [ 41.490361] nix-grpc-daemon[843]: time=2026-09-20T13:34:14.000Z level=INFO msg="Uploading 1 narinfos"3960lb # [ 41.462512] niks3-server[1041]: 2026/09/20 13:34:13 INFO Signed narinfos id=2 count=13961lb # [ 41.466012] niks3-server[1041]: 2026/09/20 13:34:13 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3962lb # [ 41.472305] niks3-server[1041]: 2026/09/20 13:34:13 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3963lb # [ 41.479053] niks3-server[1041]: 2026/09/20 13:34:13 INFO Completed upload id=23964lb # [ 41.481067] niks3-server[1041]: 2026/09/20 13:34:14 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3965worker1 # [ 41.509591] nix-grpc-daemon[843]: time=2026-09-20T13:34:14.020Z level=INFO msg="Upload complete. (389ms)"3966worker1 # [ 41.521305] nix-grpc-daemon[775]: ts=2026-09-20T13:34:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13967worker1 # [ 41.537446] nix-daemon[833]: reaped child process 867, status = succeeded3968worker2 # [ 41.513927] nix-grpc-daemon[778]: ts=2026-09-20T13:34:14Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03969worker2 # [ 41.515940] nix-grpc-daemon[778]: ts=2026-09-20T13:34:14Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13970worker1 # [ 41.590414] nix-grpc-daemon[775]: ts=2026-09-20T13:34:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:427723971worker1 # [ 41.613271] nix-grpc-daemon[775]: ts=2026-09-20T13:34:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:427723972worker1 # [ 41.633681] nix-grpc-daemon[843]: time=2026-09-20T13:34:14.144Z level=INFO msg="All 1 paths already cached"3973client # copying 1 paths to 'lb:50051'...3974worker1 # [ 41.645950] nix-grpc-daemon[775]: ts=2026-09-20T13:34:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:427723975client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3976worker1 # [ 41.669510] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3977worker1 # [ 41.934132] nix-daemon[833]: accepted connection from pid 891, user nix-grpc-daemon (trusted)3978worker1 # [ 41.960962] nix-daemon[833]: reaped child process 894, status = succeeded3979worker1 # [ 42.161591] nix-daemon[833]: accepted connection from pid 896, user nix-grpc-daemon (trusted)3980worker1 # [ 42.185622] nix-daemon[833]: reaped child process 899, status = succeeded3981lb # [ 42.172242] niks3-server[1041]: 2026/09/20 13:34:14 INFO Received uploads request method=POST path=/api/pending_closures3982worker1 # [ 42.221228] nix-grpc-daemon[843]: time=2026-09-20T13:34:14.732Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3983worker1 # [ 42.223070] nix-grpc-daemon[843]: time=2026-09-20T13:34:14.734Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3984lb # [ 42.239031] niks3-server[1041]: 2026/09/20 13:34:14 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3985lb # [ 42.252167] niks3-server[1041]: 2026/09/20 13:34:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3986lb # [ 42.260357] niks3-server[1041]: 2026/09/20 13:34:14 INFO Signed narinfos id=3 count=13987worker1 # [ 42.291141] nix-grpc-daemon[843]: time=2026-09-20T13:34:14.801Z level=INFO msg="Uploading 1 narinfos"3988lb # [ 42.264828] niks3-server[1041]: 2026/09/20 13:34:14 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3989lb # [ 42.277946] niks3-server[1041]: 2026/09/20 13:34:14 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3990lb # [ 42.290691] niks3-server[1041]: 2026/09/20 13:34:14 INFO Completed upload id=33991worker1 # [ 42.320514] nix-grpc-daemon[843]: time=2026-09-20T13:34:14.831Z level=INFO msg="Upload complete. (625ms)"3992lb # [ 42.294613] niks3-server[1041]: 2026/09/20 13:34:14 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3993worker1 # [ 42.332491] nix-grpc-daemon[775]: ts=2026-09-20T13:34:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=0 paths=1 nar_bytes_in=6243994worker1 # [ 42.348855] nix-grpc-daemon[775]: ts=2026-09-20T13:34:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:427723995worker1 # [ 42.364991] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3996worker1 # [ 42.371679] nix-daemon[833]: reaped child process 889, status = succeeded3997client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3998client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3999worker1 # [ 42.392233] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4000client # farm-b> LOG-farm-b-t14001worker1 # [ 44.058198] nix-daemon[833]: reaped child process 903, status = succeeded4002worker1 # [ 44.275096] nix-daemon[833]: accepted connection from pid 919, user nix-grpc-daemon (trusted)4003worker1 # [ 44.301418] nix-daemon[833]: reaped child process 922, status = succeeded4004lb # [ 44.285204] niks3-server[1041]: 2026/09/20 13:34:16 INFO Received uploads request method=POST path=/api/pending_closures4005worker1 # [ 44.330003] nix-grpc-daemon[843]: time=2026-09-20T13:34:16.839Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4006worker1 # [ 44.331598] nix-grpc-daemon[843]: time=2026-09-20T13:34:16.839Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"4007lb # [ 44.345368] niks3-server[1041]: 2026/09/20 13:34:16 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst4008worker1 # [ 44.389643] nix-grpc-daemon[843]: time=2026-09-20T13:34:16.900Z level=INFO msg="Uploading 1 narinfos"4009lb # [ 44.359030] niks3-server[1041]: 2026/09/20 13:34:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4010lb # [ 44.372335] niks3-server[1041]: 2026/09/20 13:34:16 INFO Signed narinfos id=4 count=14011lb # [ 44.374872] niks3-server[1041]: 2026/09/20 13:34:16 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4012lb # [ 44.391876] niks3-server[1041]: 2026/09/20 13:34:16 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4013worker1 # [ 44.431055] nix-grpc-daemon[843]: time=2026-09-20T13:34:16.942Z level=INFO msg="Upload complete. (422ms)"4014lb # [ 44.405202] niks3-server[1041]: 2026/09/20 13:34:16 INFO Completed upload id=44015lb # [ 44.410722] niks3-server[1041]: 2026/09/20 13:34:16 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo4016worker1 # [ 44.446453] nix-grpc-daemon[775]: ts=2026-09-20T13:34:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=2 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=14017worker2 # [ 44.422149] nix-grpc-daemon[778]: ts=2026-09-20T13:34:16Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=04018worker2 # [ 44.422742] nix-grpc-daemon[778]: ts=2026-09-20T13:34:16Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=14019worker1 # [ 44.468707] nix-grpc-daemon[843]: time=2026-09-20T13:34:16.956Z level=WARN msg="Failed to register uploaded object" key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls error="server returned 404: object is not pending upload\n"4020worker1 # [ 44.477554] nix-daemon[833]: reaped child process 901, status = succeeded4021worker1 # [ 44.499939] nix-grpc-daemon[775]: ts=2026-09-20T13:34:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:427724022worker1 # [ 44.520778] nix-grpc-daemon[775]: ts=2026-09-20T13:34:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:427724023worker1 # [ 44.544929] nix-grpc-daemon[843]: time=2026-09-20T13:34:17.055Z level=INFO msg="All 2 paths already cached"4024client # copying 1 paths to 'lb:50051'...4025client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...4026worker1 # [ 44.558450] nix-grpc-daemon[775]: ts=2026-09-20T13:34:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:427724027worker1 # [ 44.575664] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4028worker1 # [ 44.820076] nix-daemon[833]: accepted connection from pid 926, user nix-grpc-daemon (trusted)4029worker1 # [ 44.844917] nix-daemon[833]: reaped child process 929, status = succeeded4030worker1 # [ 45.036624] nix-daemon[833]: accepted connection from pid 931, user nix-grpc-daemon (trusted)4031worker1 # [ 45.058757] nix-daemon[833]: reaped child process 934, status = succeeded4032lb # [ 45.043341] niks3-server[1041]: 2026/09/20 13:34:17 INFO Received uploads request method=POST path=/api/pending_closures4033worker1 # [ 45.087951] nix-grpc-daemon[843]: time=2026-09-20T13:34:17.598Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4034worker1 # [ 45.089660] nix-grpc-daemon[843]: time=2026-09-20T13:34:17.598Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"4035lb # [ 45.088672] niks3-server[1041]: 2026/09/20 13:34:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4036worker1 # [ 45.121316] nix-grpc-daemon[843]: time=2026-09-20T13:34:17.632Z level=INFO msg="Uploading 1 narinfos"4037lb # [ 45.095010] niks3-server[1041]: 2026/09/20 13:34:17 INFO Signed narinfos id=5 count=14038lb # [ 45.098119] niks3-server[1041]: 2026/09/20 13:34:17 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst4039lb # [ 45.103110] niks3-server[1041]: 2026/09/20 13:34:17 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls4040lb # [ 45.110998] niks3-server[1041]: 2026/09/20 13:34:17 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4041worker1 # [ 45.144967] nix-grpc-daemon[843]: time=2026-09-20T13:34:17.656Z level=INFO msg="Upload complete. (543ms)"4042lb # [ 45.116437] niks3-server[1041]: 2026/09/20 13:34:17 INFO Completed upload id=54043lb # [ 45.119352] niks3-server[1041]: 2026/09/20 13:34:17 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo4044worker1 # [ 45.149234] nix-grpc-daemon[775]: ts=2026-09-20T13:34:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=0 paths=1 nar_bytes_in=7524045worker1 # [ 45.158570] nix-grpc-daemon[775]: ts=2026-09-20T13:34:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:427724046worker1 # [ 45.160613] nix-daemon[833]: reaped child process 924, status = succeeded4047worker1 # [ 45.164446] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4048client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...4049worker1 # [ 45.176828] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4050client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4051client # farm-top> LOG-farm-top-t14052worker1 # [ 47.008474] nix-daemon[833]: reaped child process 938, status = succeeded4053worker1 # [ 47.206489] nix-daemon[833]: accepted connection from pid 954, user nix-grpc-daemon (trusted)4054worker1 # [ 47.228079] nix-daemon[833]: reaped child process 957, status = succeeded4055lb # [ 47.213776] niks3-server[1041]: 2026/09/20 13:34:19 INFO Received uploads request method=POST path=/api/pending_closures4056worker1 # [ 47.259755] nix-grpc-daemon[843]: time=2026-09-20T13:34:19.768Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4057worker1 # [ 47.261543] nix-grpc-daemon[843]: time=2026-09-20T13:34:19.768Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4058lb # [ 47.260194] niks3-server[1041]: 2026/09/20 13:34:19 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4059lb # [ 47.277810] niks3-server[1041]: 2026/09/20 13:34:19 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4060lb # [ 47.295175] niks3-server[1041]: 2026/09/20 13:34:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4061worker1 # [ 47.331627] nix-grpc-daemon[843]: time=2026-09-20T13:34:19.841Z level=INFO msg="Uploading 1 narinfos"4062lb # [ 47.304678] niks3-server[1041]: 2026/09/20 13:34:19 INFO Signed narinfos id=6 count=14063lb # [ 47.312885] niks3-server[1041]: 2026/09/20 13:34:19 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4064lb # [ 47.325888] niks3-server[1041]: 2026/09/20 13:34:19 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4065lb # [ 47.336522] niks3-server[1041]: 2026/09/20 13:34:19 INFO Completed upload id=64066worker1 # [ 47.367899] nix-grpc-daemon[843]: time=2026-09-20T13:34:19.875Z level=INFO msg="Upload complete. (374ms)"4067lb # [ 47.341320] niks3-server[1041]: 2026/09/20 13:34:19 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4068worker1 # [ 47.377818] nix-grpc-daemon[775]: ts=2026-09-20T13:34:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14069worker1 # [ 47.402119] nix-daemon[833]: reaped child process 936, status = succeeded4070client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 9.06 seconds)4071client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4072client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.29 seconds)4073client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4074client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.04 seconds)4075client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4076client # copying 3 paths...4077client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4078client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4079client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4080client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.36 seconds)4081(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 9.90 seconds)4082subtest: repeat is answered Cached by the scheduler without building4083worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4084worker1 # finding garbage collector roots...4085worker1 # deleting specified paths...4086worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4087worker1 # deleting unused links...4088worker1 # note: hard linking is currently saving 0.0 KiB4089worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.32 seconds)4090worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4091worker2 # finding garbage collector roots...4092worker2 # deleting specified paths...4093worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4094worker2 # deleting unused links...4095worker2 # note: hard linking is currently saving 0.0 KiB4096worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.34 seconds)4097client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24098client # don't know how to build these paths:4099client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4100worker2 # [ 49.206581] nix-grpc-daemon[778]: ts=2026-09-20T13:34:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:416544101worker2 # [ 49.216263] nix-grpc-daemon[778]: ts=2026-09-20T13:34:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416544102worker2 # [ 49.251421] nix-grpc-daemon[778]: ts=2026-09-20T13:34:21Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14103client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.38 seconds)4104client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4105client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds)4106lb: must succeed: curl -sf localhost:9901/clusters4107lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4108lb: must succeed: curl -sf localhost:9901/clusters4109lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4110worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4111worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds)4112(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.62 seconds)4113subtest: inputs already in the cache are not sent to the scheduler4114lb: must succeed: curl -sf localhost:9901/clusters4115lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4116lb: must succeed: curl -sf localhost:9901/clusters4117lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4118worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4119worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.08 seconds)4120client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24121worker2 # [ 50.399043] nix-grpc-daemon[778]: ts=2026-09-20T13:34:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:416544122client # don't know how to build these paths:4123client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4124worker2 # [ 50.411865] nix-grpc-daemon[778]: ts=2026-09-20T13:34:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416544125worker2 # [ 50.433942] nix-grpc-daemon[778]: ts=2026-09-20T13:34:22Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04126worker2 # [ 50.440803] nix-grpc-daemon[778]: ts=2026-09-20T13:34:22Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=14127worker1 # [ 50.513649] nix-grpc-daemon[775]: ts=2026-09-20T13:34:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:427724128worker1 # [ 50.540231] nix-grpc-daemon[775]: ts=2026-09-20T13:34:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:427724129worker1 # [ 50.562361] nix-grpc-daemon[843]: time=2026-09-20T13:34:23.072Z level=INFO msg="All 2 paths already cached"4130client # copying 1 paths to 'lb:50051'...4131client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4132worker1 # [ 50.576797] nix-grpc-daemon[775]: ts=2026-09-20T13:34:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:427724133worker1 # [ 50.597820] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4134worker1 # [ 50.832160] nix-daemon[833]: accepted connection from pid 974, user nix-grpc-daemon (trusted)4135worker1 # [ 50.852521] nix-daemon[833]: reaped child process 977, status = succeeded4136worker1 # [ 51.053185] nix-daemon[833]: accepted connection from pid 979, user nix-grpc-daemon (trusted)4137worker1 # [ 51.073733] nix-daemon[833]: reaped child process 982, status = succeeded4138lb # [ 51.061225] niks3-server[1041]: 2026/09/20 13:34:23 INFO Received uploads request method=POST path=/api/pending_closures4139worker1 # [ 51.102240] nix-grpc-daemon[843]: time=2026-09-20T13:34:23.612Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4140worker1 # [ 51.103807] nix-grpc-daemon[843]: time=2026-09-20T13:34:23.612Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4141lb # [ 51.101513] niks3-server[1041]: 2026/09/20 13:34:23 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4142lb # [ 51.122222] niks3-server[1041]: 2026/09/20 13:34:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4143worker1 # [ 51.158225] nix-grpc-daemon[843]: time=2026-09-20T13:34:23.669Z level=INFO msg="Uploading 1 narinfos"4144lb # [ 51.131762] niks3-server[1041]: 2026/09/20 13:34:23 INFO Signed narinfos id=7 count=14145lb # [ 51.138742] envoy[921]: conn peer=[2001:db8:1::1]:33466 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9553 tx=3899 ms=87704146lb # [ 51.147036] envoy[921]: conn peer=[2001:db8:1::1]:36990 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=714147worker1 # [ 51.183652] nix-grpc-daemon[843]: time=2026-09-20T13:34:23.694Z level=INFO msg="Upload complete. (565ms)"4148lb # [ 51.155885] niks3-server[1041]: 2026/09/20 13:34:23 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4149lb # [ 51.161121] niks3-server[1041]: 2026/09/20 13:34:23 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4150worker1 # [ 51.190795] nix-grpc-daemon[775]: ts=2026-09-20T13:34:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=0 paths=1 nar_bytes_in=7524151lb # [ 51.165043] niks3-server[1041]: 2026/09/20 13:34:23 INFO Completed upload id=74152lb # [ 51.166702] niks3-server[1041]: 2026/09/20 13:34:23 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4153worker1 # [ 51.200420] nix-grpc-daemon[775]: ts=2026-09-20T13:34:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:427724154worker1 # [ 51.214334] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4155worker1 # [ 51.217147] nix-daemon[833]: reaped child process 972, status = succeeded4156client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4157client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4158worker1 # [ 51.232669] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4159client # farm-top> LOG-farm-top-t1b4160worker1 # [ 52.893913] nix-daemon[833]: reaped child process 986, status = succeeded4161worker1 # [ 53.088291] nix-daemon[833]: accepted connection from pid 1001, user nix-grpc-daemon (trusted)4162worker1 # [ 53.107721] nix-daemon[833]: reaped child process 1004, status = succeeded4163lb # [ 53.095630] niks3-server[1041]: 2026/09/20 13:34:25 INFO Received uploads request method=POST path=/api/pending_closures4164worker1 # [ 53.140715] nix-grpc-daemon[843]: time=2026-09-20T13:34:25.650Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4165worker1 # [ 53.146018] nix-grpc-daemon[843]: time=2026-09-20T13:34:25.650Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4166lb # [ 53.160845] niks3-server[1041]: 2026/09/20 13:34:25 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4167worker1 # [ 53.206159] nix-grpc-daemon[843]: time=2026-09-20T13:34:25.716Z level=INFO msg="Uploading 1 narinfos"4168lb # [ 53.173558] niks3-server[1041]: 2026/09/20 13:34:25 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4169lb # [ 53.188730] niks3-server[1041]: 2026/09/20 13:34:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4170lb # [ 53.196280] niks3-server[1041]: 2026/09/20 13:34:25 INFO Signed narinfos id=8 count=14171lb # [ 53.204764] niks3-server[1041]: 2026/09/20 13:34:25 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4172lb # [ 53.208004] niks3-server[1041]: 2026/09/20 13:34:25 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4173lb # [ 53.214988] niks3-server[1041]: 2026/09/20 13:34:25 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4174lb # [ 53.222368] niks3-server[1041]: 2026/09/20 13:34:25 INFO Completed upload id=84175worker1 # [ 53.252598] nix-grpc-daemon[843]: time=2026-09-20T13:34:25.763Z level=INFO msg="Upload complete. (407ms)"4176worker1 # [ 53.266170] nix-grpc-daemon[775]: ts=2026-09-20T13:34:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=2 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14177worker1 # [ 53.289832] nix-daemon[833]: reaped child process 984, status = succeeded4178client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 3.17 seconds)4179client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4180client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.26 seconds)4181lb: must succeed: curl -sf localhost:9901/clusters4182lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4183lb: must succeed: curl -sf localhost:9901/clusters4184lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4185worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4186worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.08 seconds)4187(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.92 seconds)4188subtest: two clients wanting the same drv build it once4189client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4190client # [ 53.901435] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4191client # Running as unit: dedup1.service; invocation ID: b7f805ab5ef04aff9e82736aa3f09d7a4192client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.12 seconds)4193client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4194worker2 # [ 54.171771] nix-grpc-daemon[778]: ts=2026-09-20T13:34:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:416544195client # [ 54.190605] nix[886]: don't know how to build these paths:4196client # [ 54.192090] nix[886]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4197worker2 # [ 54.197826] nix-grpc-daemon[778]: ts=2026-09-20T13:34:26Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04198worker2 # [ 54.206098] nix-grpc-daemon[778]: ts=2026-09-20T13:34:26Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14199worker2 # [ 54.245642] nix-grpc-daemon[778]: ts=2026-09-20T13:34:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416544200worker2 # [ 54.272541] nix-grpc-daemon[778]: ts=2026-09-20T13:34:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416544201client # [ 54.300295] nix[886]: copying 1 paths to 'lb:50051'...4202worker2 # [ 54.291444] nix-grpc-daemon[778]: ts=2026-09-20T13:34:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:416544203client # [ 54.305256] nix[886]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4204worker2 # [ 54.315601] nix-daemon[847]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4205worker2 # [ 54.351456] nix-grpc-daemon[778]: ts=2026-09-20T13:34:26Z level=info event=niks3_push_started pid=8984206worker2 # [ 54.656504] nix-grpc-daemon[898]: time=2026-09-20T13:34:27.173Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""4207worker2 # [ 54.875970] nix-daemon[847]: accepted connection from pid 911, user nix-grpc-daemon (trusted)4208worker2 # [ 54.898009] nix-daemon[847]: reaped child process 914, status = succeeded4209client # [ 55.038960] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4210client # Running as unit: dedup2.service; invocation ID: 9ce6a5c2967246669a988439cddeb5b94211client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.14 seconds)4212worker2 # [ 55.101727] nix-daemon[847]: accepted connection from pid 916, user nix-grpc-daemon (trusted)4213worker2 # [ 55.122551] nix-daemon[847]: reaped child process 919, status = succeeded4214lb # [ 55.137189] niks3-server[1041]: 2026/09/20 13:34:27 INFO Received uploads request method=POST path=/api/pending_closures4215worker2 # [ 55.151035] nix-grpc-daemon[898]: time=2026-09-20T13:34:27.669Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4216worker2 # [ 55.155060] nix-grpc-daemon[898]: time=2026-09-20T13:34:27.671Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4217lb # [ 55.189128] niks3-server[1041]: 2026/09/20 13:34:27 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4218worker2 # [ 55.203863] nix-grpc-daemon[898]: time=2026-09-20T13:34:27.722Z level=INFO msg="Uploading 1 narinfos"4219lb # [ 55.204206] niks3-server[1041]: 2026/09/20 13:34:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4220lb # [ 55.212335] niks3-server[1041]: 2026/09/20 13:34:27 INFO Signed narinfos id=9 count=14221lb # [ 55.221581] niks3-server[1041]: 2026/09/20 13:34:27 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4222lb # [ 55.236049] niks3-server[1041]: 2026/09/20 13:34:27 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4223worker2 # [ 55.242826] nix-grpc-daemon[898]: time=2026-09-20T13:34:27.761Z level=INFO msg="Upload complete. (577ms)"4224lb # [ 55.243718] niks3-server[1041]: 2026/09/20 13:34:27 INFO Completed upload id=94225worker2 # [ 55.248664] nix-grpc-daemon[778]: ts=2026-09-20T13:34:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41654 duration_s=0 paths=1 nar_bytes_in=4324226lb # [ 55.251969] niks3-server[1041]: 2026/09/20 13:34:27 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4227worker2 # [ 55.257884] nix-grpc-daemon[778]: ts=2026-09-20T13:34:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416544228worker2 # [ 55.262068] nix-daemon[847]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4229worker2 # [ 55.265937] nix-daemon[847]: reaped child process 896, status = succeeded4230worker2 # [ 55.276358] nix-daemon[847]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4231client # [ 55.285788] nix[886]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4232client: must succeed: sleep 24233worker1 # [ 56.451446] nix-grpc-daemon[775]: ts=2026-09-20T13:34:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:427724234client # [ 56.442910] nix[902]: don't know how to build these paths:4235client # [ 56.445947] nix[902]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4236worker2 # [ 56.449590] nix-grpc-daemon[778]: ts=2026-09-20T13:34:28Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04237worker2 # [ 56.455747] nix-grpc-daemon[778]: ts=2026-09-20T13:34:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416544238client # [ 56.469631] nix[902]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4239client: (finished: must succeed: sleep 2, in 2.06 seconds)4240??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4241 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394242client: waiting for success: ! systemctl is-active dedup1 dedup24243??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4244 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394245worker2 # [ 58.701308] nix-daemon[847]: reaped child process 927, status = succeeded4246worker2 # [ 58.865870] nix-daemon[847]: accepted connection from pid 954, user nix-grpc-daemon (trusted)4247worker2 # [ 58.886471] nix-daemon[847]: reaped child process 957, status = succeeded4248lb # [ 58.902044] niks3-server[1041]: 2026/09/20 13:34:31 INFO Received uploads request method=POST path=/api/pending_closures4249worker2 # [ 58.912772] nix-grpc-daemon[898]: time=2026-09-20T13:34:31.430Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4250worker2 # [ 58.914688] nix-grpc-daemon[898]: time=2026-09-20T13:34:31.430Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4251lb # [ 58.953386] niks3-server[1041]: 2026/09/20 13:34:31 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4252lb # [ 58.966406] niks3-server[1041]: 2026/09/20 13:34:31 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4253worker2 # [ 58.974635] nix-grpc-daemon[898]: time=2026-09-20T13:34:31.492Z level=INFO msg="Uploading 1 narinfos"4254lb # [ 58.976604] niks3-server[1041]: 2026/09/20 13:34:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4255lb # [ 58.981505] niks3-server[1041]: 2026/09/20 13:34:31 INFO Signed narinfos id=10 count=14256lb # [ 58.983743] niks3-server[1041]: 2026/09/20 13:34:31 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4257lb # [ 58.994134] niks3-server[1041]: 2026/09/20 13:34:31 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4258worker2 # [ 58.998475] nix-grpc-daemon[898]: time=2026-09-20T13:34:31.517Z level=INFO msg="Upload complete. (312ms)"4259lb # [ 59.001005] niks3-server[1041]: 2026/09/20 13:34:31 INFO Completed upload id=104260lb # [ 59.003771] niks3-server[1041]: 2026/09/20 13:34:31 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4261worker2 # [ 59.010190] nix-grpc-daemon[778]: ts=2026-09-20T13:34:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41654 duration_s=2 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14262worker2 # [ 59.027940] nix-grpc-daemon[778]: ts=2026-09-20T13:34:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41654 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14263worker2 # [ 59.033998] nix-daemon[847]: reaped child process 925, status = succeeded4264client # [ 59.073557] systemd[1]: dedup1.service: Deactivated successfully.4265client # [ 59.082019] systemd[1]: dedup1.service: Consumed 188ms CPU time over 5.179s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 9.1K outgoing IP traffic.4266client # [ 59.125003] systemd[1]: dedup2.service: Deactivated successfully.4267client # [ 59.127431] systemd[1]: dedup2.service: Consumed 254ms CPU time over 4.088s wall clock time, 31.2M memory peak, 7.3K incoming IP traffic, 6.4K outgoing IP traffic.4268client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.15 seconds)4269client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4270client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4271worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4272worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4273worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4274worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4275worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4276worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4277worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4278worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)4279(finished: subtest: two clients wanting the same drv build it once, in 6.35 seconds)4280subtest: build hook: nix-daemon with builders = grpc://lb4281client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4282client # [ 60.383429] systemd[1]: Started Nix Daemon.4283client # [ 60.574449] nix-daemon[943]: accepted connection from pid 940, user root (trusted)4284worker1 # [ 60.807025] nix-grpc-daemon[775]: ts=2026-09-20T13:34:33Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:427724285worker2 # [ 60.783383] nix-grpc-daemon[778]: ts=2026-09-20T13:34:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416544286worker2 # [ 60.803148] nix-grpc-daemon[778]: ts=2026-09-20T13:34:33Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04287worker2 # [ 60.809362] nix-grpc-daemon[778]: ts=2026-09-20T13:34:33Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14288worker1 # [ 60.881422] nix-grpc-daemon[775]: ts=2026-09-20T13:34:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:427724289worker1 # [ 60.894640] nix-grpc-daemon[775]: ts=2026-09-20T13:34:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:427724290worker1 # [ 60.911805] nix-grpc-daemon[775]: ts=2026-09-20T13:34:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:427724291worker1 # [ 60.934403] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4292worker1 # [ 61.146836] nix-daemon[833]: accepted connection from pid 1029, user nix-grpc-daemon (trusted)4293lb # [ 61.129485] envoy[921]: conn peer=[2001:db8:1::1]:36998 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4215 tx=1744 ms=28504294lb # [ 61.134571] envoy[921]: conn peer=[2001:db8:1::1]:55586 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1375 ms=48764295worker1 # [ 61.168551] nix-daemon[833]: reaped child process 1032, status = succeeded4296lb # [ 61.140585] envoy[921]: conn peer=[2001:db8:1::1]:55598 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1086 ms=26674297worker1 # [ 61.343085] nix-daemon[833]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4298worker1 # [ 61.361416] nix-daemon[833]: reaped child process 1037, status = succeeded4299lb # [ 61.344857] niks3-server[1041]: 2026/09/20 13:34:33 INFO Received uploads request method=POST path=/api/pending_closures4300worker1 # [ 61.385622] nix-grpc-daemon[843]: time=2026-09-20T13:34:33.896Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4301worker1 # [ 61.387168] nix-grpc-daemon[843]: time=2026-09-20T13:34:33.896Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4302lb # [ 61.374689] niks3-server[1041]: 2026/09/20 13:34:33 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4303worker1 # [ 61.420638] nix-grpc-daemon[843]: time=2026-09-20T13:34:33.931Z level=INFO msg="Uploading 1 narinfos"4304lb # [ 61.394154] niks3-server[1041]: 2026/09/20 13:34:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4305lb # [ 61.404177] niks3-server[1041]: 2026/09/20 13:34:33 INFO Signed narinfos id=11 count=14306lb # [ 61.406607] niks3-server[1041]: 2026/09/20 13:34:33 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4307lb # [ 61.413618] niks3-server[1041]: 2026/09/20 13:34:33 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4308lb # [ 61.421582] niks3-server[1041]: 2026/09/20 13:34:33 INFO Completed upload id=114309worker1 # [ 61.450793] nix-grpc-daemon[843]: time=2026-09-20T13:34:33.961Z level=INFO msg="Upload complete. (497ms)"4310lb # [ 61.423597] niks3-server[1041]: 2026/09/20 13:34:33 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4311worker1 # [ 61.460337] nix-grpc-daemon[775]: ts=2026-09-20T13:34:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=0 paths=1 nar_bytes_in=5124312worker1 # [ 61.474701] nix-grpc-daemon[775]: ts=2026-09-20T13:34:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:427724313worker1 # [ 61.480775] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4314worker1 # [ 61.485916] nix-daemon[833]: reaped child process 1027, status = succeeded4315worker1 # [ 61.500218] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4316worker1 # [ 62.531284] nix-daemon[833]: reaped child process 1041, status = succeeded4317worker1 # [ 62.687280] nix-daemon[833]: accepted connection from pid 1056, user nix-grpc-daemon (trusted)4318worker1 # [ 62.706054] nix-daemon[833]: reaped child process 1059, status = succeeded4319lb # [ 62.690961] niks3-server[1041]: 2026/09/20 13:34:35 INFO Received uploads request method=POST path=/api/pending_closures4320worker1 # [ 62.736181] nix-grpc-daemon[843]: time=2026-09-20T13:34:35.243Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4321worker1 # [ 62.737690] nix-grpc-daemon[843]: time=2026-09-20T13:34:35.243Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4322lb # [ 62.733009] niks3-server[1041]: 2026/09/20 13:34:35 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4323lb # [ 62.745966] niks3-server[1041]: 2026/09/20 13:34:35 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4324lb # [ 62.759289] niks3-server[1041]: 2026/09/20 13:34:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4325worker1 # [ 62.796480] nix-grpc-daemon[843]: time=2026-09-20T13:34:35.307Z level=INFO msg="Uploading 1 narinfos"4326lb # [ 62.768199] niks3-server[1041]: 2026/09/20 13:34:35 INFO Signed narinfos id=12 count=14327lb # [ 62.771068] niks3-server[1041]: 2026/09/20 13:34:35 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4328lb # [ 62.782021] niks3-server[1041]: 2026/09/20 13:34:35 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4329lb # [ 62.788981] niks3-server[1041]: 2026/09/20 13:34:35 INFO Completed upload id=124330lb # [ 62.791272] niks3-server[1041]: 2026/09/20 13:34:35 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4331worker1 # [ 62.818871] nix-grpc-daemon[843]: time=2026-09-20T13:34:35.330Z level=INFO msg="Upload complete. (307ms)"4332worker1 # [ 62.829386] nix-grpc-daemon[775]: ts=2026-09-20T13:34:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14333worker2 # [ 62.803025] nix-grpc-daemon[778]: ts=2026-09-20T13:34:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:416544334worker1 # [ 62.847032] nix-daemon[833]: reaped child process 1039, status = succeeded4335worker2 # [ 62.825892] nix-grpc-daemon[778]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4336worker1 # [ 62.904108] nix-grpc-daemon[775]: ts=2026-09-20T13:34:35Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:427724337worker1 # [ 62.911872] nix-grpc-daemon[775]: ts=2026-09-20T13:34:35Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=0 paths=1 nar_bytes_out=1284338worker1 # [ 63.178389] nix-grpc-daemon[775]: ts=2026-09-20T13:34:35Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:427724339worker2 # [ 63.153270] nix-grpc-daemon[778]: ts=2026-09-20T13:34:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416544340worker2 # [ 63.164984] nix-grpc-daemon[898]: time=2026-09-20T13:34:35.682Z level=INFO msg="All 1 paths already cached"4341worker2 # [ 63.185300] nix-grpc-daemon[778]: ts=2026-09-20T13:34:35Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04342worker2 # [ 63.191865] nix-grpc-daemon[778]: ts=2026-09-20T13:34:35Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14343worker1 # [ 63.226238] nix-grpc-daemon[775]: ts=2026-09-20T13:34:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:427724344worker1 # [ 63.242003] nix-grpc-daemon[775]: ts=2026-09-20T13:34:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:427724345worker1 # [ 63.257971] nix-grpc-daemon[843]: time=2026-09-20T13:34:35.769Z level=INFO msg="All 1 paths already cached"4346worker1 # [ 63.267847] nix-grpc-daemon[775]: ts=2026-09-20T13:34:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:427724347worker1 # [ 63.282500] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4348worker1 # [ 63.501712] nix-daemon[833]: accepted connection from pid 1063, user nix-grpc-daemon (trusted)4349worker1 # [ 63.523601] nix-daemon[833]: reaped child process 1066, status = succeeded4350worker1 # [ 63.700753] nix-daemon[833]: accepted connection from pid 1068, user nix-grpc-daemon (trusted)4351worker1 # [ 63.719465] nix-daemon[833]: reaped child process 1071, status = succeeded4352lb # [ 63.702102] niks3-server[1041]: 2026/09/20 13:34:36 INFO Received uploads request method=POST path=/api/pending_closures4353worker1 # [ 63.742614] nix-grpc-daemon[843]: time=2026-09-20T13:34:36.253Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4354worker1 # [ 63.744205] nix-grpc-daemon[843]: time=2026-09-20T13:34:36.253Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4355lb # [ 63.732460] niks3-server[1041]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4356lb # [ 63.748552] niks3-server[1041]: 2026/09/20 13:34:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4357worker1 # [ 63.784025] nix-grpc-daemon[843]: time=2026-09-20T13:34:36.294Z level=INFO msg="Uploading 1 narinfos"4358lb # [ 63.761220] niks3-server[1041]: 2026/09/20 13:34:36 INFO Signed narinfos id=13 count=14359lb # [ 63.766941] niks3-server[1041]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4360lb # [ 63.776248] niks3-server[1041]: 2026/09/20 13:34:36 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4361lb # [ 63.781121] niks3-server[1041]: 2026/09/20 13:34:36 INFO Completed upload id=134362worker1 # [ 63.811174] nix-grpc-daemon[843]: time=2026-09-20T13:34:36.322Z level=INFO msg="Upload complete. (509ms)"4363lb # [ 63.783875] niks3-server[1041]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4364worker1 # [ 63.820329] nix-grpc-daemon[775]: ts=2026-09-20T13:34:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=0 paths=1 nar_bytes_in=6244365worker1 # [ 63.836933] nix-grpc-daemon[775]: ts=2026-09-20T13:34:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:427724366worker1 # [ 63.843427] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4367worker1 # [ 63.849304] nix-daemon[833]: reaped child process 1061, status = succeeded4368worker1 # [ 63.863901] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4369worker1 # [ 65.513278] nix-daemon[833]: reaped child process 1075, status = succeeded4370worker1 # [ 65.694212] nix-daemon[833]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)4371worker1 # [ 65.712426] nix-daemon[833]: reaped child process 1093, status = succeeded4372lb # [ 65.694414] niks3-server[1041]: 2026/09/20 13:34:38 INFO Received uploads request method=POST path=/api/pending_closures4373worker1 # [ 65.735501] nix-grpc-daemon[843]: time=2026-09-20T13:34:38.245Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4374worker1 # [ 65.737519] nix-grpc-daemon[843]: time=2026-09-20T13:34:38.245Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4375lb # [ 65.736922] niks3-server[1041]: 2026/09/20 13:34:38 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4376lb # [ 65.748108] niks3-server[1041]: 2026/09/20 13:34:38 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4377worker1 # [ 65.787326] nix-grpc-daemon[843]: time=2026-09-20T13:34:38.298Z level=INFO msg="Uploading 1 narinfos"4378lb # [ 65.763239] niks3-server[1041]: 2026/09/20 13:34:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4379lb # [ 65.769358] niks3-server[1041]: 2026/09/20 13:34:38 INFO Signed narinfos id=14 count=14380lb # [ 65.771275] niks3-server[1041]: 2026/09/20 13:34:38 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4381lb # [ 65.776130] niks3-server[1041]: 2026/09/20 13:34:38 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4382lb # [ 65.783566] niks3-server[1041]: 2026/09/20 13:34:38 INFO Completed upload id=144383worker1 # [ 65.813631] nix-grpc-daemon[843]: time=2026-09-20T13:34:38.324Z level=INFO msg="Upload complete. (338ms)"4384lb # [ 65.786544] niks3-server[1041]: 2026/09/20 13:34:38 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4385worker1 # [ 65.825292] nix-grpc-daemon[775]: ts=2026-09-20T13:34:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14386worker1 # [ 65.844329] nix-grpc-daemon[775]: ts=2026-09-20T13:34:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:427724387worker1 # [ 65.850801] nix-daemon[833]: reaped child process 1073, status = succeeded4388worker2 # [ 65.834965] nix-grpc-daemon[778]: ts=2026-09-20T13:34:38Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:416544389worker2 # [ 65.844082] nix-grpc-daemon[778]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4390worker2 # [ 65.862204] nix-grpc-daemon[778]: ts=2026-09-20T13:34:38Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41654 duration_s=0 paths=1 nar_bytes_out=1764391worker2 # [ 66.176920] nix-grpc-daemon[778]: ts=2026-09-20T13:34:38Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:416544392worker1 # [ 66.211850] nix-grpc-daemon[775]: ts=2026-09-20T13:34:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:427724393worker1 # [ 66.221918] nix-grpc-daemon[843]: time=2026-09-20T13:34:38.733Z level=INFO msg="All 2 paths already cached"4394worker2 # [ 66.210014] nix-grpc-daemon[778]: ts=2026-09-20T13:34:38Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04395worker2 # [ 66.216509] nix-grpc-daemon[778]: ts=2026-09-20T13:34:38Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14396worker1 # [ 66.250489] nix-grpc-daemon[775]: ts=2026-09-20T13:34:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:427724397worker1 # [ 66.265993] nix-grpc-daemon[775]: ts=2026-09-20T13:34:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:427724398worker1 # [ 66.280829] nix-grpc-daemon[843]: time=2026-09-20T13:34:38.791Z level=INFO msg="All 2 paths already cached"4399worker1 # [ 66.290732] nix-grpc-daemon[775]: ts=2026-09-20T13:34:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:427724400worker1 # [ 66.304937] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4401worker1 # [ 66.511912] nix-daemon[833]: accepted connection from pid 1097, user nix-grpc-daemon (trusted)4402worker1 # [ 66.532966] nix-daemon[833]: reaped child process 1100, status = succeeded4403worker1 # [ 66.706966] nix-daemon[833]: accepted connection from pid 1102, user nix-grpc-daemon (trusted)4404worker1 # [ 66.727556] nix-daemon[833]: reaped child process 1105, status = succeeded4405lb # [ 66.709315] niks3-server[1041]: 2026/09/20 13:34:39 INFO Received uploads request method=POST path=/api/pending_closures4406worker1 # [ 66.749783] nix-grpc-daemon[843]: time=2026-09-20T13:34:39.260Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4407worker1 # [ 66.751440] nix-grpc-daemon[843]: time=2026-09-20T13:34:39.260Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4408lb # [ 66.739794] niks3-server[1041]: 2026/09/20 13:34:39 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4409lb # [ 66.756529] niks3-server[1041]: 2026/09/20 13:34:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4410worker1 # [ 66.793771] nix-grpc-daemon[843]: time=2026-09-20T13:34:39.304Z level=INFO msg="Uploading 1 narinfos"4411lb # [ 66.770082] niks3-server[1041]: 2026/09/20 13:34:39 INFO Signed narinfos id=15 count=14412lb # [ 66.777064] niks3-server[1041]: 2026/09/20 13:34:39 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4413lb # [ 66.790232] niks3-server[1041]: 2026/09/20 13:34:39 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4414lb # [ 66.794026] niks3-server[1041]: 2026/09/20 13:34:39 INFO Completed upload id=154415worker1 # [ 66.819671] nix-grpc-daemon[843]: time=2026-09-20T13:34:39.330Z level=INFO msg="Upload complete. (497ms)"4416lb # [ 66.798265] niks3-server[1041]: 2026/09/20 13:34:39 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4417worker1 # [ 66.828571] nix-grpc-daemon[775]: ts=2026-09-20T13:34:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=0 paths=1 nar_bytes_in=7524418worker1 # [ 66.840584] nix-grpc-daemon[775]: ts=2026-09-20T13:34:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:427724419worker1 # [ 66.852681] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4420worker1 # [ 66.858122] nix-daemon[833]: reaped child process 1095, status = succeeded4421worker1 # [ 66.870474] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4422worker1 # [ 67.699402] nix-daemon[833]: reaped child process 1109, status = succeeded4423worker1 # [ 67.874821] nix-daemon[833]: accepted connection from pid 1124, user nix-grpc-daemon (trusted)4424worker1 # [ 67.894372] nix-daemon[833]: reaped child process 1127, status = succeeded4425lb # [ 67.879182] niks3-server[1041]: 2026/09/20 13:34:40 INFO Received uploads request method=POST path=/api/pending_closures4426worker1 # [ 67.964592] nix-grpc-daemon[843]: time=2026-09-20T13:34:40.471Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4427worker1 # [ 67.966582] nix-grpc-daemon[843]: time=2026-09-20T13:34:40.471Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4428lb # [ 67.970893] niks3-server[1041]: 2026/09/20 13:34:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4429worker1 # [ 68.013614] nix-grpc-daemon[843]: time=2026-09-20T13:34:40.524Z level=INFO msg="Uploading 1 narinfos"4430lb # [ 67.988737] niks3-server[1041]: 2026/09/20 13:34:40 INFO Signed narinfos id=16 count=14431lb # [ 67.998507] niks3-server[1041]: 2026/09/20 13:34:40 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4432lb # [ 68.009901] niks3-server[1041]: 2026/09/20 13:34:40 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4433lb # [ 68.018696] niks3-server[1041]: 2026/09/20 13:34:40 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4434worker1 # [ 68.055822] nix-grpc-daemon[843]: time=2026-09-20T13:34:40.566Z level=INFO msg="Upload complete. (371ms)"4435lb # [ 68.026491] niks3-server[1041]: 2026/09/20 13:34:40 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4436lb # [ 68.031499] niks3-server[1041]: 2026/09/20 13:34:40 INFO Completed upload id=164437lb # [ 68.035154] niks3-server[1041]: 2026/09/20 13:34:40 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4438worker1 # [ 68.069353] nix-grpc-daemon[775]: ts=2026-09-20T13:34:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14439worker2 # [ 68.044999] nix-grpc-daemon[778]: ts=2026-09-20T13:34:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:416544440worker1 # [ 68.087882] nix-daemon[833]: reaped child process 1107, status = succeeded4441worker2 # [ 68.059919] nix-grpc-daemon[778]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4442worker1 # [ 68.132160] nix-grpc-daemon[775]: ts=2026-09-20T13:34:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:427724443worker1 # [ 68.138751] nix-grpc-daemon[775]: ts=2026-09-20T13:34:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=0 paths=1 nar_bytes_out=2324444client # [ 68.208632] nix-daemon[943]: reaped child process 945, status = succeeded4445client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.07 seconds)4446client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4447client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds)4448client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4449client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.06 seconds)4450client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4451client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds)4452(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.22 seconds)4453subtest: an input only one worker has still reaches the builder4454client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4455client # this derivation will be built:4456client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4457client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4458client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.45 seconds)4459client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4460client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.21 seconds)4461worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4462worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.26 seconds)4463worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4464worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4465client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24466client # [ 69.544642] nix-daemon[943]: accepted connection from pid 1025, user root (trusted)4467client # this derivation will be built:4468client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4469worker1 # [ 69.770377] nix-grpc-daemon[775]: ts=2026-09-20T13:34:42Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:427724470client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4471worker2 # [ 69.750090] nix-grpc-daemon[778]: ts=2026-09-20T13:34:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416544472client # copying 1 paths...4473client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'...4474worker1 # [ 69.793126] nix-grpc-daemon[775]: ts=2026-09-20T13:34:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:427724475worker1 # [ 69.808355] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4476worker1 # [ 70.021562] nix-daemon[833]: accepted connection from pid 1136, user nix-grpc-daemon (trusted)4477worker1 # [ 70.039632] nix-daemon[833]: reaped child process 1139, status = succeeded4478lb # [ 70.021607] niks3-server[1041]: 2026/09/20 13:34:42 INFO Received uploads request method=POST path=/api/pending_closures4479worker1 # [ 70.061986] nix-grpc-daemon[843]: time=2026-09-20T13:34:42.572Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4480worker1 # [ 70.063919] nix-grpc-daemon[843]: time=2026-09-20T13:34:42.572Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4481lb # [ 70.052393] niks3-server[1041]: 2026/09/20 13:34:42 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4482lb # [ 70.066066] niks3-server[1041]: 2026/09/20 13:34:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4483worker1 # [ 70.102021] nix-grpc-daemon[843]: time=2026-09-20T13:34:42.612Z level=INFO msg="Uploading 1 narinfos"4484lb # [ 70.079045] niks3-server[1041]: 2026/09/20 13:34:42 INFO Signed narinfos id=17 count=14485lb # [ 70.084532] niks3-server[1041]: 2026/09/20 13:34:42 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4486lb # [ 70.092424] niks3-server[1041]: 2026/09/20 13:34:42 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4487lb # [ 70.096863] niks3-server[1041]: 2026/09/20 13:34:42 INFO Completed upload id=174488worker1 # [ 70.126588] nix-grpc-daemon[843]: time=2026-09-20T13:34:42.637Z level=INFO msg="Upload complete. (303ms)"4489lb # [ 70.099921] niks3-server[1041]: 2026/09/20 13:34:42 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4490worker1 # [ 70.136413] nix-grpc-daemon[775]: ts=2026-09-20T13:34:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=0 paths=1 nar_bytes_in=1204491worker1 # [ 70.153832] nix-daemon[833]: reaped child process 1134, status = succeeded4492worker2 # [ 70.120842] nix-grpc-daemon[778]: ts=2026-09-20T13:34:42Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04493worker2 # [ 70.128657] nix-grpc-daemon[778]: ts=2026-09-20T13:34:42Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14494worker2 # [ 70.167985] nix-grpc-daemon[778]: ts=2026-09-20T13:34:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416544495worker2 # [ 70.184447] nix-grpc-daemon[778]: ts=2026-09-20T13:34:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416544496client # copying 2 paths to 'lb:50051'...4497client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4498worker2 # [ 70.203193] nix-grpc-daemon[778]: ts=2026-09-20T13:34:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:416544499client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4500worker2 # [ 70.218747] nix-daemon[847]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4501worker2 # [ 70.431251] nix-daemon[847]: accepted connection from pid 984, user nix-grpc-daemon (trusted)4502worker2 # [ 70.452572] nix-daemon[847]: reaped child process 987, status = succeeded4503worker2 # [ 70.628149] nix-daemon[847]: accepted connection from pid 989, user nix-grpc-daemon (trusted)4504worker2 # [ 70.648758] nix-daemon[847]: reaped child process 992, status = succeeded4505lb # [ 70.661230] niks3-server[1041]: 2026/09/20 13:34:43 INFO Received uploads request method=POST path=/api/pending_closures4506lb # [ 70.671535] niks3-server[1041]: 2026/09/20 13:34:43 INFO Received uploads request method=POST path=/api/pending_closures4507worker2 # [ 70.681102] nix-grpc-daemon[898]: time=2026-09-20T13:34:43.198Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4508worker2 # [ 70.682769] nix-grpc-daemon[898]: time=2026-09-20T13:34:43.198Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4509worker2 # [ 70.684603] nix-grpc-daemon[898]: time=2026-09-20T13:34:43.198Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4510lb # [ 70.707172] niks3-server[1041]: 2026/09/20 13:34:43 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4511lb # [ 70.720878] niks3-server[1041]: 2026/09/20 13:34:43 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4512lb # [ 70.736174] niks3-server[1041]: 2026/09/20 13:34:43 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4513lb # [ 70.742752] niks3-server[1041]: 2026/09/20 13:34:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4514lb # [ 70.751311] niks3-server[1041]: 2026/09/20 13:34:43 INFO Signed narinfos id=19 count=24515worker2 # [ 70.751331] nix-grpc-daemon[898]: time=2026-09-20T13:34:43.269Z level=INFO msg="Uploading 3 narinfos"4516lb # [ 70.755039] niks3-server[1041]: 2026/09/20 13:34:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4517lb # [ 70.762292] niks3-server[1041]: 2026/09/20 13:34:43 INFO Signed narinfos id=18 count=14518lb # [ 70.767264] niks3-server[1041]: 2026/09/20 13:34:43 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4519lb # [ 70.779768] niks3-server[1041]: 2026/09/20 13:34:43 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4520lb # [ 70.787021] niks3-server[1041]: 2026/09/20 13:34:43 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4521lb # [ 70.794316] niks3-server[1041]: 2026/09/20 13:34:43 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4522lb # [ 70.800367] niks3-server[1041]: 2026/09/20 13:34:43 INFO Completed upload id=184523lb # [ 70.802342] niks3-server[1041]: 2026/09/20 13:34:43 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4524worker2 # [ 70.801672] nix-grpc-daemon[898]: time=2026-09-20T13:34:43.320Z level=INFO msg="Upload complete. (562ms)"4525lb # [ 70.804832] niks3-server[1041]: 2026/09/20 13:34:43 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4526lb # [ 70.807008] niks3-server[1041]: 2026/09/20 13:34:43 INFO Completed upload id=194527worker2 # [ 70.813418] nix-grpc-daemon[778]: ts=2026-09-20T13:34:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41654 duration_s=0 paths=2 nar_bytes_in=9844528worker2 # [ 70.828388] nix-grpc-daemon[778]: ts=2026-09-20T13:34:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416544529worker2 # [ 70.845538] nix-daemon[847]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4530worker2 # [ 70.849801] nix-daemon[847]: reaped child process 982, status = succeeded4531worker2 # [ 70.868639] nix-grpc-daemon[778]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4532client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4533worker2 # [ 70.887391] nix-daemon[847]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4534client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4535lb # [ 71.131224] envoy[921]: conn peer=[2001:db8:1::1]:40984 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=344536lb # [ 71.136268] envoy[921]: conn peer=[2001:db8:1::1]:55608 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3379 tx=1751 ms=21294537lb # [ 71.140988] envoy[921]: conn peer=[2001:db8:1::1]:40990 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3901 tx=1877 ms=27734538lb # [ 71.145756] envoy[921]: conn peer=[2001:db8:1::1]:41004 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=934539lb # [ 71.151191] envoy[921]: conn peer=[2001:db8:1::1]:41010 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4352 tx=2223 ms=19534540lb # [ 71.156052] envoy[921]: conn peer=[2001:db8:1::1]:41012 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=406 ms=274541worker2 # [ 72.329268] nix-daemon[847]: reaped child process 997, status = succeeded4542worker2 # [ 72.499891] nix-daemon[847]: accepted connection from pid 1012, user nix-grpc-daemon (trusted)4543worker2 # [ 72.518172] nix-daemon[847]: reaped child process 1015, status = succeeded4544lb # [ 72.530589] niks3-server[1041]: 2026/09/20 13:34:45 INFO Received uploads request method=POST path=/api/pending_closures4545worker2 # [ 72.635489] nix-grpc-daemon[898]: time=2026-09-20T13:34:45.152Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4546lb # [ 72.661598] niks3-server[1041]: 2026/09/20 13:34:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4547worker2 # [ 72.671969] nix-grpc-daemon[898]: time=2026-09-20T13:34:45.190Z level=INFO msg="Uploading 1 narinfos"4548lb # [ 72.675268] niks3-server[1041]: 2026/09/20 13:34:45 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4549lb # [ 72.687820] niks3-server[1041]: 2026/09/20 13:34:45 INFO Signed narinfos id=20 count=14550lb # [ 72.694376] niks3-server[1041]: 2026/09/20 13:34:45 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4551lb # [ 72.704107] niks3-server[1041]: 2026/09/20 13:34:45 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4552lb # [ 72.714291] niks3-server[1041]: 2026/09/20 13:34:45 INFO Completed upload id=204553worker2 # [ 72.713619] nix-grpc-daemon[898]: time=2026-09-20T13:34:45.232Z level=INFO msg="Upload complete. (408ms)"4554lb # [ 72.719700] niks3-server[1041]: 2026/09/20 13:34:45 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4555worker2 # [ 72.725713] nix-grpc-daemon[778]: ts=2026-09-20T13:34:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41654 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14556worker2 # [ 72.747630] nix-daemon[847]: reaped child process 994, status = succeeded4557client # copying 1 paths...4558worker1 # [ 72.805836] nix-grpc-daemon[775]: ts=2026-09-20T13:34:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:427724559worker1 # [ 72.823651] nix-grpc-daemon[775]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4560client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4561worker1 # [ 72.876206] nix-grpc-daemon[775]: ts=2026-09-20T13:34:45Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:427724562worker1 # [ 72.882082] nix-grpc-daemon[775]: ts=2026-09-20T13:34:45Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=0 paths=1 nar_bytes_out=1204563client # [ 72.985796] nix-daemon[943]: reaped child process 1028, status = succeeded4564client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.68 seconds)4565client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24566client # [ 73.215217] nix-daemon[943]: accepted connection from pid 1047, user root (trusted)4567client # this derivation will be built:4568client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4569worker1 # [ 73.439838] nix-grpc-daemon[775]: ts=2026-09-20T13:34:45Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:427724570client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4571worker1 # [ 73.446491] nix-grpc-daemon[775]: ts=2026-09-20T13:34:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:427724572worker1 # [ 73.457861] nix-grpc-daemon[843]: time=2026-09-20T13:34:45.968Z level=INFO msg="All 1 paths already cached"4573worker2 # [ 73.445657] nix-grpc-daemon[778]: ts=2026-09-20T13:34:45Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04574worker1 # [ 73.479619] nix-grpc-daemon[775]: ts=2026-09-20T13:34:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:427724575worker2 # [ 73.446114] nix-grpc-daemon[778]: ts=2026-09-20T13:34:45Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14576worker1 # [ 73.495665] nix-grpc-daemon[775]: ts=2026-09-20T13:34:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:427724577client # copying 1 paths to 'lb:50051'...4578client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4579worker1 # [ 73.519159] nix-grpc-daemon[775]: ts=2026-09-20T13:34:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:427724580worker1 # [ 73.534761] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4581worker1 # [ 73.559851] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 82 ms (attempt 1/5)4582worker1 # [ 73.649125] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 141 ms (attempt 2/5)4583worker1 # [ 73.798249] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 125 ms (attempt 3/5)4584worker1 # [ 73.932541] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 443 ms (attempt 4/5)4585worker1 # [ 74.376083] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4586worker1 # [ 74.386018] nix-grpc-daemon[775]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4587worker1 # [ 74.627610] nix-daemon[833]: accepted connection from pid 1148, user nix-grpc-daemon (trusted)4588worker1 # [ 74.647898] nix-daemon[833]: reaped child process 1151, status = succeeded4589worker1 # [ 74.831307] nix-daemon[833]: accepted connection from pid 1153, user nix-grpc-daemon (trusted)4590worker1 # [ 74.849196] nix-daemon[833]: reaped child process 1156, status = succeeded4591lb # [ 74.834060] niks3-server[1041]: 2026/09/20 13:34:47 INFO Received uploads request method=POST path=/api/pending_closures4592worker1 # [ 74.874316] nix-grpc-daemon[843]: time=2026-09-20T13:34:47.384Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4593worker1 # [ 74.875822] nix-grpc-daemon[843]: time=2026-09-20T13:34:47.384Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4594worker1 # [ 74.906248] nix-grpc-daemon[843]: time=2026-09-20T13:34:47.417Z level=INFO msg="Uploading 1 narinfos"4595lb # [ 74.868624] niks3-server[1041]: 2026/09/20 13:34:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4596lb # [ 74.881018] niks3-server[1041]: 2026/09/20 13:34:47 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4597lb # [ 74.899817] niks3-server[1041]: 2026/09/20 13:34:47 INFO Signed narinfos id=21 count=14598lb # [ 74.902196] niks3-server[1041]: 2026/09/20 13:34:47 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4599worker1 # [ 74.935961] nix-grpc-daemon[843]: time=2026-09-20T13:34:47.447Z level=INFO msg="Upload complete. (517ms)"4600lb # [ 74.906273] niks3-server[1041]: 2026/09/20 13:34:47 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4601lb # [ 74.910705] niks3-server[1041]: 2026/09/20 13:34:47 INFO Completed upload id=214602lb # [ 74.913821] niks3-server[1041]: 2026/09/20 13:34:47 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4603worker1 # [ 74.944919] nix-grpc-daemon[775]: ts=2026-09-20T13:34:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=1 paths=1 nar_bytes_in=5684604worker1 # [ 74.953993] nix-grpc-daemon[775]: ts=2026-09-20T13:34:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:427724605worker1 # [ 74.965759] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4606worker1 # [ 74.970791] nix-daemon[833]: reaped child process 1142, status = succeeded4607client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4608worker1 # [ 74.985163] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4609client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4610worker1 # [ 76.229698] nix-daemon[833]: reaped child process 1160, status = succeeded4611worker1 # [ 76.412289] nix-daemon[833]: accepted connection from pid 1175, user nix-grpc-daemon (trusted)4612worker1 # [ 76.431456] nix-daemon[833]: reaped child process 1178, status = succeeded4613lb # [ 76.415499] niks3-server[1041]: 2026/09/20 13:34:48 INFO Received uploads request method=POST path=/api/pending_closures4614worker1 # [ 76.458200] nix-grpc-daemon[843]: time=2026-09-20T13:34:48.967Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4615lb # [ 76.449581] niks3-server[1041]: 2026/09/20 13:34:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4616worker1 # [ 76.489724] nix-grpc-daemon[843]: time=2026-09-20T13:34:49.000Z level=INFO msg="Uploading 1 narinfos"4617lb # [ 76.464701] niks3-server[1041]: 2026/09/20 13:34:48 INFO Signed narinfos id=22 count=14618lb # [ 76.467968] niks3-server[1041]: 2026/09/20 13:34:48 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4619lb # [ 76.481436] niks3-server[1041]: 2026/09/20 13:34:48 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4620lb # [ 76.493129] niks3-server[1041]: 2026/09/20 13:34:49 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4621lb # [ 76.499099] niks3-server[1041]: 2026/09/20 13:34:49 INFO Completed upload id=224622worker1 # [ 76.529214] nix-grpc-daemon[843]: time=2026-09-20T13:34:49.040Z level=INFO msg="Upload complete. (333ms)"4623lb # [ 76.502582] niks3-server[1041]: 2026/09/20 13:34:49 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4624worker1 # [ 76.541327] nix-grpc-daemon[775]: ts=2026-09-20T13:34:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14625worker1 # [ 76.560068] nix-daemon[833]: reaped child process 1158, status = succeeded4626client # copying 1 paths...4627worker1 # [ 76.587451] nix-grpc-daemon[775]: ts=2026-09-20T13:34:49Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:427724628client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4629worker2 # [ 76.590511] nix-grpc-daemon[778]: ts=2026-09-20T13:34:49Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:416544630worker2 # [ 76.598922] nix-grpc-daemon[778]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4631worker2 # [ 76.617366] nix-grpc-daemon[778]: ts=2026-09-20T13:34:49Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41654 duration_s=0 paths=1 nar_bytes_out=1204632client # [ 76.760449] nix-daemon[943]: reaped child process 1050, status = succeeded4633client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.77 seconds)4634client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24635client # [ 76.978244] nix-daemon[943]: accepted connection from pid 1069, user root (trusted)4636client # this derivation will be built:4637client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4638worker2 # [ 77.179261] nix-grpc-daemon[778]: ts=2026-09-20T13:34:49Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:416544639client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4640worker1 # [ 77.215172] nix-grpc-daemon[775]: ts=2026-09-20T13:34:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:427724641worker1 # [ 77.319698] nix-grpc-daemon[843]: time=2026-09-20T13:34:49.830Z level=INFO msg="All 1 paths already cached"4642worker2 # [ 77.313906] nix-grpc-daemon[778]: ts=2026-09-20T13:34:49Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04643worker2 # [ 77.323458] nix-grpc-daemon[778]: ts=2026-09-20T13:34:49Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14644worker2 # [ 77.332679] nix-grpc-daemon[778]: ts=2026-09-20T13:34:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416544645worker2 # [ 77.340272] nix-grpc-daemon[778]: ts=2026-09-20T13:34:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416544646worker2 # [ 77.370963] nix-grpc-daemon[898]: time=2026-09-20T13:34:49.888Z level=INFO msg="All 1 paths already cached"4647client # copying 1 paths to 'lb:50051'...4648client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4649worker2 # [ 77.382469] nix-grpc-daemon[778]: ts=2026-09-20T13:34:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:416544650worker2 # [ 77.397556] nix-daemon[847]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4651worker2 # [ 77.606121] nix-daemon[847]: accepted connection from pid 1024, user nix-grpc-daemon (trusted)4652worker2 # [ 77.625202] nix-daemon[847]: reaped child process 1027, status = succeeded4653worker2 # [ 77.799618] nix-daemon[847]: accepted connection from pid 1029, user nix-grpc-daemon (trusted)4654worker2 # [ 77.821682] nix-daemon[847]: reaped child process 1032, status = succeeded4655lb # [ 77.834276] niks3-server[1041]: 2026/09/20 13:34:50 INFO Received uploads request method=POST path=/api/pending_closures4656worker2 # [ 77.843458] nix-grpc-daemon[898]: time=2026-09-20T13:34:50.362Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4657worker2 # [ 77.845177] nix-grpc-daemon[898]: time=2026-09-20T13:34:50.362Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4658lb # [ 77.862223] niks3-server[1041]: 2026/09/20 13:34:50 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4659lb # [ 77.877758] niks3-server[1041]: 2026/09/20 13:34:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4660worker2 # [ 77.882687] nix-grpc-daemon[898]: time=2026-09-20T13:34:50.401Z level=INFO msg="Uploading 1 narinfos"4661lb # [ 77.890010] niks3-server[1041]: 2026/09/20 13:34:50 INFO Signed narinfos id=23 count=14662lb # [ 77.895396] niks3-server[1041]: 2026/09/20 13:34:50 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4663lb # [ 77.903673] niks3-server[1041]: 2026/09/20 13:34:50 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4664lb # [ 77.909058] niks3-server[1041]: 2026/09/20 13:34:50 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4665lb # [ 77.913381] niks3-server[1041]: 2026/09/20 13:34:50 INFO Completed upload id=234666worker2 # [ 77.912700] nix-grpc-daemon[898]: time=2026-09-20T13:34:50.431Z level=INFO msg="Upload complete. (497ms)"4667worker2 # [ 77.921881] nix-grpc-daemon[778]: ts=2026-09-20T13:34:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41654 duration_s=0 paths=1 nar_bytes_in=5684668worker2 # [ 77.935547] nix-grpc-daemon[778]: ts=2026-09-20T13:34:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416544669worker2 # [ 77.942169] nix-daemon[847]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4670worker2 # [ 77.947049] nix-daemon[847]: reaped child process 1022, status = succeeded4671client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4672worker2 # [ 77.959388] nix-daemon[847]: accepted connection from pid 778, user nix-grpc-daemon (trusted)4673client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4674worker2 # [ 79.591894] nix-daemon[847]: reaped child process 1036, status = succeeded4675worker2 # [ 79.764542] nix-daemon[847]: accepted connection from pid 1051, user nix-grpc-daemon (trusted)4676worker2 # [ 79.786160] nix-daemon[847]: reaped child process 1054, status = succeeded4677lb # [ 79.799095] niks3-server[1041]: 2026/09/20 13:34:52 INFO Received uploads request method=POST path=/api/pending_closures4678worker2 # [ 79.808169] nix-grpc-daemon[898]: time=2026-09-20T13:34:52.326Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4679lb # [ 79.832963] niks3-server[1041]: 2026/09/20 13:34:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4680worker2 # [ 79.842313] nix-grpc-daemon[898]: time=2026-09-20T13:34:52.360Z level=INFO msg="Uploading 1 narinfos"4681lb # [ 79.845303] niks3-server[1041]: 2026/09/20 13:34:52 INFO Signed narinfos id=24 count=14682lb # [ 79.855401] niks3-server[1041]: 2026/09/20 13:34:52 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4683lb # [ 79.864865] niks3-server[1041]: 2026/09/20 13:34:52 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4684worker2 # [ 79.872276] nix-grpc-daemon[898]: time=2026-09-20T13:34:52.391Z level=INFO msg="Upload complete. (298ms)"4685lb # [ 79.873946] niks3-server[1041]: 2026/09/20 13:34:52 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4686lb # [ 79.878121] niks3-server[1041]: 2026/09/20 13:34:52 INFO Completed upload id=244687lb # [ 79.881232] niks3-server[1041]: 2026/09/20 13:34:52 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4688worker2 # [ 79.881119] nix-grpc-daemon[778]: ts=2026-09-20T13:34:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41654 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14689worker2 # [ 79.896129] nix-daemon[847]: reaped child process 1034, status = succeeded4690client # copying 1 paths...4691worker1 # [ 79.961894] nix-grpc-daemon[775]: ts=2026-09-20T13:34:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:427724692worker1 # [ 79.977008] nix-grpc-daemon[775]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4693client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4694worker1 # [ 80.026387] nix-grpc-daemon[775]: ts=2026-09-20T13:34:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:427724695worker1 # [ 80.031898] nix-grpc-daemon[775]: ts=2026-09-20T13:34:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42772 duration_s=0 paths=1 nar_bytes_out=1204696client # [ 80.135597] nix-daemon[943]: reaped child process 1072, status = succeeded4697client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.38 seconds)4698(finished: subtest: an input only one worker has still reaches the builder, in 11.78 seconds)4699subtest: upload whose reference the worker lacks is completed from the cache4700client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4701client # this derivation will be built:4702client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4703client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4704client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.46 seconds)4705client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4706client # this derivation will be built:4707client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4708client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4709client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.43 seconds)4710client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4711lb # [ 81.130532] envoy[921]: conn peer=[2001:db8:1::1]:41014 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4226 tx=1886 ms=31654712lb # [ 81.135640] envoy[921]: conn peer=[2001:db8:1::1]:39422 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=654713lb # [ 81.140546] envoy[921]: conn peer=[2001:db8:1::1]:39432 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3714 tx=1802 ms=32674714lb # [ 81.145474] envoy[921]: conn peer=[2001:db8:1::1]:39448 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=954715lb # [ 81.150137] envoy[921]: conn peer=[2001:db8:1::1]:39452 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3732 tx=1935 ms=28774716lb # [ 81.155714] envoy[921]: conn peer=[2001:db8:1::1]:39462 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=674717client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds)4718worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4719worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.24 seconds)4720worker2 # [ 81.549970] systemd[1]: Stopping Nix worker-protocol over gRPC...4721worker2 # [ 81.633411] nix-grpc-daemon[778]: ts=2026-09-20T13:34:54Z level=info event=signal_exit4722worker2 # [ 81.891080] nix-grpc-daemon[778]: ts=2026-09-20T13:34:54Z level=info event=scheduler_yield4723worker2 # [ 81.901336] nix-grpc-daemon[778]: ts=2026-09-20T13:34:54Z level=info event=scheduler_restarting addr=lb:500514724worker1 # [ 81.933180] nix-grpc-daemon[775]: ts=2026-09-20T13:34:54Z level=info event=scheduler_restarting addr=lb:500514725lb # [ 81.902874] niks3-server[1041]: 2026/09/20 13:34:54 INFO lead: released remote=192.168.1.4:597564726worker2 # [ 81.907811] nix-grpc-daemon[778]: ts=2026-09-20T13:34:54Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:416384727worker2 # [ 81.912515] nix-grpc-daemon[778]: ts=2026-09-20T13:34:54Z level=info event=worker_gone addr=192.168.1.3:500514728worker2 # [ 81.916429] nix-grpc-daemon[778]: ts=2026-09-20T13:34:54Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:416384729worker2 # [ 81.920769] nix-grpc-daemon[778]: ts=2026-09-20T13:34:54Z level=info event=worker_gone addr=192.168.1.4:500514730lb # [ 81.945801] niks3-server[1041]: 2026/09/20 13:34:54 INFO lead: acquired remote=192.168.1.3:329224731worker1 # [ 81.975993] nix-grpc-daemon[775]: ts=2026-09-20T13:34:54Z level=info event=scheduler_take_over4732worker1 # [ 82.133219] nix-grpc-daemon[775]: ts=2026-09-20T13:34:54Z level=info event=scheduler_connected addr=lb:500514733worker2 # [ 82.102963] nix-grpc-daemon[778]: ts=2026-09-20T13:34:54Z level=info event=scheduler_connected addr=lb:500514734worker1 # [ 82.138669] nix-grpc-daemon[775]: ts=2026-09-20T13:34:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4735worker2 # [ 82.108363] nix-grpc-daemon[778]: ts=2026-09-20T13:34:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4736worker2 # [ 82.309689] nix-grpc-daemon[778]: ts=2026-09-20T13:34:54Z level=info event=scheduler_connected addr=lb:500514737worker1 # [ 82.339927] nix-grpc-daemon[775]: ts=2026-09-20T13:34:54Z level=info event=scheduler_connected addr=lb:500514738worker2 # [ 82.315110] nix-grpc-daemon[778]: ts=2026-09-20T13:34:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4739worker1 # [ 82.346036] nix-grpc-daemon[775]: ts=2026-09-20T13:34:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4740worker2 # [ 82.516370] nix-grpc-daemon[778]: ts=2026-09-20T13:34:55Z level=info event=scheduler_connected addr=lb:500514741worker1 # [ 82.546977] nix-grpc-daemon[775]: ts=2026-09-20T13:34:55Z level=info event=scheduler_connected addr=lb:500514742worker2 # [ 82.521718] nix-grpc-daemon[778]: ts=2026-09-20T13:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4743worker1 # [ 82.552657] nix-grpc-daemon[775]: ts=2026-09-20T13:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4744worker1 # [ 82.753327] nix-grpc-daemon[775]: ts=2026-09-20T13:34:55Z level=info event=scheduler_connected addr=lb:500514745worker2 # [ 82.724700] nix-grpc-daemon[778]: ts=2026-09-20T13:34:55Z level=info event=scheduler_connected addr=lb:500514746worker1 # [ 82.758741] nix-grpc-daemon[775]: ts=2026-09-20T13:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4747worker2 # [ 82.728931] nix-grpc-daemon[778]: ts=2026-09-20T13:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4748worker2 # [ 82.896146] nix-grpc-daemon[778]: ts=2026-09-20T13:34:55Z level=info event=scheduler_restarting4749worker1 # [ 82.961702] nix-grpc-daemon[775]: ts=2026-09-20T13:34:55Z level=info event=scheduler_connected addr=lb:500514750worker1 # [ 82.965924] nix-grpc-daemon[775]: ts=2026-09-20T13:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4751worker2 # [ 82.949825] nix-daemon[847]: reaped child process 849, status = succeeded4752worker2 # [ 82.952739] nix-grpc-daemon[778]: ts=2026-09-20T13:34:55Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4753worker1 # [ 83.162094] nix-grpc-daemon[775]: ts=2026-09-20T13:34:55Z level=info event=scheduler_connected addr=lb:500514754worker1 # [ 83.167336] nix-grpc-daemon[775]: ts=2026-09-20T13:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4755worker1 # [ 83.368215] nix-grpc-daemon[775]: ts=2026-09-20T13:34:55Z level=info event=scheduler_connected addr=lb:500514756worker1 # [ 83.373432] nix-grpc-daemon[775]: ts=2026-09-20T13:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4757worker1 # [ 83.574389] nix-grpc-daemon[775]: ts=2026-09-20T13:34:56Z level=info event=scheduler_connected addr=lb:500514758worker1 # [ 83.579781] nix-grpc-daemon[775]: ts=2026-09-20T13:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4759worker1 # [ 83.780417] nix-grpc-daemon[775]: ts=2026-09-20T13:34:56Z level=info event=scheduler_connected addr=lb:500514760worker2 # [ 83.762414] nix-grpc-daemon[778]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4761worker2 # [ 83.766983] nix-grpc-daemon[778]: E0000 00:00:1789911296.279919 821 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4762worker1 # [ 83.801495] nix-grpc-daemon[775]: ts=2026-09-20T13:34:56Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:517564763worker1 # [ 83.807909] nix-grpc-daemon[775]: ts=2026-09-20T13:34:56Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04764worker2 # [ 83.802434] nix-grpc-daemon[778]: E0000 00:00:1789911296.321145 821 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4765worker2 # [ 84.212942] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4766worker2 # [ 84.221599] systemd[1]: Stopped Nix worker-protocol over gRPC.4767worker2 # [ 84.228204] systemd[1]: nix-grpc-daemon.service: Consumed 1.994s CPU time over 1min 2.913s wall clock time, 51.7M memory peak, 54.8K incoming IP traffic, 137.8K outgoing IP traffic.4768worker2 # [ 84.244308] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4769worker2 # [ 84.246447] systemd[1]: Closed Nix worker-protocol over gRPC.4770worker2 # [ 84.250065] systemd[1]: nix-grpc-daemon.socket: Consumed 691us CPU time over 1min 12.379s wall clock time, 256K memory peak, 78.1K incoming IP traffic, 65K outgoing IP traffic.4771lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4772lb: must succeed: curl -sf localhost:9901/clusters4773lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4774lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4775client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24776worker1 # [ 84.623906] nix-grpc-daemon[775]: ts=2026-09-20T13:34:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:427724777client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4778worker1 # [ 84.631492] nix-grpc-daemon[775]: ts=2026-09-20T13:34:57Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:427724779client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.29 seconds)4780worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4781worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4782worker2 # [ 84.742737] systemd[1]: Listening on Nix worker-protocol over gRPC.4783worker1 # [ 84.855501] systemd[1]: Stopping Nix worker-protocol over gRPC...4784worker2 # [ 85.204812] systemd[1]: Starting scheduler-token.service...4785worker2 # [ 85.321404] systemd[1]: scheduler-token.service: Deactivated successfully.4786worker2 # [ 85.328188] systemd[1]: Finished scheduler-token.service.4787worker2 # [ 85.329710] systemd[1]: scheduler-token.service: Consumed 56ms CPU time over 119ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4788worker2 # [ 85.336955] systemd[1]: Starting Nix worker-protocol over gRPC...4789worker1 # [ 85.510149] nix-grpc-daemon[775]: ts=2026-09-20T13:34:58Z level=info event=signal_exit4790worker2 # [ 85.526083] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:58Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4791worker2 # [ 85.528709] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:58Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4792worker2 # [ 85.532866] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:58Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14793worker2 # [ 85.541107] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:58Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4794worker2 # [ 85.542841] systemd[1]: Started Nix worker-protocol over gRPC.4795worker2 # [ 85.571868] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:58Z level=info event=scheduler_connected addr=lb:500514796worker1 # [ 85.606116] nix-grpc-daemon[775]: ts=2026-09-20T13:34:58Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:517564797worker1 # [ 85.612975] nix-grpc-daemon[775]: ts=2026-09-20T13:34:58Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04798worker1 # [ 85.769144] nix-grpc-daemon[775]: ts=2026-09-20T13:34:58Z level=info event=scheduler_yield4799worker2 # [ 85.741199] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:58Z level=info event=scheduler_restarting addr=lb:500514800lb # [ 85.747840] niks3-server[1041]: 2026/09/20 13:34:58 INFO lead: released remote=192.168.1.3:329224801worker1 # [ 85.779451] nix-grpc-daemon[775]: ts=2026-09-20T13:34:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:517564802worker1 # [ 85.786088] nix-grpc-daemon[775]: ts=2026-09-20T13:34:58Z level=info event=worker_gone addr=192.168.1.4:500514803worker1 # [ 85.791958] nix-grpc-daemon[775]: ts=2026-09-20T13:34:58Z level=info event=scheduler_restarting addr=lb:500514804worker1 # [ 85.795968] nix-grpc-daemon[775]: ts=2026-09-20T13:34:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:517564805worker1 # [ 85.800422] nix-grpc-daemon[775]: ts=2026-09-20T13:34:58Z level=info event=worker_gone addr=192.168.1.3:500514806worker2 # [ 85.942695] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:58Z level=info event=scheduler_connected addr=lb:500514807worker2 # [ 85.948075] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4808worker1 # [ 85.986324] nix-grpc-daemon[775]: ts=2026-09-20T13:34:58Z level=info event=scheduler_connected addr=lb:500514809worker1 # [ 85.992414] nix-grpc-daemon[775]: ts=2026-09-20T13:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4810worker2 # [ 86.149024] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:58Z level=info event=scheduler_connected addr=lb:500514811worker2 # [ 86.154159] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4812worker1 # [ 86.192789] nix-grpc-daemon[775]: ts=2026-09-20T13:34:58Z level=info event=scheduler_connected addr=lb:500514813worker1 # [ 86.198903] nix-grpc-daemon[775]: ts=2026-09-20T13:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4814worker2 # [ 86.355094] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:58Z level=info event=scheduler_connected addr=lb:500514815worker2 # [ 86.360315] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4816worker1 # [ 86.399604] nix-grpc-daemon[775]: ts=2026-09-20T13:34:58Z level=info event=scheduler_connected addr=lb:500514817worker1 # [ 86.404871] nix-grpc-daemon[775]: ts=2026-09-20T13:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4818worker2 # [ 86.562871] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:59Z level=info event=scheduler_connected addr=lb:500514819worker2 # [ 86.567095] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4820worker1 # [ 86.605876] nix-grpc-daemon[775]: ts=2026-09-20T13:34:59Z level=info event=scheduler_connected addr=lb:500514821worker1 # [ 86.611005] nix-grpc-daemon[775]: ts=2026-09-20T13:34:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4822worker1 # [ 86.775164] nix-grpc-daemon[775]: ts=2026-09-20T13:34:59Z level=info event=scheduler_restarting4823worker2 # [ 86.764298] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:59Z level=info event=scheduler_connected addr=lb:500514824worker2 # [ 86.769468] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4825worker1 # [ 86.804762] nix-daemon[833]: reaped child process 835, status = succeeded4826worker1 # [ 86.832828] nix-grpc-daemon[775]: ts=2026-09-20T13:34:59Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4827worker2 # [ 86.970568] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:59Z level=info event=scheduler_connected addr=lb:500514828worker2 # [ 86.975678] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4829worker2 # [ 87.176872] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:59Z level=info event=scheduler_connected addr=lb:500514830worker2 # [ 87.181935] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4831worker2 # [ 87.383028] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:59Z level=info event=scheduler_connected addr=lb:500514832worker2 # [ 87.388281] nix-grpc-daemon[1078]: ts=2026-09-20T13:34:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4833worker1 # [ 87.617575] nix-grpc-daemon[775]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4834worker2 # [ 87.590906] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:00Z level=info event=scheduler_connected addr=lb:500514835worker1 # [ 87.617970] nix-grpc-daemon[775]: E0000 00:00:1789911300.128403 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true4836worker2 # [ 87.595127] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4837worker1 # [ 87.686849] nix-grpc-daemon[775]: E0000 00:00:1789911300.197858 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4838worker2 # [ 87.791839] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:00Z level=info event=scheduler_connected addr=lb:500514839worker2 # [ 87.797076] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4840worker2 # [ 87.998022] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:00Z level=info event=scheduler_connected addr=lb:500514841worker2 # [ 88.003645] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4842worker1 # [ 88.171385] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4843worker1 # [ 88.179196] systemd[1]: Stopped Nix worker-protocol over gRPC.4844worker1 # [ 88.185968] systemd[1]: nix-grpc-daemon.service: Consumed 4.089s CPU time over 1min 7.004s wall clock time, 60M memory peak, 87.4K incoming IP traffic, 158.2K outgoing IP traffic.4845worker1 # [ 88.201033] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4846worker1 # [ 88.204235] systemd[1]: Closed Nix worker-protocol over gRPC.4847worker1 # [ 88.205933] systemd[1]: nix-grpc-daemon.socket: Consumed 599us CPU time over 1min 16.333s wall clock time, 256K memory peak, 85.2K incoming IP traffic, 70.3K outgoing IP traffic.4848lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4849lb: must succeed: curl -sf localhost:9901/clusters4850worker2 # [ 88.205031] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:00Z level=info event=scheduler_connected addr=lb:500514851worker2 # [ 88.210307] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4852lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4853lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4854client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24855worker2 # [ 88.411557] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:00Z level=info event=scheduler_connected addr=lb:500514856worker2 # [ 88.417178] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4857worker2 # [ 88.523419] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:596764858worker2 # [ 88.538864] nix-daemon[847]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)4859worker2 # [ 88.565190] nix-grpc-daemon[1078]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 1/5)4860worker2 # [ 88.575118] nix-grpc-daemon[1078]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 193 ms (attempt 2/5)4861worker2 # [ 88.619950] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:01Z level=info event=scheduler_connected addr=lb:500514862worker2 # [ 88.624268] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4863worker2 # [ 88.777534] nix-grpc-daemon[1078]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 3/5)4864worker2 # [ 88.820841] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:01Z level=info event=scheduler_connected addr=lb:500514865worker2 # [ 88.825977] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4866worker2 # [ 88.877122] nix-grpc-daemon[1078]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 183 ms (attempt 4/5)4867worker2 # [ 89.027104] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:01Z level=info event=scheduler_connected addr=lb:500514868worker2 # [ 89.032484] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4869worker2 # [ 89.068565] nix-grpc-daemon[1078]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4870client # copying 2 paths...4871client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4872worker2 # [ 89.094324] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:596764873client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4874worker2 # [ 89.109017] nix-daemon[847]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)4875worker2 # [ 89.142570] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:01Z level=info event=niks3_push_started pid=11344876worker2 # [ 89.234095] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:01Z level=info event=scheduler_connected addr=lb:500514877worker2 # [ 89.236362] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4878worker2 # [ 89.358373] nix-grpc-daemon[1134]: time=2026-09-20T13:35:01.876Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""4879worker2 # [ 89.438476] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:01Z level=info event=scheduler_connected addr=lb:500514880worker2 # [ 89.441317] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4881worker2 # [ 89.542953] nix-daemon[847]: accepted connection from pid 1147, user nix-grpc-daemon (trusted)4882worker2 # [ 89.561806] nix-daemon[847]: reaped child process 1150, status = succeeded4883lb # [ 89.577496] niks3-server[1041]: 2026/09/20 13:35:02 INFO Received uploads request method=POST path=/api/pending_closures4884lb # [ 89.589160] niks3-server[1041]: 2026/09/20 13:35:02 INFO Received uploads request method=POST path=/api/pending_closures4885worker2 # [ 89.599596] nix-grpc-daemon[1134]: time=2026-09-20T13:35:02.116Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4886worker2 # [ 89.602249] nix-grpc-daemon[1134]: time=2026-09-20T13:35:02.116Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4887worker2 # [ 89.604266] nix-grpc-daemon[1134]: time=2026-09-20T13:35:02.116Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4888worker2 # [ 89.642067] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:02Z level=info event=scheduler_connected addr=lb:500514889worker2 # [ 89.644747] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4890lb # [ 89.649679] niks3-server[1041]: 2026/09/20 13:35:02 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4891lb # [ 89.663061] niks3-server[1041]: 2026/09/20 13:35:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4892lb # [ 89.674596] niks3-server[1041]: 2026/09/20 13:35:02 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4893lb # [ 89.681405] niks3-server[1041]: 2026/09/20 13:35:02 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4894lb # [ 89.687163] niks3-server[1041]: 2026/09/20 13:35:02 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4895lb # [ 89.691011] niks3-server[1041]: 2026/09/20 13:35:02 INFO Signed narinfos id=25 count=14896lb # [ 89.693674] niks3-server[1041]: 2026/09/20 13:35:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4897worker2 # [ 89.694655] nix-grpc-daemon[1134]: time=2026-09-20T13:35:02.211Z level=INFO msg="Uploading 3 narinfos"4898lb # [ 89.697394] niks3-server[1041]: 2026/09/20 13:35:02 INFO Signed narinfos id=26 count=24899lb # [ 89.724802] niks3-server[1041]: 2026/09/20 13:35:02 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4900lb # [ 89.731361] niks3-server[1041]: 2026/09/20 13:35:02 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4901lb # [ 89.736453] niks3-server[1041]: 2026/09/20 13:35:02 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4902lb # [ 89.742924] niks3-server[1041]: 2026/09/20 13:35:02 INFO Completed upload id=254903lb # [ 89.745026] niks3-server[1041]: 2026/09/20 13:35:02 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4904worker2 # [ 89.742366] nix-grpc-daemon[1134]: time=2026-09-20T13:35:02.261Z level=INFO msg="Upload complete. (380ms)"4905lb # [ 89.747719] niks3-server[1041]: 2026/09/20 13:35:02 INFO Completed upload id=264906worker2 # [ 89.756637] nix-grpc-daemon[1134]: time=2026-09-20T13:35:02.266Z level=WARN msg="Failed to register uploaded object" key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo error="server returned 404: object is not pending upload\n"4907worker2 # [ 89.772948] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59676 duration_s=0 paths=2 nar_bytes_in=3124908worker2 # [ 89.778883] nix-daemon[847]: reaped child process 1132, status = succeeded4909client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.52 seconds)4910worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4911worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds)4912worker2 # [ 89.845945] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:02Z level=info event=scheduler_connected addr=lb:500514913worker2 # [ 89.851386] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4914worker1 # [ 89.932656] systemd[1]: Listening on Nix worker-protocol over gRPC.4915worker1 # [ 89.936914] systemd[1]: Starting Nix worker-protocol over gRPC...4916worker2 # [ 90.052465] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:02Z level=info event=scheduler_connected addr=lb:500514917worker2 # [ 90.057632] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4918worker1 # [ 90.127722] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:02Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4919worker1 # [ 90.130518] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:02Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4920worker1 # [ 90.134860] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:02Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14921worker1 # [ 90.143709] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:02Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4922worker1 # [ 90.157969] systemd[1]: Started Nix worker-protocol over gRPC.4923worker1 # [ 90.160206] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:02Z level=info event=scheduler_take_over4924lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4925lb: must succeed: curl -sf localhost:9901/clusters4926lb # [ 90.129072] niks3-server[1041]: 2026/09/20 13:35:02 INFO lead: acquired remote=192.168.1.3:412044927worker1 # [ 90.187548] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:02Z level=info event=scheduler_connected addr=lb:500514928worker1 # [ 90.192563] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:02Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:518144929worker1 # [ 90.194731] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:02Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04930lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4931lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds)4932(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.09 seconds)4933subtest: scheduler down: the other node takes the lock and keeps it4934lb: must succeed: curl -sf localhost:9901/clusters4935worker2 # [ 90.258736] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:02Z level=info event=scheduler_connected addr=lb:500514936worker1 # [ 90.300197] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:02Z level=info event=oidc_jwks provider=mock keys=14937worker1 # [ 90.305771] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:02Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:518144938worker1 # [ 90.311165] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:02Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04939lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4940lb: must succeed: curl -sf localhost:9901/clusters4941lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4942lb: must succeed: curl -sf localhost:9901/clusters4943lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4944lb: must succeed: curl -sf localhost:9901/clusters4945lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4946worker1 # [ 90.551909] systemd[1]: Stopping Nix worker-protocol over gRPC...4947worker1 # [ 91.149074] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:03Z level=info event=signal_exit4948lb # [ 91.134391] envoy[921]: conn peer=[2001:db8:1::4]:44140 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=45923 tx=2405 ms=612954949lb # [ 91.139638] envoy[921]: conn peer=[2001:db8:1::1]:52166 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=234950lb # [ 91.144622] envoy[921]: conn peer=192.168.1.3:35170 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=10343 tx=2939 ms=643034951lb # [ 91.150196] envoy[921]: conn peer=[2001:db8:1::1]:52176 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1010 tx=282 ms=12474952worker1 # [ 91.358880] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:03Z level=info event=scheduler_yield4953lb # [ 91.336229] niks3-server[1041]: 2026/09/20 13:35:03 INFO lead: released remote=192.168.1.3:412044954worker2 # [ 91.335736] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:03Z level=info event=scheduler_restarting addr=lb:500514955worker1 # [ 91.366195] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:03Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:518144956worker1 # [ 91.372258] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:03Z level=info event=worker_gone addr=192.168.1.4:500514957worker1 # [ 91.378393] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:03Z level=info event=scheduler_restarting addr=lb:500514958worker1 # [ 91.382742] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:03Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:518144959worker1 # [ 91.387364] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:03Z level=info event=worker_gone addr=192.168.1.3:500514960worker2 # [ 91.536122] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:04Z level=info event=scheduler_connected addr=lb:500514961worker2 # [ 91.541457] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4962worker1 # [ 91.573255] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=info event=scheduler_connected addr=lb:500514963worker1 # [ 91.578713] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4964worker2 # [ 91.742675] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:04Z level=info event=scheduler_connected addr=lb:500514965worker1 # [ 91.779496] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=info event=scheduler_connected addr=lb:500514966worker2 # [ 91.748221] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4967worker1 # [ 91.784945] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4968worker2 # [ 91.949391] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:04Z level=info event=scheduler_connected addr=lb:500514969worker2 # [ 91.954728] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4970worker1 # [ 91.986056] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=info event=scheduler_connected addr=lb:500514971worker1 # [ 91.991853] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4972worker2 # [ 92.155877] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:04Z level=info event=scheduler_connected addr=lb:500514973worker2 # [ 92.161430] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4974worker1 # [ 92.195020] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=info event=scheduler_connected addr=lb:500514975worker1 # [ 92.199553] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4976worker1 # [ 92.364233] nix-grpc-daemon[1202]: ts=2026-09-20T13:35:04Z level=info event=scheduler_restarting4977worker2 # [ 92.364633] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:04Z level=info event=scheduler_connected addr=lb:500514978worker2 # [ 92.369009] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4979worker2 # [ 92.565339] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:05Z level=info event=scheduler_connected addr=lb:500514980worker2 # [ 92.570739] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4981worker2 # [ 92.771788] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:05Z level=info event=scheduler_connected addr=lb:500514982worker2 # [ 92.777151] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4983worker2 # [ 92.978536] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:05Z level=info event=scheduler_connected addr=lb:500514984worker2 # [ 92.983804] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4985worker1 # [ 93.192650] nix-grpc-daemon[1202]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4986worker1 # [ 93.198533] nix-grpc-daemon[1202]: E0000 00:00:1789911305.703485 1245 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true4987worker1 # [ 93.205269] nix-grpc-daemon[1202]: E0000 00:00:1789911305.703739 1245 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4988worker2 # [ 93.185326] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:05Z level=info event=scheduler_connected addr=lb:500514989worker2 # [ 93.190533] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4990worker2 # [ 93.393601] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:05Z level=info event=scheduler_connected addr=lb:500514991worker2 # [ 93.398119] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4992worker2 # [ 93.594714] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:06Z level=info event=scheduler_connected addr=lb:500514993worker2 # [ 93.600091] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4994worker2 # [ 93.801339] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:06Z level=info event=scheduler_connected addr=lb:500514995worker2 # [ 93.806657] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4996worker2 # [ 94.008150] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:06Z level=info event=scheduler_connected addr=lb:500514997worker2 # [ 94.013504] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4998worker1 # [ 94.180450] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4999worker1 # [ 94.186113] systemd[1]: Stopped Nix worker-protocol over gRPC.5000worker1 # [ 94.193197] systemd[1]: nix-grpc-daemon.service: Consumed 175ms CPU time over 4.247s wall clock time, 10.8M memory peak, 9.2K incoming IP traffic, 7.9K outgoing IP traffic.5001worker1 # [ 94.208177] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5002worker1 # [ 94.212705] systemd[1]: Closed Nix worker-protocol over gRPC.5003worker1 # [ 94.214658] systemd[1]: nix-grpc-daemon.socket: Consumed 810us CPU time over 4.287s wall clock time, 256K memory peak, 13.4K incoming IP traffic, 10.4K outgoing IP traffic.5004worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5005worker2 # [ 94.215856] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:06Z level=info event=scheduler_connected addr=lb:500515006worker2 # [ 94.224730] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5007worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.11 seconds)5008worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5009worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)5010worker2 # [ 94.426715] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:06Z level=info event=scheduler_connected addr=lb:500515011worker2 # [ 94.431075] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5012worker2 # [ 94.627649] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:07Z level=info event=scheduler_connected addr=lb:500515013worker2 # [ 94.633469] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5014worker2 # [ 94.835016] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:07Z level=info event=scheduler_connected addr=lb:500515015worker2 # [ 94.840600] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5016worker2 # [ 95.041878] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:07Z level=info event=scheduler_connected addr=lb:500515017worker2 # [ 95.047475] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5018worker2 # [ 95.248754] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:07Z level=info event=scheduler_connected addr=lb:500515019worker2 # [ 95.254268] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5020worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5021worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)5022worker2 # [ 95.455979] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:07Z level=info event=scheduler_connected addr=lb:500515023worker2 # [ 95.459492] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5024worker2 # [ 95.562245] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:08Z level=info event=scheduler_take_over5025lb # [ 95.565877] niks3-server[1041]: 2026/09/20 13:35:08 INFO lead: acquired remote=192.168.1.4:430925026worker2 # [ 95.660702] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:08Z level=info event=scheduler_connected addr=lb:500515027worker2 # [ 95.691429] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:08Z level=info event=oidc_jwks provider=mock keys=15028worker2 # [ 95.696265] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:08Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:494705029worker2 # [ 95.701817] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05030worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5031worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)5032client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&25033worker2 # [ 96.779273] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:596765034client # don't know how to build these paths:5035client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5036worker2 # [ 96.789525] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:596765037worker2 # [ 96.818868] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:09Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=05038worker2 # [ 96.826144] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:09Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=15039worker2 # [ 96.866202] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:596765040worker2 # [ 96.882948] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:596765041client # copying 1 paths to 'lb:50051'...5042client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...5043worker2 # [ 96.900115] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:596765044worker2 # [ 96.917082] nix-daemon[847]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5045worker2 # [ 97.125588] nix-daemon[847]: accepted connection from pid 1174, user nix-grpc-daemon (trusted)5046worker2 # [ 97.145609] nix-daemon[847]: reaped child process 1177, status = succeeded5047worker2 # [ 97.322390] nix-daemon[847]: accepted connection from pid 1179, user nix-grpc-daemon (trusted)5048worker2 # [ 97.341873] nix-daemon[847]: reaped child process 1182, status = succeeded5049lb # [ 97.356822] niks3-server[1041]: 2026/09/20 13:35:09 INFO Received uploads request method=POST path=/api/pending_closures5050worker2 # [ 97.370154] nix-grpc-daemon[1134]: time=2026-09-20T13:35:09.888Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5051worker2 # [ 97.371629] nix-grpc-daemon[1134]: time=2026-09-20T13:35:09.888Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"5052lb # [ 97.395022] niks3-server[1041]: 2026/09/20 13:35:09 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst5053worker2 # [ 97.409149] nix-grpc-daemon[1134]: time=2026-09-20T13:35:09.927Z level=INFO msg="Uploading 1 narinfos"5054lb # [ 97.409954] niks3-server[1041]: 2026/09/20 13:35:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5055lb # [ 97.420104] niks3-server[1041]: 2026/09/20 13:35:09 INFO Signed narinfos id=27 count=15056lb # [ 97.425700] niks3-server[1041]: 2026/09/20 13:35:09 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls5057worker2 # [ 97.433876] nix-grpc-daemon[1134]: time=2026-09-20T13:35:09.952Z level=INFO msg="Upload complete. (499ms)"5058lb # [ 97.435289] niks3-server[1041]: 2026/09/20 13:35:09 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5059lb # [ 97.439577] niks3-server[1041]: 2026/09/20 13:35:09 INFO Completed upload id=275060lb # [ 97.442367] niks3-server[1041]: 2026/09/20 13:35:09 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo5061worker2 # [ 97.442280] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59676 duration_s=0 paths=1 nar_bytes_in=5205062worker2 # [ 97.455569] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:596765063worker2 # [ 97.461929] nix-daemon[847]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5064worker2 # [ 97.466751] nix-daemon[847]: reaped child process 1172, status = succeeded5065client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5066client # farm-a> worker2: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5067worker2 # [ 97.480262] nix-daemon[847]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5068client # farm-a> LOG-farm-a-on-standby5069worker2 # [ 98.328583] nix-daemon[847]: reaped child process 1186, status = succeeded5070worker2 # [ 98.504378] nix-daemon[847]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)5071worker2 # [ 98.523941] nix-daemon[847]: reaped child process 1204, status = succeeded5072lb # [ 98.538464] niks3-server[1041]: 2026/09/20 13:35:11 INFO Received uploads request method=POST path=/api/pending_closures5073worker2 # [ 98.549424] nix-grpc-daemon[1134]: time=2026-09-20T13:35:11.067Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5074worker2 # [ 98.553022] nix-grpc-daemon[1134]: time=2026-09-20T13:35:11.067Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5075worker2 # [ 98.597281] nix-grpc-daemon[1134]: time=2026-09-20T13:35:11.115Z level=INFO msg="Uploading 1 narinfos"5076lb # [ 98.589251] niks3-server[1041]: 2026/09/20 13:35:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5077lb # [ 98.608150] niks3-server[1041]: 2026/09/20 13:35:11 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5078lb # [ 98.625410] niks3-server[1041]: 2026/09/20 13:35:11 INFO Signed narinfos id=28 count=15079lb # [ 98.627722] niks3-server[1041]: 2026/09/20 13:35:11 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5080worker2 # [ 98.638316] nix-grpc-daemon[1134]: time=2026-09-20T13:35:11.157Z level=INFO msg="Upload complete. (346ms)"5081lb # [ 98.639945] niks3-server[1041]: 2026/09/20 13:35:11 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5082lb # [ 98.643699] niks3-server[1041]: 2026/09/20 13:35:11 INFO Completed upload id=285083lb # [ 98.647118] niks3-server[1041]: 2026/09/20 13:35:11 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5084lb # [ 98.650447] niks3-server[1041]: 2026/09/20 13:35:11 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5085worker2 # [ 98.660943] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59676 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15086worker2 # [ 98.672306] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:11Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05087worker2 # [ 98.675981] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:11Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=15088worker2 # [ 98.682150] nix-daemon[847]: reaped child process 1184, status = succeeded5089worker2 # [ 98.704563] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:596765090worker2 # [ 98.720446] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:596765091worker2 # [ 98.735574] nix-grpc-daemon[1134]: time=2026-09-20T13:35:11.254Z level=INFO msg="All 1 paths already cached"5092client # copying 1 paths to 'lb:50051'...5093client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5094worker2 # [ 98.745865] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:596765095worker2 # [ 98.760653] nix-daemon[847]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5096worker2 # [ 98.958545] nix-daemon[847]: accepted connection from pid 1210, user nix-grpc-daemon (trusted)5097worker2 # [ 98.977463] nix-daemon[847]: reaped child process 1213, status = succeeded5098worker2 # [ 99.150851] nix-daemon[847]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)5099worker2 # [ 99.167945] nix-daemon[847]: reaped child process 1218, status = succeeded5100lb # [ 99.180955] niks3-server[1041]: 2026/09/20 13:35:11 INFO Received uploads request method=POST path=/api/pending_closures5101worker2 # [ 99.191585] nix-grpc-daemon[1134]: time=2026-09-20T13:35:11.710Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5102worker2 # [ 99.193229] nix-grpc-daemon[1134]: time=2026-09-20T13:35:11.710Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5103lb # [ 99.209208] niks3-server[1041]: 2026/09/20 13:35:11 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5104worker2 # [ 99.230255] nix-grpc-daemon[1134]: time=2026-09-20T13:35:11.748Z level=INFO msg="Uploading 1 narinfos"5105lb # [ 99.224425] niks3-server[1041]: 2026/09/20 13:35:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5106lb # [ 99.238741] niks3-server[1041]: 2026/09/20 13:35:11 INFO Signed narinfos id=29 count=15107lb # [ 99.245124] niks3-server[1041]: 2026/09/20 13:35:11 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5108worker2 # [ 99.252656] nix-grpc-daemon[1134]: time=2026-09-20T13:35:11.771Z level=INFO msg="Upload complete. (475ms)"5109lb # [ 99.255331] niks3-server[1041]: 2026/09/20 13:35:11 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5110lb # [ 99.261740] niks3-server[1041]: 2026/09/20 13:35:11 INFO Completed upload id=295111worker2 # [ 99.260143] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59676 duration_s=0 paths=1 nar_bytes_in=6405112lb # [ 99.265515] niks3-server[1041]: 2026/09/20 13:35:11 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5113worker2 # [ 99.272518] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:596765114worker2 # [ 99.278528] nix-daemon[847]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5115worker2 # [ 99.283270] nix-daemon[847]: reaped child process 1208, status = succeeded5116client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5117client # farm-b> worker2: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5118worker2 # [ 99.297155] nix-daemon[847]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5119client # farm-b> LOG-farm-b-on-standby5120worker2 # [ 100.741301] nix-daemon[847]: reaped child process 1222, status = succeeded5121worker2 # [ 100.924127] nix-daemon[847]: accepted connection from pid 1237, user nix-grpc-daemon (trusted)5122worker2 # [ 100.941383] nix-daemon[847]: reaped child process 1240, status = succeeded5123lb # [ 100.957240] niks3-server[1041]: 2026/09/20 13:35:13 INFO Received uploads request method=POST path=/api/pending_closures5124worker2 # [ 100.968649] nix-grpc-daemon[1134]: time=2026-09-20T13:35:13.485Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5125worker2 # [ 100.971727] nix-grpc-daemon[1134]: time=2026-09-20T13:35:13.485Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5126lb # [ 100.996280] niks3-server[1041]: 2026/09/20 13:35:13 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5127lb # [ 101.006736] niks3-server[1041]: 2026/09/20 13:35:13 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5128worker2 # [ 101.014263] nix-grpc-daemon[1134]: time=2026-09-20T13:35:13.532Z level=INFO msg="Uploading 1 narinfos"5129lb # [ 101.017776] niks3-server[1041]: 2026/09/20 13:35:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5130lb # [ 101.026348] niks3-server[1041]: 2026/09/20 13:35:13 INFO Signed narinfos id=30 count=15131lb # [ 101.029396] niks3-server[1041]: 2026/09/20 13:35:13 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5132lb # [ 101.035493] niks3-server[1041]: 2026/09/20 13:35:13 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5133lb # [ 101.039724] niks3-server[1041]: 2026/09/20 13:35:13 INFO Completed upload id=305134worker2 # [ 101.039118] nix-grpc-daemon[1134]: time=2026-09-20T13:35:13.558Z level=INFO msg="Upload complete. (331ms)"5135lb # [ 101.042299] niks3-server[1041]: 2026/09/20 13:35:13 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5136worker2 # [ 101.057169] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59676 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15137worker2 # [ 101.072366] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:13Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05138worker2 # [ 101.078302] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:13Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=15139worker2 # [ 101.082560] nix-daemon[847]: reaped child process 1220, status = succeeded5140worker2 # [ 101.099504] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:596765141worker2 # [ 101.114301] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:596765142worker2 # [ 101.127981] nix-grpc-daemon[1134]: time=2026-09-20T13:35:13.646Z level=INFO msg="All 2 paths already cached"5143client # copying 1 paths to 'lb:50051'...5144client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5145worker2 # [ 101.138302] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:596765146lb # [ 101.141016] envoy[921]: conn peer=[2001:db8:1::3]:37534 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1028 tx=349 ms=22315147worker2 # [ 101.154718] nix-daemon[847]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5148worker2 # [ 101.358214] nix-daemon[847]: accepted connection from pid 1246, user nix-grpc-daemon (trusted)5149worker2 # [ 101.375981] nix-daemon[847]: reaped child process 1249, status = succeeded5150worker2 # [ 101.553892] nix-daemon[847]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)5151worker2 # [ 101.571025] nix-daemon[847]: reaped child process 1254, status = succeeded5152lb # [ 101.584694] niks3-server[1041]: 2026/09/20 13:35:14 INFO Received uploads request method=POST path=/api/pending_closures5153worker2 # [ 101.592694] nix-grpc-daemon[1134]: time=2026-09-20T13:35:14.111Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5154worker2 # [ 101.594305] nix-grpc-daemon[1134]: time=2026-09-20T13:35:14.111Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5155lb # [ 101.611324] niks3-server[1041]: 2026/09/20 13:35:14 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5156lb # [ 101.624789] niks3-server[1041]: 2026/09/20 13:35:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5157worker2 # [ 101.631314] nix-grpc-daemon[1134]: time=2026-09-20T13:35:14.149Z level=INFO msg="Uploading 1 narinfos"5158lb # [ 101.636859] niks3-server[1041]: 2026/09/20 13:35:14 INFO Signed narinfos id=31 count=15159lb # [ 101.639733] niks3-server[1041]: 2026/09/20 13:35:14 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5160lb # [ 101.648244] niks3-server[1041]: 2026/09/20 13:35:14 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5161lb # [ 101.656004] niks3-server[1041]: 2026/09/20 13:35:14 INFO Completed upload id=315162worker2 # [ 101.655246] nix-grpc-daemon[1134]: time=2026-09-20T13:35:14.174Z level=INFO msg="Upload complete. (482ms)"5163lb # [ 101.658857] niks3-server[1041]: 2026/09/20 13:35:14 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5164worker2 # [ 101.664228] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59676 duration_s=0 paths=1 nar_bytes_in=7685165worker2 # [ 101.675773] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:596765166worker2 # [ 101.682391] nix-daemon[847]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5167worker2 # [ 101.686702] nix-daemon[847]: reaped child process 1244, status = succeeded5168client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5169client # farm-top> worker2: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5170worker2 # [ 101.699694] nix-daemon[847]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5171client # farm-top> LOG-farm-top-on-standby5172worker2 # [ 102.722192] nix-daemon[847]: reaped child process 1258, status = succeeded5173worker2 # [ 102.882500] nix-daemon[847]: accepted connection from pid 1273, user nix-grpc-daemon (trusted)5174worker2 # [ 102.900939] nix-daemon[847]: reaped child process 1276, status = succeeded5175lb # [ 102.914508] niks3-server[1041]: 2026/09/20 13:35:15 INFO Received uploads request method=POST path=/api/pending_closures5176worker2 # [ 102.925990] nix-grpc-daemon[1134]: time=2026-09-20T13:35:15.443Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5177worker2 # [ 102.927511] nix-grpc-daemon[1134]: time=2026-09-20T13:35:15.443Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5178lb # [ 102.948414] niks3-server[1041]: 2026/09/20 13:35:15 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5179lb # [ 102.964143] niks3-server[1041]: 2026/09/20 13:35:15 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5180worker2 # [ 102.977247] nix-grpc-daemon[1134]: time=2026-09-20T13:35:15.495Z level=INFO msg="Uploading 1 narinfos"5181lb # [ 102.973110] niks3-server[1041]: 2026/09/20 13:35:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5182lb # [ 102.981927] niks3-server[1041]: 2026/09/20 13:35:15 INFO Signed narinfos id=32 count=15183lb # [ 102.987234] niks3-server[1041]: 2026/09/20 13:35:15 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5184lb # [ 102.994864] niks3-server[1041]: 2026/09/20 13:35:15 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5185lb # [ 103.001545] niks3-server[1041]: 2026/09/20 13:35:15 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5186lb # [ 103.006509] niks3-server[1041]: 2026/09/20 13:35:15 INFO Completed upload id=325187worker2 # [ 103.005426] nix-grpc-daemon[1134]: time=2026-09-20T13:35:15.524Z level=INFO msg="Upload complete. (296ms)"5188worker2 # [ 103.016931] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59676 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15189worker2 # [ 103.031182] nix-daemon[847]: reaped child process 1256, status = succeeded5190client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 6.54 seconds)5191client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5192client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds)5193worker1 # [ 103.424889] systemd[1]: Listening on Nix worker-protocol over gRPC.5194worker1 # [ 103.433688] systemd[1]: Starting Nix worker-protocol over gRPC...5195worker1 # [ 103.632504] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:16Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5196worker1 # [ 103.635327] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5197worker1 # [ 103.639572] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:16Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15198worker1 # [ 103.647644] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:16Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5199worker1 # [ 103.656057] systemd[1]: Started Nix worker-protocol over gRPC.5200lb: must succeed: curl -sf localhost:9901/clusters5201worker1 # [ 103.675336] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:16Z level=info event=scheduler_connected addr=lb:500515202worker2 # [ 103.646406] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:16Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:494705203worker2 # [ 103.652650] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:16Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05204lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5205worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5206worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5207lb: must succeed: curl -sf localhost:9901/clusters5208lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5209lb: must succeed: curl -sf localhost:9901/clusters5210lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5211worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5212worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5213(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.77 seconds)5214subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5215client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5216client # [ 104.078730] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5217client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5218worker1 # [ 104.344157] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:482825219worker1 # [ 104.356642] nix-daemon[833]: accepted connection from pid 1266, user nix-grpc-daemon (trusted)5220client # Running as unit: rs.service; invocation ID: b61a7596911c4ea3854ebc97c6b988ef5221client # [ 104.357512] nix[1173]: don't know how to build these paths:5222client # [ 104.359953] nix[1173]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5223worker2 # [ 104.363666] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:16Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05224worker2 # [ 104.369196] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:16Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=15225worker2 # [ 104.407730] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:596765226worker2 # [ 104.423326] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:596765227client # [ 104.445723] nix[1173]: copying 1 paths to 'lb:50051'...5228client # [ 104.451421] nix[1173]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5229worker2 # [ 104.440713] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:596765230worker2 # [ 104.455525] nix-daemon[847]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5231worker2 # [ 104.658633] nix-daemon[847]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)5232worker2 # [ 104.678566] nix-daemon[847]: reaped child process 1292, status = succeeded5233worker2 # [ 104.851884] nix-daemon[847]: accepted connection from pid 1294, user nix-grpc-daemon (trusted)5234worker2 # [ 104.868710] nix-daemon[847]: reaped child process 1297, status = succeeded5235lb # [ 104.883302] niks3-server[1041]: 2026/09/20 13:35:17 INFO Received uploads request method=POST path=/api/pending_closures5236worker2 # [ 104.893699] nix-grpc-daemon[1134]: time=2026-09-20T13:35:17.412Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5237worker2 # [ 104.895197] nix-grpc-daemon[1134]: time=2026-09-20T13:35:17.412Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5238lb # [ 104.911445] niks3-server[1041]: 2026/09/20 13:35:17 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5239worker2 # [ 104.924545] nix-grpc-daemon[1134]: time=2026-09-20T13:35:17.443Z level=INFO msg="Uploading 1 narinfos"5240lb # [ 104.925172] niks3-server[1041]: 2026/09/20 13:35:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5241lb # [ 104.936935] niks3-server[1041]: 2026/09/20 13:35:17 INFO Signed narinfos id=33 count=15242lb # [ 104.945926] niks3-server[1041]: 2026/09/20 13:35:17 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5243worker2 # [ 104.956135] nix-grpc-daemon[1134]: time=2026-09-20T13:35:17.475Z level=INFO msg="Upload complete. (483ms)"5244lb # [ 104.957368] niks3-server[1041]: 2026/09/20 13:35:17 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5245lb # [ 104.962758] niks3-server[1041]: 2026/09/20 13:35:17 INFO Completed upload id=335246worker2 # [ 104.964153] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59676 duration_s=0 paths=1 nar_bytes_in=4165247lb # [ 104.967194] niks3-server[1041]: 2026/09/20 13:35:17 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5248worker2 # [ 104.976266] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:596765249worker2 # [ 104.981855] nix-daemon[847]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5250worker2 # [ 104.986950] nix-daemon[847]: reaped child process 1287, status = succeeded5251client # [ 105.007059] nix[1173]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5252worker2 # [ 104.999533] nix-daemon[847]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)5253lb: must succeed: curl -sf localhost:9901/clusters5254lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5255lb: must succeed: curl -sf localhost:9901/clusters5256lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5257lb: must succeed: curl -sf localhost:9901/clusters5258lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5259lb: must succeed: curl -sf localhost:9901/clusters5260lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5261worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5262worker1 # [ 107.079959] systemd-journald[275]: Received client request to rotate journal, rotating.5263worker1 # [ 107.099585] systemd-journald[275]: Vacuuming done, freed 0B of archived journals from /var/log/journal/3f1a322b8c094eaebc7be95ccf4bc2ba.5264worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds)5265worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service5266worker2 # [ 107.124698] systemd[1]: Stopping Nix worker-protocol over gRPC...5267worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5268??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5269 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735270client: must succeed: sleep 5.05271worker2 # [ 107.559107] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:20Z level=info event=draining5272lb # [ 111.140631] envoy[921]: conn peer=[2001:db8:1::1]:54634 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9580 tx=3821 ms=62505273client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5274worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5275worker2 # [ 112.651914] nix-daemon[847]: reaped child process 1301, status = succeeded5276worker2 # [ 112.820123] nix-daemon[847]: accepted connection from pid 1341, user nix-grpc-daemon (trusted)5277worker2 # [ 112.840166] nix-daemon[847]: reaped child process 1344, status = succeeded5278lb # [ 112.853212] niks3-server[1041]: 2026/09/20 13:35:25 INFO Received uploads request method=POST path=/api/pending_closures5279worker2 # [ 112.863766] nix-grpc-daemon[1134]: time=2026-09-20T13:35:25.382Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5280worker2 # [ 112.869031] nix-grpc-daemon[1134]: time=2026-09-20T13:35:25.384Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5281lb # [ 112.897407] niks3-server[1041]: 2026/09/20 13:35:25 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5282lb # [ 112.910280] niks3-server[1041]: 2026/09/20 13:35:25 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5283lb # [ 112.920283] niks3-server[1041]: 2026/09/20 13:35:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5284worker2 # [ 112.924742] nix-grpc-daemon[1134]: time=2026-09-20T13:35:25.443Z level=INFO msg="Uploading 1 narinfos"5285lb # [ 112.927792] niks3-server[1041]: 2026/09/20 13:35:25 INFO Signed narinfos id=34 count=15286lb # [ 112.933290] niks3-server[1041]: 2026/09/20 13:35:25 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5287lb # [ 112.940639] niks3-server[1041]: 2026/09/20 13:35:25 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5288lb # [ 112.946806] niks3-server[1041]: 2026/09/20 13:35:25 INFO Completed upload id=345289worker2 # [ 112.946122] nix-grpc-daemon[1134]: time=2026-09-20T13:35:25.464Z level=INFO msg="Upload complete. (331ms)"5290lb # [ 112.949586] niks3-server[1041]: 2026/09/20 13:35:25 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5291worker2 # [ 112.961157] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59676 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15292worker2 # [ 112.976470] nix-daemon[847]: reaped child process 1299, status = succeeded5293client # [ 113.011593] systemd[1]: rs.service: Deactivated successfully.5294client # [ 113.016134] systemd[1]: rs.service: Consumed 157ms CPU time over 8.934s wall clock time, 39.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5295worker2 # [ 113.560449] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:26Z level=info event=signal_exit5296worker2 # [ 113.781089] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:26Z level=info event=scheduler_yield5297lb # [ 113.784442] niks3-server[1041]: 2026/09/20 13:35:26 INFO lead: released remote=192.168.1.4:430925298worker1 # [ 113.818177] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:26Z level=info event=scheduler_restarting addr=lb:500515299worker2 # [ 113.796766] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:26Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:494705300worker2 # [ 113.802324] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:26Z level=info event=worker_gone addr=192.168.1.3:500515301worker2 # [ 113.807871] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:26Z level=info event=scheduler_restarting addr=lb:500515302worker2 # [ 113.812001] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:26Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:494705303worker2 # [ 113.816415] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:26Z level=info event=worker_gone addr=192.168.1.4:500515304worker1 # [ 114.018171] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:26Z level=info event=scheduler_connected addr=lb:500515305worker1 # [ 114.023580] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5306worker2 # [ 114.004855] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:26Z level=info event=scheduler_connected addr=lb:500515307worker2 # [ 114.009652] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5308worker1 # [ 114.224159] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:26Z level=info event=scheduler_connected addr=lb:500515309worker1 # [ 114.229242] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5310worker2 # [ 114.210648] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:26Z level=info event=scheduler_connected addr=lb:500515311worker2 # [ 114.215799] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5312worker1 # [ 114.430036] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:26Z level=info event=scheduler_connected addr=lb:500515313worker1 # [ 114.435188] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5314worker2 # [ 114.417293] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:26Z level=info event=scheduler_connected addr=lb:500515315worker2 # [ 114.422675] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5316worker1 # [ 114.636220] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:27Z level=info event=scheduler_connected addr=lb:500515317worker1 # [ 114.641344] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5318worker2 # [ 114.623831] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:27Z level=info event=scheduler_connected addr=lb:500515319worker2 # [ 114.630770] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5320worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.23 seconds)5321client: waiting for success: ! systemctl is-active rs5322worker2 # [ 114.786950] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:27Z level=info event=scheduler_restarting5323client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5324client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5325worker1 # [ 114.844375] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:27Z level=info event=scheduler_connected addr=lb:500515326worker1 # [ 114.848557] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5327worker2 # [ 114.822377] nix-daemon[847]: reaped child process 1127, status = succeeded5328worker2 # [ 114.850535] nix-grpc-daemon[1078]: ts=2026-09-20T13:35:27Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5329client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds)5330client: must fail: journalctl -u rs | grep -q 'reconnecting'5331client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5332lb: must succeed: curl -sf localhost:9901/clusters5333lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5334worker1 # [ 115.045048] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:27Z level=info event=scheduler_connected addr=lb:500515335worker1 # [ 115.050488] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5336worker1 # [ 115.251080] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:27Z level=info event=scheduler_connected addr=lb:500515337worker1 # [ 115.256591] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5338worker1 # [ 115.457512] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:27Z level=info event=scheduler_connected addr=lb:500515339worker1 # [ 115.463027] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5340worker2 # [ 115.630547] nix-grpc-daemon[1078]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5341worker1 # [ 115.663790] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:28Z level=info event=scheduler_connected addr=lb:500515342worker2 # [ 115.635250] nix-grpc-daemon[1078]: E0000 00:00:1789911328.147976 1121 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true5343worker1 # [ 115.669144] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5344worker2 # [ 115.642010] nix-grpc-daemon[1078]: E0000 00:00:1789911328.148275 1121 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5345worker2 # [ 115.832984] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5346worker2 # [ 115.840159] systemd[1]: Stopped Nix worker-protocol over gRPC.5347worker1 # [ 115.871989] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:28Z level=info event=scheduler_connected addr=lb:500515348worker2 # [ 115.842879] systemd[1]: nix-grpc-daemon.service: Consumed 1.988s CPU time over 30.494s wall clock time, 34.2M memory peak, 63.6K incoming IP traffic, 160.1K outgoing IP traffic.5349worker1 # [ 115.876240] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5350worker2 # [ 115.861350] systemd[1]: Starting scheduler-token.service...5351worker2 # [ 115.956634] systemd[1]: scheduler-token.service: Deactivated successfully.5352worker2 # [ 115.959918] systemd[1]: Finished scheduler-token.service.5353worker2 # [ 115.964902] systemd[1]: scheduler-token.service: Consumed 42ms CPU time over 98ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5354worker2 # [ 115.970199] systemd[1]: Starting Nix worker-protocol over gRPC...5355lb: must succeed: curl -sf localhost:9901/clusters5356worker1 # [ 116.072679] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:28Z level=info event=scheduler_connected addr=lb:500515357worker1 # [ 116.078062] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5358lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5359worker2 # [ 116.147773] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:28Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5360worker2 # [ 116.150339] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5361worker2 # [ 116.154374] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15362worker2 # [ 116.162370] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5363worker2 # [ 116.166239] systemd[1]: Started Nix worker-protocol over gRPC.5364worker2 # [ 116.173435] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:28Z level=info event=scheduler_take_over5365lb # [ 116.173760] niks3-server[1041]: 2026/09/20 13:35:28 INFO lead: acquired remote=192.168.1.4:541545366worker2 # [ 116.186037] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:28Z level=info event=scheduler_connected addr=lb:500515367worker2 # [ 116.187925] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5368worker1 # [ 116.278573] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:28Z level=info event=scheduler_connected addr=lb:500515369worker1 # [ 116.283960] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5370worker2 # [ 116.389464] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:28Z level=info event=scheduler_connected addr=lb:500515371worker2 # [ 116.394584] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5372worker1 # [ 116.484806] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:28Z level=info event=scheduler_connected addr=lb:500515373worker1 # [ 116.490125] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5374worker2 # [ 116.595988] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:29Z level=info event=scheduler_connected addr=lb:500515375worker2 # [ 116.601173] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5376worker1 # [ 116.690945] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:29Z level=info event=scheduler_connected addr=lb:500515377worker1 # [ 116.696398] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5378worker2 # [ 116.802167] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:29Z level=info event=scheduler_connected addr=lb:500515379worker2 # [ 116.807390] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5380worker1 # [ 116.898468] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:29Z level=info event=scheduler_connected addr=lb:500515381worker2 # [ 116.871663] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:29Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:501125382worker2 # [ 116.877298] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:29Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05383worker2 # [ 117.008611] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:29Z level=info event=scheduler_connected addr=lb:500515384worker2 # [ 117.022533] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:29Z level=info event=oidc_jwks provider=mock keys=15385worker2 # [ 117.027025] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:29Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:501125386worker2 # [ 117.032407] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:29Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05387lb: must succeed: curl -sf localhost:9901/clusters5388lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5389worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5390worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5391(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.23 seconds)5392subtest: scheduler restart mid-build: build finishes, no double build5393client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5394client # [ 117.304871] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5395client # Running as unit: mid.service; invocation ID: e444874300ba4537bc3a87bc83585b175396client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds)5397worker2 # [ 117.542141] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:501245398worker2 # [ 117.557081] nix-daemon[847]: accepted connection from pid 1354, user nix-grpc-daemon (trusted)5399client # [ 117.585311] nix[1209]: don't know how to build these paths:5400client # [ 117.588430] nix[1209]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5401worker2 # [ 117.588145] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:30Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05402worker2 # [ 117.594126] nix-grpc-daemon[1354]: ts=2026-09-20T13:35:30Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15403worker1 # [ 117.671351] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482825404worker1 # [ 117.689713] nix-grpc-daemon[1266]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 1/5)5405worker1 # [ 117.747222] nix-grpc-daemon[1266]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 111 ms (attempt 2/5)5406worker1 # [ 117.865823] nix-grpc-daemon[1266]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 193 ms (attempt 3/5)5407worker1 # [ 118.067778] nix-grpc-daemon[1266]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 183 ms (attempt 4/5)5408worker1 # [ 118.259109] nix-grpc-daemon[1266]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5409worker1 # [ 118.280595] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482825410client # [ 118.275861] nix[1209]: copying 1 paths to 'lb:50051'...5411worker1 # [ 118.296122] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:482825412client # [ 118.276308] nix[1209]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5413worker1 # [ 118.311698] nix-daemon[833]: accepted connection from pid 1266, user nix-grpc-daemon (trusted)5414worker1 # [ 118.338947] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:30Z level=info event=niks3_push_started pid=13765415worker1 # [ 118.566252] nix-grpc-daemon[1376]: time=2026-09-20T13:35:31.076Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""5416worker1 # [ 118.751242] nix-daemon[833]: accepted connection from pid 1393, user nix-grpc-daemon (trusted)5417worker1 # [ 118.769490] nix-daemon[833]: reaped child process 1396, status = succeeded5418worker1 # [ 118.949671] nix-daemon[833]: accepted connection from pid 1398, user nix-grpc-daemon (trusted)5419worker1 # [ 118.967339] nix-daemon[833]: reaped child process 1401, status = succeeded5420lb # [ 118.950686] niks3-server[1041]: 2026/09/20 13:35:31 INFO Received uploads request method=POST path=/api/pending_closures5421worker1 # [ 118.991579] nix-grpc-daemon[1376]: time=2026-09-20T13:35:31.501Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5422worker1 # [ 118.993381] nix-grpc-daemon[1376]: time=2026-09-20T13:35:31.501Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5423lb # [ 118.989990] niks3-server[1041]: 2026/09/20 13:35:31 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5424worker1 # [ 119.035192] nix-grpc-daemon[1376]: time=2026-09-20T13:35:31.545Z level=INFO msg="Uploading 1 narinfos"5425lb # [ 119.004591] niks3-server[1041]: 2026/09/20 13:35:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5426lb # [ 119.019312] niks3-server[1041]: 2026/09/20 13:35:31 INFO Signed narinfos id=35 count=15427lb # [ 119.025833] niks3-server[1041]: 2026/09/20 13:35:31 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5428lb # [ 119.036720] niks3-server[1041]: 2026/09/20 13:35:31 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5429worker1 # [ 119.075487] nix-grpc-daemon[1376]: time=2026-09-20T13:35:31.586Z level=INFO msg="Upload complete. (504ms)"5430lb # [ 119.047206] niks3-server[1041]: 2026/09/20 13:35:31 INFO Completed upload id=355431worker1 # [ 119.086111] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48282 duration_s=0 paths=1 nar_bytes_in=4245432lb # [ 119.057705] niks3-server[1041]: 2026/09/20 13:35:31 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5433worker1 # [ 119.100093] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482825434worker1 # [ 119.109649] nix-daemon[833]: accepted connection from pid 1266, user nix-grpc-daemon (trusted)5435worker1 # [ 119.112479] nix-daemon[833]: reaped child process 1374, status = succeeded5436client # [ 119.104420] nix[1209]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5437worker1 # [ 119.127521] nix-daemon[833]: accepted connection from pid 1266, user nix-grpc-daemon (trusted)5438lb: must succeed: curl -sf localhost:9901/clusters5439lb # [ 121.145621] envoy[921]: conn peer=[2001:db8:1::1]:55146 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1351 ms=86605440lb # [ 121.145929] envoy[921]: conn peer=[2001:db8:1::4]:34852 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=37774 tx=2179 ms=292725441lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5442lb: must succeed: curl -sf localhost:9901/clusters5443lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5444worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5445worker2 # [ 121.325263] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1354 (nix-grpc-daemon) on client request.5446worker2 # [ 121.342598] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5447lb # [ 121.346067] niks3-server[1041]: 2026/09/20 13:35:33 INFO lead: released remote=192.168.1.4:541545448worker1 # [ 121.388002] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:33Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5449client # [ 121.368970] nix[1209]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5450worker2 # [ 121.378424] nix-daemon[847]: reaped child process 1410, status = succeeded5451worker2 # [ 121.382155] systemd[1]: Starting scheduler-token.service...5452worker2 # [ 121.397280] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5453worker2 # [ 121.399272] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5454worker2 # [ 121.401258] systemd[1]: nix-grpc-daemon.service: Consumed 180ms CPU time over 5.421s wall clock time, 11.6M memory peak, 9.9K incoming IP traffic, 13K outgoing IP traffic.5455worker2 # [ 121.478507] systemd[1]: scheduler-token.service: Deactivated successfully.5456worker2 # [ 121.479680] systemd[1]: Finished scheduler-token.service.5457worker2 # [ 121.482770] systemd[1]: scheduler-token.service: Consumed 30ms CPU time over 95ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5458worker2 # [ 121.485855] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.5459worker2 # [ 121.489175] systemd[1]: Starting scheduler-token.service...5460worker1 # [ 121.588160] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:34Z level=info event=scheduler_connected addr=lb:500515461worker2 # [ 121.567434] systemd[1]: scheduler-token.service: Deactivated successfully.5462worker2 # [ 121.571682] systemd[1]: Finished scheduler-token.service.5463worker2 # [ 121.574201] systemd[1]: scheduler-token.service: Consumed 26ms CPU time over 78ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5464worker2 # [ 121.578122] systemd[1]: Starting Nix worker-protocol over gRPC...5465worker2 # [ 121.745252] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:34Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5466worker2 # [ 121.747904] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:34Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5467worker2 # [ 121.752306] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:34Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15468worker2 # [ 121.760080] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:34Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5469worker2 # [ 121.768614] systemd[1]: Started Nix worker-protocol over gRPC.5470worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.51 seconds)5471lb # [ 121.776629] niks3-server[1041]: 2026/09/20 13:35:34 INFO lead: acquired remote=192.168.1.4:559845472client: must succeed: sleep 5.05473worker2 # [ 121.775715] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:34Z level=info event=scheduler_take_over5474worker1 # [ 121.811825] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5475worker2 # [ 121.789296] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:34Z level=info event=scheduler_connected addr=lb:500515476worker2 # [ 121.796073] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:34Z level=info event=oidc_jwks provider=mock keys=15477worker2 # [ 121.798034] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:34Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:356565478worker2 # [ 121.799743] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:34Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05479worker1 # [ 122.014408] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:34Z level=info event=scheduler_connected addr=lb:500515480worker2 # [ 121.986829] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:34Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:356565481worker2 # [ 121.992148] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:34Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=15482client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5483worker1 # [ 127.157270] nix-daemon[833]: reaped child process 1405, status = succeeded5484client: waiting for success: ! systemctl is-active mid5485worker1 # [ 127.322657] nix-daemon[833]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5486worker1 # [ 127.342559] nix-daemon[833]: reaped child process 1444, status = succeeded5487lb # [ 127.324658] niks3-server[1041]: 2026/09/20 13:35:39 INFO Received uploads request method=POST path=/api/pending_closures5488worker1 # [ 127.367360] nix-grpc-daemon[1376]: time=2026-09-20T13:35:39.875Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5489worker1 # [ 127.369617] nix-grpc-daemon[1376]: time=2026-09-20T13:35:39.875Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5490lb # [ 127.357877] niks3-server[1041]: 2026/09/20 13:35:39 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5491lb # [ 127.380845] niks3-server[1041]: 2026/09/20 13:35:39 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5492lb # [ 127.397929] niks3-server[1041]: 2026/09/20 13:35:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5493worker1 # [ 127.437371] nix-grpc-daemon[1376]: time=2026-09-20T13:35:39.946Z level=INFO msg="Uploading 1 narinfos"5494lb # [ 127.411491] niks3-server[1041]: 2026/09/20 13:35:39 INFO Signed narinfos id=36 count=15495lb # [ 127.428616] niks3-server[1041]: 2026/09/20 13:35:39 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5496worker1 # [ 127.464362] nix-grpc-daemon[1376]: time=2026-09-20T13:35:39.975Z level=INFO msg="Upload complete. (321ms)"5497lb # [ 127.436943] niks3-server[1041]: 2026/09/20 13:35:39 INFO Completed upload id=365498worker1 # [ 127.477186] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48282 duration_s=8 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15499lb # [ 127.462241] niks3-server[1041]: 2026/09/20 13:35:39 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5500worker1 # [ 127.492812] nix-grpc-daemon[1376]: time=2026-09-20T13:35:40.003Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5501worker1 # [ 127.501792] nix-daemon[833]: reaped child process 1403, status = succeeded5502client # [ 127.500391] systemd[1]: mid.service: Deactivated successfully.5503client # [ 127.505573] systemd[1]: mid.service: Consumed 164ms CPU time over 10.196s wall clock time, 37.2M memory peak, 8.8K incoming IP traffic, 9.2K outgoing IP traffic.5504client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5505client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5506client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5507(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 11.12 seconds)5508subtest: interrupting the client stops the build on the worker5509client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5510client # [ 128.397116] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5511client # Running as unit: intr.service; invocation ID: 6b9edaf5d3a947a88052b39b3c190a5e5512client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5513client # [ 128.620994] nix[1245]: don't know how to build these paths:5514client # [ 128.622061] nix[1245]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5515worker1 # [ 128.641329] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:482825516worker2 # [ 128.627981] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:41Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05517worker2 # [ 128.633475] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:41Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15518worker2 # [ 128.675973] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:356845519worker2 # [ 128.690842] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5520worker2 # [ 128.715380] nix-grpc-daemon[1444]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 70 ms (attempt 1/5)5521worker2 # [ 128.791503] nix-grpc-daemon[1444]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 2/5)5522worker2 # [ 128.839268] nix-grpc-daemon[1444]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 182 ms (attempt 3/5)5523worker2 # [ 129.021903] nix-grpc-daemon[1444]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 4/5)5524worker2 # [ 129.162803] nix-grpc-daemon[1444]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5525worker2 # [ 129.183108] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:356845526client # [ 129.208143] nix[1245]: copying 1 paths to 'lb:50051'...5527worker2 # [ 129.198536] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:356845528client # [ 129.210681] nix[1245]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5529worker2 # [ 129.215440] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5530worker2 # [ 129.243256] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:41Z level=info event=niks3_push_started pid=15145531worker2 # [ 129.459756] nix-grpc-daemon[1514]: time=2026-09-20T13:35:41.977Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""5532worker2 # [ 129.637044] nix-daemon[847]: accepted connection from pid 1527, user nix-grpc-daemon (trusted)5533worker2 # [ 129.655827] nix-daemon[847]: reaped child process 1530, status = succeeded5534worker2 # [ 129.845514] nix-daemon[847]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)5535worker2 # [ 129.862853] nix-daemon[847]: reaped child process 1539, status = succeeded5536lb # [ 129.877241] niks3-server[1041]: 2026/09/20 13:35:42 INFO Received uploads request method=POST path=/api/pending_closures5537worker2 # [ 129.891170] nix-grpc-daemon[1514]: time=2026-09-20T13:35:42.410Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5538worker2 # [ 129.894706] nix-grpc-daemon[1514]: time=2026-09-20T13:35:42.411Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5539lb # [ 129.919924] niks3-server[1041]: 2026/09/20 13:35:42 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5540lb # [ 129.932981] niks3-server[1041]: 2026/09/20 13:35:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5541worker2 # [ 129.940282] nix-grpc-daemon[1514]: time=2026-09-20T13:35:42.458Z level=INFO msg="Uploading 1 narinfos"5542lb # [ 129.943849] niks3-server[1041]: 2026/09/20 13:35:42 INFO Signed narinfos id=37 count=15543lb # [ 129.964207] niks3-server[1041]: 2026/09/20 13:35:42 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5544lb # [ 129.980307] niks3-server[1041]: 2026/09/20 13:35:42 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5545lb # [ 129.987604] niks3-server[1041]: 2026/09/20 13:35:42 INFO Completed upload id=375546worker2 # [ 129.987060] nix-grpc-daemon[1514]: time=2026-09-20T13:35:42.505Z level=INFO msg="Upload complete. (523ms)"5547lb # [ 129.990798] niks3-server[1041]: 2026/09/20 13:35:42 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5548worker2 # [ 130.000607] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35684 duration_s=0 paths=1 nar_bytes_in=4245549worker2 # [ 130.016315] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:356845550worker2 # [ 130.025864] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5551worker2 # [ 130.031618] nix-daemon[847]: reaped child process 1512, status = succeeded5552client # [ 130.054977] nix[1245]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5553worker2 # [ 130.048105] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5554client: must succeed: systemctl kill -s INT intr5555client # [ 130.939048] systemd[1]: intr.service: Sent signal SIGINT to main process 1245 (nix) on client request.5556worker2 # [ 130.938914] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:43Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5557client # [ 130.947748] nix[1245]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5558client # [ 130.951441] nix[1245]: error: interrupted by the user5559client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5560client # [ 130.985445] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5561client # [ 130.987640] systemd[1]: intr.service: Failed with result 'exit-code'.5562client # [ 130.990809] systemd[1]: intr.service: Consumed 137ms CPU time over 2.592s wall clock time, 39.2M memory peak, 7.9K incoming IP traffic, 8.7K outgoing IP traffic.5563worker2 # [ 131.085969] nix-daemon[847]: reaped child process 1541, status = succeeded5564worker2 # [ 131.092542] nix-daemon[1543]: unexpected Nix daemon error: error: interrupted by the user5565worker2 # [ 131.108112] nix-daemon[847]: reaped child process 1543, status = failed with exit code 15566(finished: subtest: interrupting the client stops the build on the worker, in 2.77 seconds)5567subtest: a deploy mid-build drains: the build finishes, the new generation takes over5568client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5569lb # [ 131.143998] envoy[921]: conn peer=[2001:db8:1::4]:35634 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4102 tx=385 ms=51825570lb # [ 131.144515] envoy[921]: conn peer=[2001:db8:1::1]:37090 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3022 tx=1422 ms=99255571lb # [ 131.144627] envoy[921]: conn peer=[2001:db8:1::1]:47710 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=756 ms=23515572client # [ 131.195955] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5573client # Running as unit: sw.service; invocation ID: 9d899b44bfa745a797dbe685fed609075574client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.10 seconds)5575client # [ 131.438617] nix[1265]: don't know how to build these paths:5576client # [ 131.440507] nix[1265]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5577worker2 # [ 131.427625] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:356845578worker2 # [ 131.442457] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:43Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05579worker2 # [ 131.448827] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:43Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15580worker1 # [ 131.519942] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482825581worker1 # [ 131.534857] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482825582client # [ 131.528251] nix[1265]: copying 1 paths to 'lb:50051'...5583client # [ 131.533602] nix[1265]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5584worker1 # [ 131.553667] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:482825585worker1 # [ 131.569753] nix-daemon[833]: accepted connection from pid 1266, user nix-grpc-daemon (trusted)5586worker1 # [ 131.778593] nix-daemon[833]: accepted connection from pid 1468, user nix-grpc-daemon (trusted)5587worker1 # [ 131.799286] nix-daemon[833]: reaped child process 1471, status = succeeded5588worker1 # [ 131.977558] nix-daemon[833]: accepted connection from pid 1473, user nix-grpc-daemon (trusted)5589worker1 # [ 131.995786] nix-daemon[833]: reaped child process 1476, status = succeeded5590lb # [ 131.978009] niks3-server[1041]: 2026/09/20 13:35:44 INFO Received uploads request method=POST path=/api/pending_closures5591worker1 # [ 132.020262] nix-grpc-daemon[1376]: time=2026-09-20T13:35:44.530Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5592worker1 # [ 132.021765] nix-grpc-daemon[1376]: time=2026-09-20T13:35:44.530Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5593lb # [ 132.013844] niks3-server[1041]: 2026/09/20 13:35:44 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5594lb # [ 132.027051] niks3-server[1041]: 2026/09/20 13:35:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5595worker1 # [ 132.064044] nix-grpc-daemon[1376]: time=2026-09-20T13:35:44.574Z level=INFO msg="Uploading 1 narinfos"5596lb # [ 132.038944] niks3-server[1041]: 2026/09/20 13:35:44 INFO Signed narinfos id=38 count=15597lb # [ 132.046205] niks3-server[1041]: 2026/09/20 13:35:44 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5598worker1 # [ 132.086484] nix-grpc-daemon[1376]: time=2026-09-20T13:35:44.597Z level=INFO msg="Upload complete. (499ms)"5599lb # [ 132.058225] niks3-server[1041]: 2026/09/20 13:35:44 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5600lb # [ 132.063693] niks3-server[1041]: 2026/09/20 13:35:44 INFO Completed upload id=385601lb # [ 132.067229] niks3-server[1041]: 2026/09/20 13:35:44 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5602worker1 # [ 132.096278] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48282 duration_s=0 paths=1 nar_bytes_in=4165603worker1 # [ 132.111808] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482825604worker1 # [ 132.119104] nix-daemon[833]: accepted connection from pid 1266, user nix-grpc-daemon (trusted)5605worker1 # [ 132.125513] nix-daemon[833]: reaped child process 1466, status = succeeded5606client # [ 132.116101] nix[1265]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5607worker1 # [ 132.138077] nix-daemon[833]: accepted connection from pid 1266, user nix-grpc-daemon (trusted)5608worker1: must succeed: systemctl reload nix-grpc-daemon.service5609worker1 # [ 133.936774] systemd[1]: Reloading Nix worker-protocol over gRPC...5610worker1 # [ 133.986521] systemd[1]: Reloaded Nix worker-protocol over gRPC.5611worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.10 seconds)5612worker1: must succeed: pgrep -f 'read -t [9]0 x'5613worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5614client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25615worker2 # [ 134.265099] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:356845616client # don't know how to build these paths:5617client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5618worker1 # [ 134.307720] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482825619worker2 # [ 134.301363] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:46Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05620worker2 # [ 134.308574] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:46Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15621worker2 # [ 134.352284] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:356845622worker2 # [ 134.367130] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:356845623client # copying 1 paths to 'lb:50051'...5624worker2 # [ 134.383218] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:356845625client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5626worker2 # [ 134.406972] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5627worker2 # [ 134.614698] nix-daemon[847]: accepted connection from pid 1589, user nix-grpc-daemon (trusted)5628worker1 # [ 134.662324] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:47Z level=info event=draining5629worker2 # [ 134.634326] nix-daemon[847]: reaped child process 1592, status = succeeded5630worker2 # [ 134.812897] nix-daemon[847]: accepted connection from pid 1594, user nix-grpc-daemon (trusted)5631worker2 # [ 134.829559] nix-daemon[847]: reaped child process 1597, status = succeeded5632lb # [ 134.845284] niks3-server[1041]: 2026/09/20 13:35:47 INFO Received uploads request method=POST path=/api/pending_closures5633worker2 # [ 134.855509] nix-grpc-daemon[1514]: time=2026-09-20T13:35:47.373Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5634worker2 # [ 134.857196] nix-grpc-daemon[1514]: time=2026-09-20T13:35:47.373Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5635lb # [ 134.875073] niks3-server[1041]: 2026/09/20 13:35:47 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5636lb # [ 134.894449] niks3-server[1041]: 2026/09/20 13:35:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5637worker2 # [ 134.899556] nix-grpc-daemon[1514]: time=2026-09-20T13:35:47.418Z level=INFO msg="Uploading 1 narinfos"5638lb # [ 134.905383] niks3-server[1041]: 2026/09/20 13:35:47 INFO Signed narinfos id=39 count=15639lb # [ 134.907856] niks3-server[1041]: 2026/09/20 13:35:47 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5640lb # [ 134.918643] niks3-server[1041]: 2026/09/20 13:35:47 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5641lb # [ 134.924880] niks3-server[1041]: 2026/09/20 13:35:47 INFO Completed upload id=395642worker2 # [ 134.923529] nix-grpc-daemon[1514]: time=2026-09-20T13:35:47.442Z level=INFO msg="Upload complete. (498ms)"5643lb # [ 134.927277] niks3-server[1041]: 2026/09/20 13:35:47 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5644worker2 # [ 134.932395] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35684 duration_s=0 paths=1 nar_bytes_in=5285645worker2 # [ 134.947400] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:356845646worker2 # [ 134.954156] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5647worker2 # [ 134.959280] nix-daemon[847]: reaped child process 1587, status = succeeded5648client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5649client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5650worker2 # [ 134.971079] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5651client # farm-a> LOG-farm-a-during-drain5652worker2 # [ 136.621265] nix-daemon[847]: reaped child process 1601, status = succeeded5653worker2 # [ 136.800119] nix-daemon[847]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5654worker2 # [ 136.816346] nix-daemon[847]: reaped child process 1619, status = succeeded5655lb # [ 136.831987] niks3-server[1041]: 2026/09/20 13:35:49 INFO Received uploads request method=POST path=/api/pending_closures5656worker2 # [ 136.843822] nix-grpc-daemon[1514]: time=2026-09-20T13:35:49.359Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5657worker2 # [ 136.846555] nix-grpc-daemon[1514]: time=2026-09-20T13:35:49.359Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5658lb # [ 136.860863] niks3-server[1041]: 2026/09/20 13:35:49 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5659lb # [ 136.880384] niks3-server[1041]: 2026/09/20 13:35:49 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5660lb # [ 136.897424] niks3-server[1041]: 2026/09/20 13:35:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5661worker2 # [ 136.903709] nix-grpc-daemon[1514]: time=2026-09-20T13:35:49.422Z level=INFO msg="Uploading 1 narinfos"5662lb # [ 136.908295] niks3-server[1041]: 2026/09/20 13:35:49 INFO Signed narinfos id=40 count=15663lb # [ 136.923961] niks3-server[1041]: 2026/09/20 13:35:49 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5664lb # [ 136.934475] niks3-server[1041]: 2026/09/20 13:35:49 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5665lb # [ 136.941345] niks3-server[1041]: 2026/09/20 13:35:49 INFO Completed upload id=405666worker2 # [ 136.939568] nix-grpc-daemon[1514]: time=2026-09-20T13:35:49.458Z level=INFO msg="Upload complete. (354ms)"5667lb # [ 136.944111] niks3-server[1041]: 2026/09/20 13:35:49 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5668worker2 # [ 136.958434] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35684 duration_s=2 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=3 outputs=15669worker2 # [ 136.975444] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:49Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05670worker2 # [ 136.980299] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:49Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15671worker2 # [ 136.984714] nix-daemon[847]: reaped child process 1599, status = succeeded5672worker2 # [ 137.009117] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:356845673worker2 # [ 137.023926] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:356845674worker2 # [ 137.039341] nix-grpc-daemon[1514]: time=2026-09-20T13:35:49.558Z level=INFO msg="All 1 paths already cached"5675client # copying 1 paths to 'lb:50051'...5676worker2 # [ 137.049291] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:356845677client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5678worker2 # [ 137.072294] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5679worker2 # [ 137.276162] nix-daemon[847]: accepted connection from pid 1625, user nix-grpc-daemon (trusted)5680worker2 # [ 137.293269] nix-daemon[847]: reaped child process 1628, status = succeeded5681worker2 # [ 137.470242] nix-daemon[847]: accepted connection from pid 1630, user nix-grpc-daemon (trusted)5682worker2 # [ 137.488146] nix-daemon[847]: reaped child process 1633, status = succeeded5683lb # [ 137.500718] niks3-server[1041]: 2026/09/20 13:35:50 INFO Received uploads request method=POST path=/api/pending_closures5684worker2 # [ 137.513117] nix-grpc-daemon[1514]: time=2026-09-20T13:35:50.031Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5685worker2 # [ 137.514637] nix-grpc-daemon[1514]: time=2026-09-20T13:35:50.031Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5686lb # [ 137.537029] niks3-server[1041]: 2026/09/20 13:35:50 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5687lb # [ 137.547051] niks3-server[1041]: 2026/09/20 13:35:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5688worker2 # [ 137.553161] nix-grpc-daemon[1514]: time=2026-09-20T13:35:50.071Z level=INFO msg="Uploading 1 narinfos"5689lb # [ 137.557365] niks3-server[1041]: 2026/09/20 13:35:50 INFO Signed narinfos id=41 count=15690lb # [ 137.564304] niks3-server[1041]: 2026/09/20 13:35:50 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5691lb # [ 137.577879] niks3-server[1041]: 2026/09/20 13:35:50 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5692lb # [ 137.583466] niks3-server[1041]: 2026/09/20 13:35:50 INFO Completed upload id=415693worker2 # [ 137.582088] nix-grpc-daemon[1514]: time=2026-09-20T13:35:50.100Z level=INFO msg="Upload complete. (491ms)"5694lb # [ 137.586092] niks3-server[1041]: 2026/09/20 13:35:50 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5695worker2 # [ 137.592250] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35684 duration_s=0 paths=1 nar_bytes_in=6405696worker2 # [ 137.604336] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:356845697worker2 # [ 137.611806] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5698worker2 # [ 137.617180] nix-daemon[847]: reaped child process 1623, status = succeeded5699client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5700worker2 # [ 137.629411] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5701client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5702client # farm-b> LOG-farm-b-during-drain5703worker2 # [ 139.065396] nix-daemon[847]: reaped child process 1637, status = succeeded5704worker2 # [ 139.243566] nix-daemon[847]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)5705worker2 # [ 139.262991] nix-daemon[847]: reaped child process 1655, status = succeeded5706lb # [ 139.277922] niks3-server[1041]: 2026/09/20 13:35:51 INFO Received uploads request method=POST path=/api/pending_closures5707worker2 # [ 139.285833] nix-grpc-daemon[1514]: time=2026-09-20T13:35:51.803Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5708worker2 # [ 139.287466] nix-grpc-daemon[1514]: time=2026-09-20T13:35:51.803Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5709lb # [ 139.311990] niks3-server[1041]: 2026/09/20 13:35:51 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5710worker2 # [ 139.326301] nix-grpc-daemon[1514]: time=2026-09-20T13:35:51.844Z level=INFO msg="Uploading 1 narinfos"5711lb # [ 139.326821] niks3-server[1041]: 2026/09/20 13:35:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5712lb # [ 139.335512] niks3-server[1041]: 2026/09/20 13:35:51 INFO Signed narinfos id=42 count=15713lb # [ 139.344062] niks3-server[1041]: 2026/09/20 13:35:51 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5714lb # [ 139.356767] niks3-server[1041]: 2026/09/20 13:35:51 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5715worker2 # [ 139.360585] nix-grpc-daemon[1514]: time=2026-09-20T13:35:51.879Z level=INFO msg="Upload complete. (318ms)"5716lb # [ 139.361968] niks3-server[1041]: 2026/09/20 13:35:51 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5717lb # [ 139.368115] niks3-server[1041]: 2026/09/20 13:35:51 INFO Completed upload id=425718lb # [ 139.371088] niks3-server[1041]: 2026/09/20 13:35:51 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5719worker2 # [ 139.373248] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35684 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=4 outputs=15720worker2 # [ 139.391157] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:51Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05721worker2 # [ 139.395151] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:51Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15722worker2 # [ 139.399224] nix-daemon[847]: reaped child process 1635, status = succeeded5723worker2 # [ 139.431898] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:356845724worker2 # [ 139.447506] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:356845725worker2 # [ 139.462449] nix-grpc-daemon[1514]: time=2026-09-20T13:35:51.981Z level=INFO msg="All 2 paths already cached"5726client # copying 1 paths to 'lb:50051'...5727worker2 # [ 139.472928] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:356845728client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5729worker2 # [ 139.496869] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5730worker2 # [ 139.698268] nix-daemon[847]: accepted connection from pid 1661, user nix-grpc-daemon (trusted)5731worker2 # [ 139.717184] nix-daemon[847]: reaped child process 1664, status = succeeded5732worker2 # [ 139.892839] nix-daemon[847]: accepted connection from pid 1666, user nix-grpc-daemon (trusted)5733worker2 # [ 139.912170] nix-daemon[847]: reaped child process 1669, status = succeeded5734lb # [ 139.923817] niks3-server[1041]: 2026/09/20 13:35:52 INFO Received uploads request method=POST path=/api/pending_closures5735worker2 # [ 139.934527] nix-grpc-daemon[1514]: time=2026-09-20T13:35:52.453Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5736worker2 # [ 139.936211] nix-grpc-daemon[1514]: time=2026-09-20T13:35:52.453Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5737lb # [ 139.955975] niks3-server[1041]: 2026/09/20 13:35:52 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5738worker2 # [ 139.968414] nix-grpc-daemon[1514]: time=2026-09-20T13:35:52.487Z level=INFO msg="Uploading 1 narinfos"5739lb # [ 139.970685] niks3-server[1041]: 2026/09/20 13:35:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5740lb # [ 139.982984] niks3-server[1041]: 2026/09/20 13:35:52 INFO Signed narinfos id=43 count=15741lb # [ 139.988236] niks3-server[1041]: 2026/09/20 13:35:52 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5742worker2 # [ 139.994954] nix-grpc-daemon[1514]: time=2026-09-20T13:35:52.513Z level=INFO msg="Upload complete. (480ms)"5743lb # [ 139.996284] niks3-server[1041]: 2026/09/20 13:35:52 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5744lb # [ 140.000890] niks3-server[1041]: 2026/09/20 13:35:52 INFO Completed upload id=435745lb # [ 140.004594] niks3-server[1041]: 2026/09/20 13:35:52 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5746worker2 # [ 140.004251] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35684 duration_s=0 paths=1 nar_bytes_in=7685747worker2 # [ 140.015125] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:356845748worker2 # [ 140.021700] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5749worker2 # [ 140.026549] nix-daemon[847]: reaped child process 1659, status = succeeded5750client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5751client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5752worker2 # [ 140.039377] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5753client # farm-top> LOG-farm-top-during-drain5754worker2 # [ 141.685251] nix-daemon[847]: reaped child process 1673, status = succeeded5755worker2 # [ 141.865682] nix-daemon[847]: accepted connection from pid 1688, user nix-grpc-daemon (trusted)5756worker2 # [ 141.883123] nix-daemon[847]: reaped child process 1691, status = succeeded5757lb # [ 141.899211] niks3-server[1041]: 2026/09/20 13:35:54 INFO Received uploads request method=POST path=/api/pending_closures5758worker2 # [ 141.907723] nix-grpc-daemon[1514]: time=2026-09-20T13:35:54.424Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5759worker2 # [ 141.909526] nix-grpc-daemon[1514]: time=2026-09-20T13:35:54.424Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5760lb # [ 141.940389] niks3-server[1041]: 2026/09/20 13:35:54 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5761lb # [ 141.952250] niks3-server[1041]: 2026/09/20 13:35:54 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5762worker2 # [ 141.961168] nix-grpc-daemon[1514]: time=2026-09-20T13:35:54.479Z level=INFO msg="Uploading 1 narinfos"5763lb # [ 141.963938] niks3-server[1041]: 2026/09/20 13:35:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5764lb # [ 141.967213] niks3-server[1041]: 2026/09/20 13:35:54 INFO Signed narinfos id=44 count=15765lb # [ 141.974608] niks3-server[1041]: 2026/09/20 13:35:54 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5766worker2 # [ 141.979828] nix-grpc-daemon[1514]: time=2026-09-20T13:35:54.498Z level=INFO msg="Upload complete. (329ms)"5767lb # [ 141.982266] niks3-server[1041]: 2026/09/20 13:35:54 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5768lb # [ 141.985710] niks3-server[1041]: 2026/09/20 13:35:54 INFO Completed upload id=445769lb # [ 141.988626] niks3-server[1041]: 2026/09/20 13:35:54 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5770worker2 # [ 141.992910] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35684 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=5 outputs=15771worker2 # [ 142.008793] nix-daemon[847]: reaped child process 1671, status = succeeded5772client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 8.03 seconds)5773client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5774client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds)5775worker1: must succeed: pkill -f 'read -t [9]0 x'5776worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5777client: waiting for success: ! systemctl is-active sw5778worker1 # [ 142.590465] nix-daemon[833]: reaped child process 1480, status = succeeded5779worker1 # [ 142.783179] nix-daemon[833]: accepted connection from pid 1521, user nix-grpc-daemon (trusted)5780worker1 # [ 142.803283] nix-daemon[833]: reaped child process 1524, status = succeeded5781lb # [ 142.785418] niks3-server[1041]: 2026/09/20 13:35:55 INFO Received uploads request method=POST path=/api/pending_closures5782worker1 # [ 142.826233] nix-grpc-daemon[1376]: time=2026-09-20T13:35:55.336Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5783worker1 # [ 142.827765] nix-grpc-daemon[1376]: time=2026-09-20T13:35:55.336Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5784lb # [ 142.818615] niks3-server[1041]: 2026/09/20 13:35:55 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5785lb # [ 142.832111] niks3-server[1041]: 2026/09/20 13:35:55 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5786lb # [ 142.842303] niks3-server[1041]: 2026/09/20 13:35:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5787lb # [ 142.848240] niks3-server[1041]: 2026/09/20 13:35:55 INFO Signed narinfos id=45 count=15788worker1 # [ 142.878216] nix-grpc-daemon[1376]: time=2026-09-20T13:35:55.388Z level=INFO msg="Uploading 1 narinfos"5789lb # [ 142.853278] niks3-server[1041]: 2026/09/20 13:35:55 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5790lb # [ 142.864979] niks3-server[1041]: 2026/09/20 13:35:55 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5791worker1 # [ 142.900389] nix-grpc-daemon[1376]: time=2026-09-20T13:35:55.411Z level=INFO msg="Upload complete. (340ms)"5792lb # [ 142.870839] niks3-server[1041]: 2026/09/20 13:35:55 INFO Completed upload id=455793lb # [ 142.874233] niks3-server[1041]: 2026/09/20 13:35:55 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5794worker1 # [ 142.912971] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48282 duration_s=10 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=2 outputs=15795worker1 # [ 142.928294] nix-daemon[833]: reaped child process 1478, status = succeeded5796client # [ 142.935140] systemd[1]: sw.service: Deactivated successfully.5797client # [ 142.940160] systemd[1]: sw.service: Consumed 159ms CPU time over 11.742s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5798client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5799client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5800client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds)5801worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5802worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.07 seconds)5803lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5804lb: must succeed: curl -sf localhost:9901/clusters5805worker1 # [ 143.665187] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:56Z level=info event=signal_exit5806lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5807lb: must succeed: curl -sf localhost:9901/clusters5808lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5809worker2 # [ 144.874511] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:57Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:356565810worker1 # [ 144.907177] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:57Z level=info event=scheduler_restarting5811worker2 # [ 144.879332] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:57Z level=info event=worker_gone addr=192.168.1.3:500515812worker1 # [ 144.926668] nix-grpc-daemon[1266]: ts=2026-09-20T13:35:57Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5813worker1 # [ 144.952813] nix-daemon[833]: reaped child process 1322, status = succeeded5814worker1 # [ 145.273457] nix-grpc-daemon[1266]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5815worker1 # [ 145.278048] nix-grpc-daemon[1266]: E0000 00:00:1789911357.784327 1309 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5816worker1 # [ 145.284503] nix-grpc-daemon[1266]: E0000 00:00:1789911357.784560 1309 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5817lb: must succeed: curl -sf localhost:9901/clusters5818lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5819worker1 # [ 146.110862] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5820worker1 # [ 146.114064] systemd[1]: nix-grpc-daemon.service: Consumed 1.136s CPU time over 42.675s wall clock time, 31.4M memory peak, 28.3K incoming IP traffic, 41.2K outgoing IP traffic.5821lb: must succeed: curl -sf localhost:9901/clusters5822lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5823worker1 # [ 147.100299] systemd[1]: Starting Nix worker-protocol over gRPC...5824worker1 # [ 147.315207] nix-grpc-daemon[1536]: ts=2026-09-20T13:35:59Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5825worker1 # [ 147.317804] nix-grpc-daemon[1536]: ts=2026-09-20T13:35:59Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5826worker1 # [ 147.321896] nix-grpc-daemon[1536]: ts=2026-09-20T13:35:59Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15827worker1 # [ 147.329917] nix-grpc-daemon[1536]: ts=2026-09-20T13:35:59Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5828worker1 # [ 147.331899] systemd[1]: Started Nix worker-protocol over gRPC.5829worker1 # [ 147.356833] nix-grpc-daemon[1536]: ts=2026-09-20T13:35:59Z level=info event=scheduler_connected addr=lb:500515830worker2 # [ 147.329490] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:59Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:356565831worker2 # [ 147.329824] nix-grpc-daemon[1444]: ts=2026-09-20T13:35:59Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05832lb: must succeed: curl -sf localhost:9901/clusters5833lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5834lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 4.41 seconds)5835lb: must succeed: curl -sf localhost:9901/clusters5836lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5837worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5838worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5839(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 17.01 seconds)5840subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5841client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15842worker2 # [ 148.368907] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:356845843worker2 # [ 148.376581] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:356845844worker2 # [ 148.422647] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:00Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05845worker2 # [ 148.428766] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:00Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15846worker2 # [ 148.434689] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:00Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05847worker2 # [ 148.439885] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:00Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05848worker1 # [ 148.506126] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504705849worker1 # [ 148.519661] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)5850worker1 # [ 148.544564] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5)5851worker1 # [ 148.588391] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 2/5)5852worker1 # [ 148.643744] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 262 ms (attempt 3/5)5853worker1 # [ 148.913432] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 4/5)5854worker1 # [ 148.935118] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5855worker1 # [ 148.955420] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504705856worker1 # [ 148.971306] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504705857worker1 # [ 148.986177] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)5858worker1 # [ 149.013230] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:01Z level=info event=niks3_push_started pid=15925859worker1 # [ 149.230279] nix-grpc-daemon[1592]: time=2026-09-20T13:36:01.740Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""5860worker1 # [ 149.411515] nix-daemon[833]: accepted connection from pid 1605, user nix-grpc-daemon (trusted)5861worker1 # [ 149.428434] nix-daemon[833]: reaped child process 1608, status = succeeded5862worker1 # [ 149.607850] nix-daemon[833]: accepted connection from pid 1610, user nix-grpc-daemon (trusted)5863worker1 # [ 149.624174] nix-daemon[833]: reaped child process 1613, status = succeeded5864lb # [ 149.609757] niks3-server[1041]: 2026/09/20 13:36:02 INFO Received uploads request method=POST path=/api/pending_closures5865worker1 # [ 149.650772] nix-grpc-daemon[1592]: time=2026-09-20T13:36:02.160Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5866worker1 # [ 149.652561] nix-grpc-daemon[1592]: time=2026-09-20T13:36:02.160Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5867lb # [ 149.645098] niks3-server[1041]: 2026/09/20 13:36:02 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5868worker1 # [ 149.691460] nix-grpc-daemon[1592]: time=2026-09-20T13:36:02.202Z level=INFO msg="Uploading 1 narinfos"5869lb # [ 149.660920] niks3-server[1041]: 2026/09/20 13:36:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5870lb # [ 149.671253] niks3-server[1041]: 2026/09/20 13:36:02 INFO Signed narinfos id=46 count=15871lb # [ 149.678689] niks3-server[1041]: 2026/09/20 13:36:02 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5872lb # [ 149.687641] niks3-server[1041]: 2026/09/20 13:36:02 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5873worker1 # [ 149.723873] nix-grpc-daemon[1592]: time=2026-09-20T13:36:02.234Z level=INFO msg="Upload complete. (489ms)"5874lb # [ 149.695987] niks3-server[1041]: 2026/09/20 13:36:02 INFO Completed upload id=465875lb # [ 149.700279] niks3-server[1041]: 2026/09/20 13:36:02 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5876worker1 # [ 149.732884] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=0 paths=1 nar_bytes_in=5125877worker1 # [ 149.747646] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504705878worker1 # [ 149.753729] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)5879worker1 # [ 149.758867] nix-daemon[833]: reaped child process 1590, status = succeeded5880worker1 # [ 149.770212] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)5881worker1 # [ 150.996271] nix-daemon[833]: reaped child process 1617, status = succeeded5882worker1 # [ 151.158992] nix-daemon[833]: accepted connection from pid 1632, user nix-grpc-daemon (trusted)5883worker1 # [ 151.176979] nix-daemon[833]: reaped child process 1635, status = succeeded5884lb # [ 151.143671] envoy[921]: conn peer=[2001:db8:1::1]:40254 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9681 tx=3880 ms=77455885lb # [ 151.148839] envoy[921]: conn peer=[2001:db8:1::1]:40244 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=1347 ms=114725886lb # [ 151.154378] envoy[921]: conn peer=[2001:db8:1::3]:53620 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3308 tx=1009 ms=412445887worker1 # [ 151.196478] nix-grpc-daemon[1592]: time=2026-09-20T13:36:03.706Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5888worker1 # [ 151.197966] nix-grpc-daemon[1592]: time=2026-09-20T13:36:03.706Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5889lb # [ 151.165744] niks3-server[1041]: 2026/09/20 13:36:03 INFO Received uploads request method=POST path=/api/pending_closures5890lb # [ 151.196451] niks3-server[1041]: 2026/09/20 13:36:03 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5891lb # [ 151.209353] niks3-server[1041]: 2026/09/20 13:36:03 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5892lb # [ 151.217014] niks3-server[1041]: 2026/09/20 13:36:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5893worker1 # [ 151.253247] nix-grpc-daemon[1592]: time=2026-09-20T13:36:03.763Z level=INFO msg="Uploading 1 narinfos"5894lb # [ 151.222401] niks3-server[1041]: 2026/09/20 13:36:03 INFO Signed narinfos id=47 count=15895lb # [ 151.226403] niks3-server[1041]: 2026/09/20 13:36:03 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5896lb # [ 151.238378] niks3-server[1041]: 2026/09/20 13:36:03 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5897lb # [ 151.244453] niks3-server[1041]: 2026/09/20 13:36:03 INFO Completed upload id=475898worker1 # [ 151.273834] nix-grpc-daemon[1592]: time=2026-09-20T13:36:03.784Z level=INFO msg="Upload complete. (291ms)"5899lb # [ 151.247237] niks3-server[1041]: 2026/09/20 13:36:03 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5900worker1 # [ 151.285589] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=6 outputs=15901worker2 # [ 151.257280] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:03Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15902worker2 # [ 151.264913] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:03Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05903worker1 # [ 151.299523] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504705904worker1 # [ 151.304629] nix-daemon[833]: reaped child process 1615, status = succeeded5905worker1 # [ 151.311326] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504705906worker1 # [ 151.322840] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504705907worker1 # [ 151.333585] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)5908worker1 # [ 151.523596] nix-daemon[833]: accepted connection from pid 1639, user nix-grpc-daemon (trusted)5909worker1 # [ 151.539908] nix-daemon[833]: reaped child process 1642, status = succeeded5910worker1 # [ 151.717385] nix-daemon[833]: accepted connection from pid 1644, user nix-grpc-daemon (trusted)5911worker1 # [ 151.734426] nix-daemon[833]: reaped child process 1647, status = succeeded5912lb # [ 151.715418] niks3-server[1041]: 2026/09/20 13:36:04 INFO Received uploads request method=POST path=/api/pending_closures5913worker1 # [ 151.755197] nix-grpc-daemon[1592]: time=2026-09-20T13:36:04.265Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5914worker1 # [ 151.756842] nix-grpc-daemon[1592]: time=2026-09-20T13:36:04.266Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5915lb # [ 151.742211] niks3-server[1041]: 2026/09/20 13:36:04 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5916worker1 # [ 151.785141] nix-grpc-daemon[1592]: time=2026-09-20T13:36:04.296Z level=INFO msg="Uploading 1 narinfos"5917lb # [ 151.759449] niks3-server[1041]: 2026/09/20 13:36:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5918lb # [ 151.769393] niks3-server[1041]: 2026/09/20 13:36:04 INFO Signed narinfos id=48 count=15919lb # [ 151.774543] niks3-server[1041]: 2026/09/20 13:36:04 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5920lb # [ 151.783275] niks3-server[1041]: 2026/09/20 13:36:04 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5921worker1 # [ 151.817199] nix-grpc-daemon[1592]: time=2026-09-20T13:36:04.328Z level=INFO msg="Upload complete. (472ms)"5922lb # [ 151.787846] niks3-server[1041]: 2026/09/20 13:36:04 INFO Completed upload id=485923lb # [ 151.791425] niks3-server[1041]: 2026/09/20 13:36:04 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5924worker1 # [ 151.824141] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=0 paths=1 nar_bytes_in=5125925worker1 # [ 151.837560] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504705926worker1 # [ 151.843259] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)5927worker1 # [ 151.848082] nix-daemon[833]: reaped child process 1637, status = succeeded5928worker1 # [ 151.861667] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)5929worker1 # [ 153.095418] nix-daemon[833]: reaped child process 1651, status = succeeded5930worker1 # [ 153.271006] nix-daemon[833]: accepted connection from pid 1666, user nix-grpc-daemon (trusted)5931worker1 # [ 153.290338] nix-daemon[833]: reaped child process 1669, status = succeeded5932lb # [ 153.273862] niks3-server[1041]: 2026/09/20 13:36:05 INFO Received uploads request method=POST path=/api/pending_closures5933worker1 # [ 153.314152] nix-grpc-daemon[1592]: time=2026-09-20T13:36:05.824Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5934worker1 # [ 153.315655] nix-grpc-daemon[1592]: time=2026-09-20T13:36:05.824Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5935lb # [ 153.308646] niks3-server[1041]: 2026/09/20 13:36:05 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5936lb # [ 153.320930] niks3-server[1041]: 2026/09/20 13:36:05 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5937worker1 # [ 153.364278] nix-grpc-daemon[1592]: time=2026-09-20T13:36:05.875Z level=INFO msg="Uploading 1 narinfos"5938lb # [ 153.337237] niks3-server[1041]: 2026/09/20 13:36:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5939lb # [ 153.346370] niks3-server[1041]: 2026/09/20 13:36:05 INFO Signed narinfos id=49 count=15940lb # [ 153.351128] niks3-server[1041]: 2026/09/20 13:36:05 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5941lb # [ 153.358854] niks3-server[1041]: 2026/09/20 13:36:05 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5942lb # [ 153.363381] niks3-server[1041]: 2026/09/20 13:36:05 INFO Completed upload id=495943worker1 # [ 153.392919] nix-grpc-daemon[1592]: time=2026-09-20T13:36:05.904Z level=INFO msg="Upload complete. (321ms)"5944lb # [ 153.366091] niks3-server[1041]: 2026/09/20 13:36:05 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5945worker2 # [ 153.371525] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:05Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15946worker1 # [ 153.402898] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=7 outputs=15947worker2 # [ 153.384416] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:05Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05948worker1 # [ 153.421683] nix-daemon[833]: reaped child process 1649, status = succeeded5949worker1 # [ 153.458713] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504705950worker1 # [ 153.474344] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504705951worker1 # [ 153.488759] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504705952worker1 # [ 153.502461] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)5953worker1 # [ 153.708472] nix-daemon[833]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)5954worker1 # [ 153.729110] nix-daemon[833]: reaped child process 1676, status = succeeded5955worker1 # [ 153.904684] nix-daemon[833]: accepted connection from pid 1678, user nix-grpc-daemon (trusted)5956worker1 # [ 153.922431] nix-daemon[833]: reaped child process 1681, status = succeeded5957lb # [ 153.904792] niks3-server[1041]: 2026/09/20 13:36:06 INFO Received uploads request method=POST path=/api/pending_closures5958worker1 # [ 153.943576] nix-grpc-daemon[1592]: time=2026-09-20T13:36:06.454Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5959worker1 # [ 153.945262] nix-grpc-daemon[1592]: time=2026-09-20T13:36:06.454Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5960lb # [ 153.934253] niks3-server[1041]: 2026/09/20 13:36:06 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5961lb # [ 153.946214] niks3-server[1041]: 2026/09/20 13:36:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5962worker1 # [ 153.983598] nix-grpc-daemon[1592]: time=2026-09-20T13:36:06.494Z level=INFO msg="Uploading 1 narinfos"5963lb # [ 153.956341] niks3-server[1041]: 2026/09/20 13:36:06 INFO Signed narinfos id=50 count=15964lb # [ 153.959269] niks3-server[1041]: 2026/09/20 13:36:06 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5965lb # [ 153.970421] niks3-server[1041]: 2026/09/20 13:36:06 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5966lb # [ 153.977228] niks3-server[1041]: 2026/09/20 13:36:06 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5967lb # [ 153.981484] niks3-server[1041]: 2026/09/20 13:36:06 INFO Completed upload id=505968worker1 # [ 154.011521] nix-grpc-daemon[1592]: time=2026-09-20T13:36:06.522Z level=INFO msg="Upload complete. (492ms)"5969worker1 # [ 154.019445] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=0 paths=1 nar_bytes_in=5125970worker1 # [ 154.034677] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504705971worker1 # [ 154.040980] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)5972worker1 # [ 154.045843] nix-daemon[833]: reaped child process 1671, status = succeeded5973worker1 # [ 154.059783] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)5974worker1 # [ 155.297071] nix-daemon[833]: reaped child process 1685, status = succeeded5975worker1 # [ 155.466193] nix-daemon[833]: accepted connection from pid 1700, user nix-grpc-daemon (trusted)5976worker1 # [ 155.484780] nix-daemon[833]: reaped child process 1703, status = succeeded5977lb # [ 155.469528] niks3-server[1041]: 2026/09/20 13:36:07 INFO Received uploads request method=POST path=/api/pending_closures5978worker1 # [ 155.510584] nix-grpc-daemon[1592]: time=2026-09-20T13:36:08.020Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5979worker1 # [ 155.512317] nix-grpc-daemon[1592]: time=2026-09-20T13:36:08.020Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5980lb # [ 155.500433] niks3-server[1041]: 2026/09/20 13:36:08 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5981lb # [ 155.514083] niks3-server[1041]: 2026/09/20 13:36:08 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5982lb # [ 155.528189] niks3-server[1041]: 2026/09/20 13:36:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5983worker1 # [ 155.563682] nix-grpc-daemon[1592]: time=2026-09-20T13:36:08.074Z level=INFO msg="Uploading 1 narinfos"5984lb # [ 155.538181] niks3-server[1041]: 2026/09/20 13:36:08 INFO Signed narinfos id=51 count=15985lb # [ 155.543333] niks3-server[1041]: 2026/09/20 13:36:08 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5986lb # [ 155.549775] niks3-server[1041]: 2026/09/20 13:36:08 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5987lb # [ 155.559159] niks3-server[1041]: 2026/09/20 13:36:08 INFO Completed upload id=515988worker1 # [ 155.589260] nix-grpc-daemon[1592]: time=2026-09-20T13:36:08.100Z level=INFO msg="Upload complete. (318ms)"5989lb # [ 155.562096] niks3-server[1041]: 2026/09/20 13:36:08 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5990worker2 # [ 155.570483] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:08Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15991worker1 # [ 155.601181] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=8 outputs=15992worker2 # [ 155.580832] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:08Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05993worker1 # [ 155.623436] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504705994worker1 # [ 155.629684] nix-daemon[833]: reaped child process 1683, status = succeeded5995worker1 # [ 155.637949] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504705996worker1 # [ 155.651092] nix-grpc-daemon[1592]: time=2026-09-20T13:36:08.162Z level=INFO msg="All 1 paths already cached"5997worker1 # [ 155.659910] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504705998worker1 # [ 155.672868] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)5999worker1 # [ 155.868947] nix-daemon[833]: accepted connection from pid 1707, user nix-grpc-daemon (trusted)6000worker1 # [ 155.886017] nix-daemon[833]: reaped child process 1710, status = succeeded6001worker1 # [ 156.059052] nix-daemon[833]: accepted connection from pid 1712, user nix-grpc-daemon (trusted)6002worker1 # [ 156.076651] nix-daemon[833]: reaped child process 1715, status = succeeded6003lb # [ 156.057782] niks3-server[1041]: 2026/09/20 13:36:08 INFO Received uploads request method=POST path=/api/pending_closures6004worker1 # [ 156.096920] nix-grpc-daemon[1592]: time=2026-09-20T13:36:08.607Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6005worker1 # [ 156.098370] nix-grpc-daemon[1592]: time=2026-09-20T13:36:08.607Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"6006lb # [ 156.084806] niks3-server[1041]: 2026/09/20 13:36:08 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst6007lb # [ 156.098161] niks3-server[1041]: 2026/09/20 13:36:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6008worker1 # [ 156.135463] nix-grpc-daemon[1592]: time=2026-09-20T13:36:08.646Z level=INFO msg="Uploading 1 narinfos"6009lb # [ 156.111095] niks3-server[1041]: 2026/09/20 13:36:08 INFO Signed narinfos id=52 count=16010lb # [ 156.116859] niks3-server[1041]: 2026/09/20 13:36:08 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls6011lb # [ 156.124836] niks3-server[1041]: 2026/09/20 13:36:08 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6012worker1 # [ 156.158642] nix-grpc-daemon[1592]: time=2026-09-20T13:36:08.669Z level=INFO msg="Upload complete. (470ms)"6013lb # [ 156.130070] niks3-server[1041]: 2026/09/20 13:36:08 INFO Completed upload id=526014lb # [ 156.133832] niks3-server[1041]: 2026/09/20 13:36:08 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo6015worker1 # [ 156.168979] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=0 paths=1 nar_bytes_in=6246016worker1 # [ 156.177863] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504706017worker1 # [ 156.184700] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6018worker1 # [ 156.190136] nix-daemon[833]: reaped child process 1705, status = succeeded6019worker1 # [ 156.202625] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6020worker1 # [ 157.828937] nix-daemon[833]: reaped child process 1719, status = succeeded6021worker1 # [ 157.987072] nix-daemon[833]: accepted connection from pid 1734, user nix-grpc-daemon (trusted)6022worker1 # [ 158.005162] nix-daemon[833]: reaped child process 1737, status = succeeded6023lb # [ 157.989435] niks3-server[1041]: 2026/09/20 13:36:10 INFO Received uploads request method=POST path=/api/pending_closures6024worker1 # [ 158.032330] nix-grpc-daemon[1592]: time=2026-09-20T13:36:10.540Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6025worker1 # [ 158.033776] nix-grpc-daemon[1592]: time=2026-09-20T13:36:10.540Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"6026lb # [ 158.027328] niks3-server[1041]: 2026/09/20 13:36:10 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst6027lb # [ 158.040292] niks3-server[1041]: 2026/09/20 13:36:10 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv6028lb # [ 158.049100] niks3-server[1041]: 2026/09/20 13:36:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6029worker1 # [ 158.085205] nix-grpc-daemon[1592]: time=2026-09-20T13:36:10.596Z level=INFO msg="Uploading 1 narinfos"6030lb # [ 158.055098] niks3-server[1041]: 2026/09/20 13:36:10 INFO Signed narinfos id=53 count=16031lb # [ 158.059527] niks3-server[1041]: 2026/09/20 13:36:10 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls6032lb # [ 158.071432] niks3-server[1041]: 2026/09/20 13:36:10 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6033lb # [ 158.077512] niks3-server[1041]: 2026/09/20 13:36:10 INFO Completed upload id=536034worker1 # [ 158.106785] nix-grpc-daemon[1592]: time=2026-09-20T13:36:10.617Z level=INFO msg="Upload complete. (293ms)"6035lb # [ 158.080522] niks3-server[1041]: 2026/09/20 13:36:10 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo6036worker1 # [ 158.117713] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=9 outputs=16037worker2 # [ 158.090050] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:10Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=16038worker2 # [ 158.099525] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:10Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=06039worker1 # [ 158.133825] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504706040worker1 # [ 158.139822] nix-daemon[833]: reaped child process 1717, status = succeeded6041worker1 # [ 158.147163] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504706042worker1 # [ 158.164964] nix-grpc-daemon[1592]: time=2026-09-20T13:36:10.676Z level=INFO msg="All 1 paths already cached"6043worker1 # [ 158.172496] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504706044worker1 # [ 158.184543] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6045worker1 # [ 158.380852] nix-daemon[833]: accepted connection from pid 1741, user nix-grpc-daemon (trusted)6046worker1 # [ 158.400064] nix-daemon[833]: reaped child process 1744, status = succeeded6047worker1 # [ 158.571252] nix-daemon[833]: accepted connection from pid 1746, user nix-grpc-daemon (trusted)6048worker1 # [ 158.590413] nix-daemon[833]: reaped child process 1749, status = succeeded6049lb # [ 158.571853] niks3-server[1041]: 2026/09/20 13:36:11 INFO Received uploads request method=POST path=/api/pending_closures6050worker1 # [ 158.612059] nix-grpc-daemon[1592]: time=2026-09-20T13:36:11.123Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6051worker1 # [ 158.613539] nix-grpc-daemon[1592]: time=2026-09-20T13:36:11.123Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"6052lb # [ 158.618195] niks3-server[1041]: 2026/09/20 13:36:11 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst6053worker1 # [ 158.656898] nix-grpc-daemon[1592]: time=2026-09-20T13:36:11.168Z level=INFO msg="Uploading 1 narinfos"6054lb # [ 158.632226] niks3-server[1041]: 2026/09/20 13:36:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6055lb # [ 158.641442] niks3-server[1041]: 2026/09/20 13:36:11 INFO Signed narinfos id=54 count=16056lb # [ 158.646541] niks3-server[1041]: 2026/09/20 13:36:11 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls6057lb # [ 158.656419] niks3-server[1041]: 2026/09/20 13:36:11 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6058lb # [ 158.661198] niks3-server[1041]: 2026/09/20 13:36:11 INFO Completed upload id=546059worker1 # [ 158.691140] nix-grpc-daemon[1592]: time=2026-09-20T13:36:11.202Z level=INFO msg="Upload complete. (492ms)"6060lb # [ 158.663953] niks3-server[1041]: 2026/09/20 13:36:11 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo6061worker1 # [ 158.700241] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=0 paths=1 nar_bytes_in=6246062worker1 # [ 158.711157] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504706063worker1 # [ 158.718184] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6064worker1 # [ 158.723321] nix-daemon[833]: reaped child process 1739, status = succeeded6065worker1 # [ 158.737036] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6066worker1 # [ 159.782978] nix-daemon[833]: reaped child process 1753, status = succeeded6067worker1 # [ 159.961717] nix-daemon[833]: accepted connection from pid 1768, user nix-grpc-daemon (trusted)6068worker1 # [ 159.979509] nix-daemon[833]: reaped child process 1771, status = succeeded6069lb # [ 159.965385] niks3-server[1041]: 2026/09/20 13:36:12 INFO Received uploads request method=POST path=/api/pending_closures6070worker1 # [ 160.004749] nix-grpc-daemon[1592]: time=2026-09-20T13:36:12.515Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6071worker1 # [ 160.010064] nix-grpc-daemon[1592]: time=2026-09-20T13:36:12.517Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"6072lb # [ 160.010788] niks3-server[1041]: 2026/09/20 13:36:12 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst6073lb # [ 160.019641] niks3-server[1041]: 2026/09/20 13:36:12 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv6074worker1 # [ 160.057051] nix-grpc-daemon[1592]: time=2026-09-20T13:36:12.567Z level=INFO msg="Uploading 1 narinfos"6075lb # [ 160.028302] niks3-server[1041]: 2026/09/20 13:36:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6076lb # [ 160.040417] niks3-server[1041]: 2026/09/20 13:36:12 INFO Signed narinfos id=55 count=16077lb # [ 160.043366] niks3-server[1041]: 2026/09/20 13:36:12 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls6078lb # [ 160.052863] niks3-server[1041]: 2026/09/20 13:36:12 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6079lb # [ 160.061160] niks3-server[1041]: 2026/09/20 13:36:12 INFO Completed upload id=556080worker1 # [ 160.091278] nix-grpc-daemon[1592]: time=2026-09-20T13:36:12.602Z level=INFO msg="Upload complete. (344ms)"6081lb # [ 160.064553] niks3-server[1041]: 2026/09/20 13:36:12 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo6082worker2 # [ 160.070923] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:12Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=16083worker1 # [ 160.104940] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=10 outputs=16084worker2 # [ 160.084471] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:12Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=06085worker1 # [ 160.124435] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504706086worker1 # [ 160.132778] nix-daemon[833]: reaped child process 1751, status = succeeded6087worker1 # [ 160.137162] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504706088worker1 # [ 160.146211] nix-grpc-daemon[1592]: time=2026-09-20T13:36:12.657Z level=INFO msg="All 1 paths already cached"6089worker1 # [ 160.154237] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504706090worker1 # [ 160.166388] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6091worker1 # [ 160.358547] nix-daemon[833]: accepted connection from pid 1775, user nix-grpc-daemon (trusted)6092worker1 # [ 160.377649] nix-daemon[833]: reaped child process 1778, status = succeeded6093worker1 # [ 160.552478] nix-daemon[833]: accepted connection from pid 1780, user nix-grpc-daemon (trusted)6094worker1 # [ 160.571792] nix-daemon[833]: reaped child process 1783, status = succeeded6095lb # [ 160.553350] niks3-server[1041]: 2026/09/20 13:36:13 INFO Received uploads request method=POST path=/api/pending_closures6096worker1 # [ 160.593805] nix-grpc-daemon[1592]: time=2026-09-20T13:36:13.105Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6097worker1 # [ 160.595780] nix-grpc-daemon[1592]: time=2026-09-20T13:36:13.106Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6098lb # [ 160.585389] niks3-server[1041]: 2026/09/20 13:36:13 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6099lb # [ 160.597182] niks3-server[1041]: 2026/09/20 13:36:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6100worker1 # [ 160.634375] nix-grpc-daemon[1592]: time=2026-09-20T13:36:13.145Z level=INFO msg="Uploading 1 narinfos"6101lb # [ 160.605910] niks3-server[1041]: 2026/09/20 13:36:13 INFO Signed narinfos id=56 count=16102lb # [ 160.613371] niks3-server[1041]: 2026/09/20 13:36:13 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6103lb # [ 160.622700] niks3-server[1041]: 2026/09/20 13:36:13 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6104lb # [ 160.629468] niks3-server[1041]: 2026/09/20 13:36:13 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6105lb # [ 160.633964] niks3-server[1041]: 2026/09/20 13:36:13 INFO Completed upload id=566106worker1 # [ 160.663640] nix-grpc-daemon[1592]: time=2026-09-20T13:36:13.174Z level=INFO msg="Upload complete. (483ms)"6107worker1 # [ 160.671710] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=0 paths=1 nar_bytes_in=6246108worker1 # [ 160.685439] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504706109worker1 # [ 160.691933] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6110worker1 # [ 160.697012] nix-daemon[833]: reaped child process 1773, status = succeeded6111worker1 # [ 160.710166] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6112worker1 # [ 161.542899] nix-daemon[833]: reaped child process 1787, status = succeeded6113worker1 # [ 161.712574] nix-daemon[833]: accepted connection from pid 1802, user nix-grpc-daemon (trusted)6114worker1 # [ 161.731160] nix-daemon[833]: reaped child process 1805, status = succeeded6115lb # [ 161.713956] niks3-server[1041]: 2026/09/20 13:36:14 INFO Received uploads request method=POST path=/api/pending_closures6116worker1 # [ 161.755081] nix-grpc-daemon[1592]: time=2026-09-20T13:36:14.265Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6117worker1 # [ 161.756742] nix-grpc-daemon[1592]: time=2026-09-20T13:36:14.265Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6118lb # [ 161.745436] niks3-server[1041]: 2026/09/20 13:36:14 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6119lb # [ 161.758344] niks3-server[1041]: 2026/09/20 13:36:14 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6120lb # [ 161.771632] niks3-server[1041]: 2026/09/20 13:36:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6121worker1 # [ 161.807827] nix-grpc-daemon[1592]: time=2026-09-20T13:36:14.318Z level=INFO msg="Uploading 1 narinfos"6122lb # [ 161.782850] niks3-server[1041]: 2026/09/20 13:36:14 INFO Signed narinfos id=57 count=16123lb # [ 161.788673] niks3-server[1041]: 2026/09/20 13:36:14 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6124lb # [ 161.797942] niks3-server[1041]: 2026/09/20 13:36:14 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6125lb # [ 161.803230] niks3-server[1041]: 2026/09/20 13:36:14 INFO Completed upload id=576126worker1 # [ 161.833260] nix-grpc-daemon[1592]: time=2026-09-20T13:36:14.344Z level=INFO msg="Upload complete. (313ms)"6127lb # [ 161.806273] niks3-server[1041]: 2026/09/20 13:36:14 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6128worker2 # [ 161.812814] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:14Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16129worker1 # [ 161.847206] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=11 outputs=16130worker2 # [ 161.825739] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:14Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06131worker1 # [ 161.864461] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504706132worker1 # [ 161.873481] nix-daemon[833]: reaped child process 1785, status = succeeded6133worker1 # [ 161.877918] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504706134worker1 # [ 161.886754] nix-grpc-daemon[1592]: time=2026-09-20T13:36:14.397Z level=INFO msg="All 2 paths already cached"6135worker1 # [ 161.895545] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504706136worker1 # [ 161.908109] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6137worker1 # [ 162.095715] nix-daemon[833]: accepted connection from pid 1809, user nix-grpc-daemon (trusted)6138worker1 # [ 162.113786] nix-daemon[833]: reaped child process 1812, status = succeeded6139worker1 # [ 162.290266] nix-daemon[833]: accepted connection from pid 1814, user nix-grpc-daemon (trusted)6140worker1 # [ 162.307509] nix-daemon[833]: reaped child process 1817, status = succeeded6141lb # [ 162.290362] niks3-server[1041]: 2026/09/20 13:36:14 INFO Received uploads request method=POST path=/api/pending_closures6142worker1 # [ 162.329690] nix-grpc-daemon[1592]: time=2026-09-20T13:36:14.840Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6143worker1 # [ 162.331144] nix-grpc-daemon[1592]: time=2026-09-20T13:36:14.840Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6144lb # [ 162.319096] niks3-server[1041]: 2026/09/20 13:36:14 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6145worker1 # [ 162.368059] nix-grpc-daemon[1592]: time=2026-09-20T13:36:14.878Z level=INFO msg="Uploading 1 narinfos"6146lb # [ 162.331200] niks3-server[1041]: 2026/09/20 13:36:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6147lb # [ 162.343936] niks3-server[1041]: 2026/09/20 13:36:14 INFO Signed narinfos id=58 count=16148lb # [ 162.351157] niks3-server[1041]: 2026/09/20 13:36:14 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6149lb # [ 162.362804] niks3-server[1041]: 2026/09/20 13:36:14 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6150lb # [ 162.368434] niks3-server[1041]: 2026/09/20 13:36:14 INFO Completed upload id=586151worker1 # [ 162.398319] nix-grpc-daemon[1592]: time=2026-09-20T13:36:14.909Z level=INFO msg="Upload complete. (477ms)"6152lb # [ 162.371648] niks3-server[1041]: 2026/09/20 13:36:14 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6153worker1 # [ 162.406761] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=0 paths=1 nar_bytes_in=7526154worker1 # [ 162.419449] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504706155worker1 # [ 162.425632] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6156worker1 # [ 162.430849] nix-daemon[833]: reaped child process 1807, status = succeeded6157worker1 # [ 162.442255] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6158worker1 # [ 163.290737] nix-daemon[833]: reaped child process 1821, status = succeeded6159worker1 # [ 163.479991] nix-daemon[833]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6160worker1 # [ 163.496262] nix-daemon[833]: reaped child process 1839, status = succeeded6161lb # [ 163.481323] niks3-server[1041]: 2026/09/20 13:36:15 INFO Received uploads request method=POST path=/api/pending_closures6162worker1 # [ 163.523703] nix-grpc-daemon[1592]: time=2026-09-20T13:36:16.031Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6163worker1 # [ 163.525487] nix-grpc-daemon[1592]: time=2026-09-20T13:36:16.031Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6164lb # [ 163.524424] niks3-server[1041]: 2026/09/20 13:36:16 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6165worker1 # [ 163.563435] nix-grpc-daemon[1592]: time=2026-09-20T13:36:16.074Z level=INFO msg="Uploading 1 narinfos"6166lb # [ 163.541749] niks3-server[1041]: 2026/09/20 13:36:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6167lb # [ 163.550151] niks3-server[1041]: 2026/09/20 13:36:16 INFO Signed narinfos id=59 count=16168worker1 # [ 163.585151] nix-grpc-daemon[1592]: time=2026-09-20T13:36:16.096Z level=INFO msg="Upload complete. (330ms)"6169lb # [ 163.557011] niks3-server[1041]: 2026/09/20 13:36:16 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6170lb # [ 163.562377] niks3-server[1041]: 2026/09/20 13:36:16 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6171lb # [ 163.565585] niks3-server[1041]: 2026/09/20 13:36:16 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6172worker2 # [ 163.562545] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:16Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16173lb # [ 163.568878] niks3-server[1041]: 2026/09/20 13:36:16 INFO Completed upload id=596174worker1 # [ 163.596960] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=12 outputs=16175lb # [ 163.571252] niks3-server[1041]: 2026/09/20 13:36:16 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6176worker1 # [ 163.610918] nix-daemon[833]: reaped child process 1819, status = succeeded6177worker1 # [ 163.646276] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504706178worker1 # [ 163.661600] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504706179worker1 # [ 163.675412] nix-grpc-daemon[1592]: time=2026-09-20T13:36:16.186Z level=INFO msg="All 2 paths already cached"6180worker1 # [ 163.684659] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504706181worker1 # [ 163.698232] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6182worker1 # [ 163.896581] nix-daemon[833]: accepted connection from pid 1843, user nix-grpc-daemon (trusted)6183worker1 # [ 163.915364] nix-daemon[833]: reaped child process 1846, status = succeeded6184worker1 # [ 164.087471] nix-daemon[833]: accepted connection from pid 1848, user nix-grpc-daemon (trusted)6185worker1 # [ 164.102864] nix-daemon[833]: reaped child process 1851, status = succeeded6186lb # [ 164.088204] niks3-server[1041]: 2026/09/20 13:36:16 INFO Received uploads request method=POST path=/api/pending_closures6187worker1 # [ 164.126888] nix-grpc-daemon[1592]: time=2026-09-20T13:36:16.637Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6188worker1 # [ 164.128467] nix-grpc-daemon[1592]: time=2026-09-20T13:36:16.637Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6189lb # [ 164.117652] niks3-server[1041]: 2026/09/20 13:36:16 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6190lb # [ 164.131344] niks3-server[1041]: 2026/09/20 13:36:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6191worker1 # [ 164.167844] nix-grpc-daemon[1592]: time=2026-09-20T13:36:16.678Z level=INFO msg="Uploading 1 narinfos"6192lb # [ 164.141124] niks3-server[1041]: 2026/09/20 13:36:16 INFO Signed narinfos id=60 count=16193lb # [ 164.149107] niks3-server[1041]: 2026/09/20 13:36:16 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6194worker1 # [ 164.190244] nix-grpc-daemon[1592]: time=2026-09-20T13:36:16.701Z level=INFO msg="Upload complete. (476ms)"6195lb # [ 164.160821] niks3-server[1041]: 2026/09/20 13:36:16 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6196lb # [ 164.168444] niks3-server[1041]: 2026/09/20 13:36:16 INFO Completed upload id=606197lb # [ 164.172593] niks3-server[1041]: 2026/09/20 13:36:16 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6198worker1 # [ 164.200255] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=0 paths=1 nar_bytes_in=7526199worker1 # [ 164.210117] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504706200worker1 # [ 164.216898] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6201worker1 # [ 164.221951] nix-daemon[833]: reaped child process 1841, status = succeeded6202worker1 # [ 164.235152] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6203worker1 # [ 164.860454] nix-daemon[833]: reaped child process 1855, status = succeeded6204worker1 # [ 165.034430] nix-daemon[833]: accepted connection from pid 1870, user nix-grpc-daemon (trusted)6205worker1 # [ 165.052422] nix-daemon[833]: reaped child process 1873, status = succeeded6206lb # [ 165.034836] niks3-server[1041]: 2026/09/20 13:36:17 INFO Received uploads request method=POST path=/api/pending_closures6207worker1 # [ 165.074944] nix-grpc-daemon[1592]: time=2026-09-20T13:36:17.584Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6208worker1 # [ 165.076510] nix-grpc-daemon[1592]: time=2026-09-20T13:36:17.584Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6209lb # [ 165.064429] niks3-server[1041]: 2026/09/20 13:36:17 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6210lb # [ 165.084119] niks3-server[1041]: 2026/09/20 13:36:17 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6211worker1 # [ 165.122156] nix-grpc-daemon[1592]: time=2026-09-20T13:36:17.633Z level=INFO msg="Uploading 1 narinfos"6212lb # [ 165.095685] niks3-server[1041]: 2026/09/20 13:36:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6213lb # [ 165.105579] niks3-server[1041]: 2026/09/20 13:36:17 INFO Signed narinfos id=61 count=16214lb # [ 165.109378] niks3-server[1041]: 2026/09/20 13:36:17 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6215worker1 # [ 165.147082] nix-grpc-daemon[1592]: time=2026-09-20T13:36:17.658Z level=INFO msg="Upload complete. (303ms)"6216lb # [ 165.117545] niks3-server[1041]: 2026/09/20 13:36:17 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6217lb # [ 165.122668] niks3-server[1041]: 2026/09/20 13:36:17 INFO Completed upload id=616218lb # [ 165.125568] niks3-server[1041]: 2026/09/20 13:36:17 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6219worker2 # [ 165.123475] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:17Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16220worker1 # [ 165.156763] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=0 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=13 outputs=16221worker1 # [ 165.172299] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504706222worker1 # [ 165.180185] nix-daemon[833]: reaped child process 1853, status = succeeded6223worker1 # [ 165.210310] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504706224worker1 # [ 165.225754] nix-grpc-daemon[1592]: time=2026-09-20T13:36:17.736Z level=INFO msg="All 2 paths already cached"6225worker1 # [ 165.234851] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504706226worker1 # [ 165.248401] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6227worker1 # [ 165.453227] nix-daemon[833]: accepted connection from pid 1877, user nix-grpc-daemon (trusted)6228worker1 # [ 165.471328] nix-daemon[833]: reaped child process 1880, status = succeeded6229worker1 # [ 165.644086] nix-daemon[833]: accepted connection from pid 1882, user nix-grpc-daemon (trusted)6230worker1 # [ 165.663494] nix-daemon[833]: reaped child process 1885, status = succeeded6231lb # [ 165.644447] niks3-server[1041]: 2026/09/20 13:36:18 INFO Received uploads request method=POST path=/api/pending_closures6232worker1 # [ 165.684674] nix-grpc-daemon[1592]: time=2026-09-20T13:36:18.195Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6233worker1 # [ 165.686148] nix-grpc-daemon[1592]: time=2026-09-20T13:36:18.195Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6234lb # [ 165.672565] niks3-server[1041]: 2026/09/20 13:36:18 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6235lb # [ 165.687511] niks3-server[1041]: 2026/09/20 13:36:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6236worker1 # [ 165.723124] nix-grpc-daemon[1592]: time=2026-09-20T13:36:18.234Z level=INFO msg="Uploading 1 narinfos"6237lb # [ 165.700174] niks3-server[1041]: 2026/09/20 13:36:18 INFO Signed narinfos id=62 count=16238lb # [ 165.710936] niks3-server[1041]: 2026/09/20 13:36:18 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6239worker1 # [ 165.745648] nix-grpc-daemon[1592]: time=2026-09-20T13:36:18.256Z level=INFO msg="Upload complete. (480ms)"6240lb # [ 165.716470] niks3-server[1041]: 2026/09/20 13:36:18 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6241lb # [ 165.721564] niks3-server[1041]: 2026/09/20 13:36:18 INFO Completed upload id=626242worker1 # [ 165.752354] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=0 paths=1 nar_bytes_in=7526243lb # [ 165.724690] niks3-server[1041]: 2026/09/20 13:36:18 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6244worker1 # [ 165.766165] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504706245worker1 # [ 165.772886] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6246worker1 # [ 165.778316] nix-daemon[833]: reaped child process 1875, status = succeeded6247worker1 # [ 165.791886] nix-daemon[833]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6248worker1 # [ 167.026931] nix-daemon[833]: reaped child process 1889, status = succeeded6249worker1 # [ 167.224965] nix-daemon[833]: accepted connection from pid 1904, user nix-grpc-daemon (trusted)6250worker1 # [ 167.247599] nix-daemon[833]: reaped child process 1907, status = succeeded6251lb # [ 167.234697] niks3-server[1041]: 2026/09/20 13:36:19 INFO Received uploads request method=POST path=/api/pending_closures6252worker1 # [ 167.280985] nix-grpc-daemon[1592]: time=2026-09-20T13:36:19.789Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6253worker1 # [ 167.282476] nix-grpc-daemon[1592]: time=2026-09-20T13:36:19.789Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6254lb # [ 167.293396] niks3-server[1041]: 2026/09/20 13:36:19 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6255lb # [ 167.306121] niks3-server[1041]: 2026/09/20 13:36:19 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6256lb # [ 167.313747] niks3-server[1041]: 2026/09/20 13:36:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6257worker1 # [ 167.347848] nix-grpc-daemon[1592]: time=2026-09-20T13:36:19.858Z level=INFO msg="Uploading 1 narinfos"6258lb # [ 167.321597] niks3-server[1041]: 2026/09/20 13:36:19 INFO Signed narinfos id=63 count=16259lb # [ 167.326064] niks3-server[1041]: 2026/09/20 13:36:19 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6260lb # [ 167.336594] niks3-server[1041]: 2026/09/20 13:36:19 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6261lb # [ 167.345364] niks3-server[1041]: 2026/09/20 13:36:19 INFO Completed upload id=636262worker1 # [ 167.375499] nix-grpc-daemon[1592]: time=2026-09-20T13:36:19.886Z level=INFO msg="Upload complete. (372ms)"6263lb # [ 167.348071] niks3-server[1041]: 2026/09/20 13:36:19 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6264worker1 # [ 167.389685] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50470 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=14 outputs=16265worker1 # [ 167.414358] nix-daemon[833]: reaped child process 1887, status = succeeded6266client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.32 seconds)6267worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6268worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)6269client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16270worker1 # [ 167.874079] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:504706271worker1 # [ 167.885502] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504706272worker2 # [ 167.891809] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:20Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06273lb # [ 171.153597] envoy[921]: conn peer=[2001:db8:1::1]:52380 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27131 tx=10754 ms=190126274client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.41 seconds)6275(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 49.83 seconds)6276subtest: low disk drains a worker and builds go to the other6277worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6278worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.13 seconds)6279worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6280worker1 # [ 199.362701] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:51Z level=info event=unhealthy reason=min_free6281worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds)6282client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26283client # don't know how to build these paths:6284client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6285worker2 # [ 200.441430] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:356846286worker1 # [ 200.478527] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504706287worker2 # [ 200.475911] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:52Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06288worker2 # [ 200.482898] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:52Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16289worker2 # [ 200.524191] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:356846290worker2 # [ 200.542327] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:356846291client # copying 1 paths to 'lb:50051'...6292client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6293worker2 # [ 200.559028] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:356846294worker2 # [ 200.576403] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)6295worker2 # [ 200.795193] nix-daemon[847]: accepted connection from pid 1716, user nix-grpc-daemon (trusted)6296worker2 # [ 200.812929] nix-daemon[847]: reaped child process 1719, status = succeeded6297worker2 # [ 200.989510] nix-daemon[847]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)6298worker2 # [ 201.006191] nix-daemon[847]: reaped child process 1724, status = succeeded6299lb # [ 201.019697] niks3-server[1041]: 2026/09/20 13:36:53 INFO Received uploads request method=POST path=/api/pending_closures6300worker2 # [ 201.033080] nix-grpc-daemon[1514]: time=2026-09-20T13:36:53.551Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6301worker2 # [ 201.034815] nix-grpc-daemon[1514]: time=2026-09-20T13:36:53.551Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6302lb # [ 201.052584] niks3-server[1041]: 2026/09/20 13:36:53 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6303lb # [ 201.071013] niks3-server[1041]: 2026/09/20 13:36:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6304worker2 # [ 201.076085] nix-grpc-daemon[1514]: time=2026-09-20T13:36:53.594Z level=INFO msg="Uploading 1 narinfos"6305lb # [ 201.079560] niks3-server[1041]: 2026/09/20 13:36:53 INFO Signed narinfos id=64 count=16306lb # [ 201.086523] niks3-server[1041]: 2026/09/20 13:36:53 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6307lb # [ 201.097244] niks3-server[1041]: 2026/09/20 13:36:53 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6308lb # [ 201.103437] niks3-server[1041]: 2026/09/20 13:36:53 INFO Completed upload id=646309worker2 # [ 201.102828] nix-grpc-daemon[1514]: time=2026-09-20T13:36:53.621Z level=INFO msg="Upload complete. (507ms)"6310lb # [ 201.106132] niks3-server[1041]: 2026/09/20 13:36:53 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6311worker2 # [ 201.111851] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35684 duration_s=0 paths=1 nar_bytes_in=5126312worker2 # [ 201.127608] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:356846313worker2 # [ 201.133802] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)6314worker2 # [ 201.138956] nix-daemon[847]: reaped child process 1714, status = succeeded6315client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6316worker2 # [ 201.150443] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)6317client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6318lb # [ 201.153385] envoy[921]: conn peer=[2001:db8:1::1]:51660 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=523 ms=300796319client # farm-a> LOG-farm-a-drain6320worker2 # [ 202.399975] nix-daemon[847]: reaped child process 1728, status = succeeded6321worker2 # [ 202.580331] nix-daemon[847]: accepted connection from pid 1743, user nix-grpc-daemon (trusted)6322worker2 # [ 202.597827] nix-daemon[847]: reaped child process 1746, status = succeeded6323lb # [ 202.613848] niks3-server[1041]: 2026/09/20 13:36:55 INFO Received uploads request method=POST path=/api/pending_closures6324worker2 # [ 202.624410] nix-grpc-daemon[1514]: time=2026-09-20T13:36:55.140Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6325worker2 # [ 202.626294] nix-grpc-daemon[1514]: time=2026-09-20T13:36:55.140Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6326lb # [ 202.651451] niks3-server[1041]: 2026/09/20 13:36:55 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6327lb # [ 202.664369] niks3-server[1041]: 2026/09/20 13:36:55 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6328worker2 # [ 202.671207] nix-grpc-daemon[1514]: time=2026-09-20T13:36:55.189Z level=INFO msg="Uploading 1 narinfos"6329lb # [ 202.676586] niks3-server[1041]: 2026/09/20 13:36:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6330lb # [ 202.683864] niks3-server[1041]: 2026/09/20 13:36:55 INFO Signed narinfos id=65 count=16331lb # [ 202.690109] niks3-server[1041]: 2026/09/20 13:36:55 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6332worker2 # [ 202.693027] nix-grpc-daemon[1514]: time=2026-09-20T13:36:55.211Z level=INFO msg="Upload complete. (329ms)"6333lb # [ 202.694495] niks3-server[1041]: 2026/09/20 13:36:55 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6334lb # [ 202.699565] niks3-server[1041]: 2026/09/20 13:36:55 INFO Completed upload id=656335lb # [ 202.702330] niks3-server[1041]: 2026/09/20 13:36:55 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6336worker2 # [ 202.709216] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35684 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=15 outputs=16337worker2 # [ 202.723114] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:55Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06338worker2 # [ 202.726890] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:55Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16339worker2 # [ 202.730691] nix-daemon[847]: reaped child process 1726, status = succeeded6340worker2 # [ 202.755651] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:356846341worker2 # [ 202.772254] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:356846342worker2 # [ 202.786775] nix-grpc-daemon[1514]: time=2026-09-20T13:36:55.305Z level=INFO msg="All 1 paths already cached"6343client # copying 1 paths to 'lb:50051'...6344client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6345worker2 # [ 202.797248] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:356846346worker2 # [ 202.811017] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)6347worker2 # [ 203.014733] nix-daemon[847]: accepted connection from pid 1752, user nix-grpc-daemon (trusted)6348worker2 # [ 203.035802] nix-daemon[847]: reaped child process 1755, status = succeeded6349worker2 # [ 203.209277] nix-daemon[847]: accepted connection from pid 1757, user nix-grpc-daemon (trusted)6350worker2 # [ 203.226081] nix-daemon[847]: reaped child process 1760, status = succeeded6351lb # [ 203.237670] niks3-server[1041]: 2026/09/20 13:36:55 INFO Received uploads request method=POST path=/api/pending_closures6352worker2 # [ 203.242456] nix-grpc-daemon[1514]: time=2026-09-20T13:36:55.761Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6353worker2 # [ 203.243969] nix-grpc-daemon[1514]: time=2026-09-20T13:36:55.761Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6354lb # [ 203.253380] niks3-server[1041]: 2026/09/20 13:36:55 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6355lb # [ 203.260172] niks3-server[1041]: 2026/09/20 13:36:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6356worker2 # [ 203.262432] nix-grpc-daemon[1514]: time=2026-09-20T13:36:55.781Z level=INFO msg="Uploading 1 narinfos"6357lb # [ 203.266059] niks3-server[1041]: 2026/09/20 13:36:55 INFO Signed narinfos id=66 count=16358lb # [ 203.269130] niks3-server[1041]: 2026/09/20 13:36:55 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6359lb # [ 203.274588] niks3-server[1041]: 2026/09/20 13:36:55 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6360worker2 # [ 203.276053] nix-grpc-daemon[1514]: time=2026-09-20T13:36:55.794Z level=INFO msg="Upload complete. (448ms)"6361lb # [ 203.277474] niks3-server[1041]: 2026/09/20 13:36:55 INFO Completed upload id=666362lb # [ 203.279094] niks3-server[1041]: 2026/09/20 13:36:55 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6363worker2 # [ 203.280107] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35684 duration_s=0 paths=1 nar_bytes_in=6326364worker2 # [ 203.289719] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:356846365worker2 # [ 203.293819] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)6366worker2 # [ 203.297243] nix-daemon[847]: reaped child process 1750, status = succeeded6367client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6368worker2 # [ 203.306431] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)6369client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6370client # farm-b> LOG-farm-b-drain6371worker2 # [ 204.328275] nix-daemon[847]: reaped child process 1764, status = succeeded6372worker2 # [ 204.486369] nix-daemon[847]: accepted connection from pid 1779, user nix-grpc-daemon (trusted)6373worker2 # [ 204.505226] nix-daemon[847]: reaped child process 1782, status = succeeded6374lb # [ 204.520727] niks3-server[1041]: 2026/09/20 13:36:57 INFO Received uploads request method=POST path=/api/pending_closures6375worker2 # [ 204.532412] nix-grpc-daemon[1514]: time=2026-09-20T13:36:57.048Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6376worker2 # [ 204.533892] nix-grpc-daemon[1514]: time=2026-09-20T13:36:57.048Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6377lb # [ 204.560701] niks3-server[1041]: 2026/09/20 13:36:57 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6378lb # [ 204.572302] niks3-server[1041]: 2026/09/20 13:36:57 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6379worker2 # [ 204.584725] nix-grpc-daemon[1514]: time=2026-09-20T13:36:57.103Z level=INFO msg="Uploading 1 narinfos"6380lb # [ 204.585422] niks3-server[1041]: 2026/09/20 13:36:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6381lb # [ 204.590061] niks3-server[1041]: 2026/09/20 13:36:57 INFO Signed narinfos id=67 count=16382lb # [ 204.594547] niks3-server[1041]: 2026/09/20 13:36:57 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6383lb # [ 204.604973] niks3-server[1041]: 2026/09/20 13:36:57 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6384lb # [ 204.610939] niks3-server[1041]: 2026/09/20 13:36:57 INFO Completed upload id=676385worker2 # [ 204.610243] nix-grpc-daemon[1514]: time=2026-09-20T13:36:57.129Z level=INFO msg="Upload complete. (293ms)"6386lb # [ 204.613855] niks3-server[1041]: 2026/09/20 13:36:57 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6387worker2 # [ 204.621060] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35684 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=16 outputs=16388worker2 # [ 204.636421] nix-daemon[847]: reaped child process 1762, status = succeeded6389worker2 # [ 204.668939] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:57Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06390worker2 # [ 204.676099] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:57Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16391worker2 # [ 204.715298] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:356846392worker2 # [ 204.730622] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:356846393worker2 # [ 204.745094] nix-grpc-daemon[1514]: time=2026-09-20T13:36:57.263Z level=INFO msg="All 2 paths already cached"6394client # copying 1 paths to 'lb:50051'...6395client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6396worker2 # [ 204.755148] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:356846397worker2 # [ 204.769349] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)6398worker2 # [ 204.974519] nix-daemon[847]: accepted connection from pid 1788, user nix-grpc-daemon (trusted)6399worker2 # [ 204.993923] nix-daemon[847]: reaped child process 1791, status = succeeded6400worker2 # [ 205.163530] nix-daemon[847]: accepted connection from pid 1793, user nix-grpc-daemon (trusted)6401worker2 # [ 205.181674] nix-daemon[847]: reaped child process 1796, status = succeeded6402lb # [ 205.193357] niks3-server[1041]: 2026/09/20 13:36:57 INFO Received uploads request method=POST path=/api/pending_closures6403worker2 # [ 205.202927] nix-grpc-daemon[1514]: time=2026-09-20T13:36:57.721Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6404worker2 # [ 205.204522] nix-grpc-daemon[1514]: time=2026-09-20T13:36:57.721Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6405lb # [ 205.231336] niks3-server[1041]: 2026/09/20 13:36:57 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6406worker2 # [ 205.239509] nix-grpc-daemon[1514]: time=2026-09-20T13:36:57.758Z level=INFO msg="Uploading 1 narinfos"6407lb # [ 205.244764] niks3-server[1041]: 2026/09/20 13:36:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6408lb # [ 205.254682] niks3-server[1041]: 2026/09/20 13:36:57 INFO Signed narinfos id=68 count=16409lb # [ 205.258404] niks3-server[1041]: 2026/09/20 13:36:57 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6410lb # [ 205.265679] niks3-server[1041]: 2026/09/20 13:36:57 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6411lb # [ 205.270353] niks3-server[1041]: 2026/09/20 13:36:57 INFO Completed upload id=686412worker2 # [ 205.269341] nix-grpc-daemon[1514]: time=2026-09-20T13:36:57.788Z level=INFO msg="Upload complete. (483ms)"6413lb # [ 205.273029] niks3-server[1041]: 2026/09/20 13:36:57 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6414worker2 # [ 205.276279] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35684 duration_s=0 paths=1 nar_bytes_in=7606415worker2 # [ 205.289863] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:356846416worker2 # [ 205.296365] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)6417worker2 # [ 205.301280] nix-daemon[847]: reaped child process 1786, status = succeeded6418client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6419client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6420worker2 # [ 205.315009] nix-daemon[847]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)6421client # farm-top> LOG-farm-top-drain6422worker2 # [ 206.161694] nix-daemon[847]: reaped child process 1800, status = succeeded6423worker2 # [ 206.342262] nix-daemon[847]: accepted connection from pid 1815, user nix-grpc-daemon (trusted)6424worker2 # [ 206.360492] nix-daemon[847]: reaped child process 1818, status = succeeded6425lb # [ 206.373685] niks3-server[1041]: 2026/09/20 13:36:58 INFO Received uploads request method=POST path=/api/pending_closures6426worker2 # [ 206.383507] nix-grpc-daemon[1514]: time=2026-09-20T13:36:58.901Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6427worker2 # [ 206.385224] nix-grpc-daemon[1514]: time=2026-09-20T13:36:58.901Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6428lb # [ 206.412769] niks3-server[1041]: 2026/09/20 13:36:58 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6429worker2 # [ 206.427453] nix-grpc-daemon[1514]: time=2026-09-20T13:36:58.946Z level=INFO msg="Uploading 1 narinfos"6430lb # [ 206.430078] niks3-server[1041]: 2026/09/20 13:36:58 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6431lb # [ 206.437601] niks3-server[1041]: 2026/09/20 13:36:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6432lb # [ 206.444942] niks3-server[1041]: 2026/09/20 13:36:58 INFO Signed narinfos id=69 count=16433lb # [ 206.449768] niks3-server[1041]: 2026/09/20 13:36:58 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6434worker2 # [ 206.453167] nix-grpc-daemon[1514]: time=2026-09-20T13:36:58.972Z level=INFO msg="Upload complete. (328ms)"6435lb # [ 206.454806] niks3-server[1041]: 2026/09/20 13:36:58 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6436lb # [ 206.458552] niks3-server[1041]: 2026/09/20 13:36:58 INFO Completed upload id=696437lb # [ 206.460951] niks3-server[1041]: 2026/09/20 13:36:58 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6438worker2 # [ 206.465113] nix-grpc-daemon[1444]: ts=2026-09-20T13:36:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35684 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=17 outputs=16439worker2 # [ 206.479981] nix-daemon[847]: reaped child process 1798, status = succeeded6440client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.37 seconds)6441client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6442client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.24 seconds)6443worker1: must succeed: rm /nix/.rw-store/fill6444worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.20 seconds)6445worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6446worker1 # [ 207.376473] nix-grpc-daemon[1536]: ts=2026-09-20T13:36:59Z level=info event=healthy reason=min_free6447worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.15 seconds)6448(finished: subtest: low disk drains a worker and builds go to the other, in 10.35 seconds)6449(finished: run the VM test script, in 209.36 seconds)6450test script finished in 209.74s6451cleanup6452kill QemuMachine (pid 49)6453client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6454kill QemuMachine (pid 50)6455lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6456kill QemuMachine (pid 52)6457worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6458kill QemuMachine (pid 51)6459worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6460(finished: cleanup, in 1.26 seconds)6461additionally exposed symbols:6462 client, lb, worker1, worker2,6463 vlan1,6464 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh