vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #206
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.01 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker1 # Disk image does not exist, creating the virtualisation disk image...13worker1: QEMU running (pid 51)14worker2 # Disk image does not exist, creating the virtualisation disk image...15worker2: QEMU running (pid 52)16worker2 # Formatting '/build/vm-state-worker2/tmp.lBcbzi7mEJ', fmt=raw size=107374182417worker1 # Formatting '/build/vm-state-worker1/tmp.CAMb3NCuiB', fmt=raw size=107374182418lb # Disk image does not exist, creating the virtualisation disk image...19lb: QEMU running (pid 50)20client: QEMU running (pid 49)21client # Disk image does not exist, creating the virtualisation disk image...22client # Formatting '/build/vm-state-client/tmp.t6C1ByVBa5', fmt=raw size=107374182423worker2 # mke2fs 1.47.4 (6-Mar-2025)24worker1 # mke2fs 1.47.4 (6-Mar-2025)25lb # Formatting '/build/vm-state-lb/tmp.q3xEbb1P1Y', fmt=raw size=107374182426(finished: start all VMs, in 0.25 seconds)27worker2 # Discarding device blocks: 0/262144 done28lb # mke2fs 1.47.4 (6-Mar-2025)29client: waiting for unit network-addresses-eth1.service30worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes31lb # Discarding device blocks: 0/262144 done32client: waiting for the VM to finish booting33worker2 # Filesystem UUID: 8f77da46-0131-47ac-91d3-2cf3ece4f49734lb # Creating filesystem with 262144 4k blocks and 65536 inodes35worker2 # Superblock backups stored on blocks:36lb # Filesystem UUID: 2738f7f1-4f0c-46cf-b09c-6afdae2a9aac37worker1 # Discarding device blocks: 0/262144 done38client # mke2fs 1.47.4 (6-Mar-2025)39worker2 # 32768, 98304, 163840, 22937640lb # Superblock backups stored on blocks:41worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes42client # Discarding device blocks: 0/262144 done43worker2 # 44lb # 32768, 98304, 163840, 22937645worker1 # Filesystem UUID: 860f095d-8254-47a1-a158-991ddfc8d91f46client # Creating filesystem with 262144 4k blocks and 65536 inodes47worker2 # Allocating group tables: 0/8 done48lb # 49worker1 # Superblock backups stored on blocks:50client # Filesystem UUID: da62907f-710c-4664-9a11-b5dc2fef2ba451worker2 # Writing inode tables: 0/8 done52lb # Allocating group tables: 0/8 done53worker1 # 32768, 98304, 163840, 22937654client # Superblock backups stored on blocks:55worker2 # Creating journal (8192 blocks): done56lb # Writing inode tables: 0/8 done57worker1 # 58client # 32768, 98304, 163840, 22937659worker2 # Writing superblocks and filesystem accounting information: 0/8 done60lb # Creating journal (8192 blocks): done61worker1 # Allocating group tables: 0/8 done62client # 63worker2 # 64lb # Writing superblocks and filesystem accounting information: 0/8 done65worker1 # Writing inode tables: 0/8 done66client # Allocating group tables: 0/8 done67worker2 # Virtualisation disk image created.68lb # 69worker1 # Creating journal (8192 blocks): done70lb # Virtualisation disk image created.71worker1 # Writing superblocks and filesystem accounting information: 0/8 done72client # Writing inode tables: 0/8 done73worker1 # 74client # Creating journal (8192 blocks): done75worker1 # Virtualisation disk image created.76client # Writing superblocks and filesystem accounting information: 0/8 done77client # 78client # Virtualisation disk image created.79worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker1 # 84worker1 # 85worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...87worker1 # 88worker1 # 89worker1 # 90worker1 # 91worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0092worker2 # 93worker2 # 94worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0095client # 96client # 97worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...98worker1 # 99worker1 # 100client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00101lb # 102lb # 103worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...104worker2 # 105worker2 # 106worker2 # 107worker2 # 108lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00109worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00110client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...111client # 112client # 113client # 114client # 115lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...116client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00117lb # 118lb # 119lb # 120lb # 121lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00122worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...123worker2 # 124worker2 # 125client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...126client # 127client # 128lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129lb # 130lb # 131worker1 # Booting from ROM...132worker2 # Booting from ROM...133client # Booting from ROM...134lb # Booting from ROM...135worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026137worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rvsngj39rzmaylbw0r3qiqzwv2igjh1n-nixos-system-worker1-test/init regInfo=/nix/store/r3vsrh4gibsjd93ai3f384ak7i0k5ajv-closure-info/registration console=ttyS0,115200n8 console=tty0138worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3wlw5bswpkdy4vjmzg1c10hvmwznrq47-nixos-system-worker2-test/init regInfo=/nix/store/fbifgg1m2lxf88xsfb1i43xcabqyik15-closure-info/registration console=ttyS0,115200n8 console=tty0139worker1 # [ 0.000000] BIOS-provided physical RAM map:140worker2 # [ 0.000000] BIOS-provided physical RAM map:141client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026142worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable143worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable144worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved145worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved146worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved147worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved148worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable149worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable150client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zhxi75b5nsabxqch8h65z6an848g1y3d-nixos-system-client-test/init regInfo=/nix/store/yyih6n0zkymmkrx5sbdz8k65ym6m6vqw-closure-info/registration console=ttyS0,115200n8 console=tty0151worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved152client # [ 0.000000] BIOS-provided physical RAM map:153lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026154worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved155worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved156client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable157worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved158worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved159worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved160client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved161worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved162worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved163client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved164worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved165worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved166client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable167worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved168worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved169lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8fdxjbikvaji18xgirrp6mfk844mip85-nixos-system-lb-test/init regInfo=/nix/store/8716l27kqqvxrr52shr1gfnbwraiag7w-closure-info/registration console=ttyS0,115200n8 console=tty0170client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved171worker2 # [ 0.000000] NX (Execute Disable) protection: active172lb # [ 0.000000] BIOS-provided physical RAM map:173worker1 # [ 0.000000] NX (Execute Disable) protection: active174client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved175worker2 # [ 0.000000] APIC: Static calls initialized176worker1 # [ 0.000000] APIC: Static calls initialized177lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable178worker2 # [ 0.000000] SMBIOS 2.8 present.179worker1 # [ 0.000000] SMBIOS 2.8 present.180client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved181lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved182client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved183worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014184worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014185lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved186worker2 # [ 0.000000] DMI: Memory slots populated: 1/1187worker1 # [ 0.000000] DMI: Memory slots populated: 1/1188client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved189worker2 # [ 0.000000] Hypervisor detected: KVM190worker1 # [ 0.000000] Hypervisor detected: KVM191lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable192client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved193worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000194worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000195lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved196client # [ 0.000000] NX (Execute Disable) protection: active197worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00198worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00199client # [ 0.000000] APIC: Static calls initialized200lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved201worker2 # [ 0.000000] kvm-clock: using sched offset of 488436968 cycles202client # [ 0.000000] SMBIOS 2.8 present.203worker1 # [ 0.000000] kvm-clock: using sched offset of 483811971 cycles204lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved205worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns206client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014207worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns208lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved209worker2 # [ 0.000006] tsc: Detected 2400.012 MHz processor210client # [ 0.000000] DMI: Memory slots populated: 1/1211worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor212client # [ 0.000000] Hypervisor detected: KVM213lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved214worker2 # [ 0.000824] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000215worker1 # [ 0.000817] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000216client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000217lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved218worker2 # [ 0.000852] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs219client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00220worker1 # [ 0.000845] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs221lb # [ 0.000000] NX (Execute Disable) protection: active222client # [ 0.000000] kvm-clock: using sched offset of 484861795 cycles223worker2 # [ 0.000855] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT224lb # [ 0.000000] APIC: Static calls initialized225worker1 # [ 0.000848] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT226lb # [ 0.000000] SMBIOS 2.8 present.227worker2 # [ 0.002808] found SMP MP-table at [mem 0x000f5450-0x000f545f]228worker1 # [ 0.002754] found SMP MP-table at [mem 0x000f5450-0x000f545f]229client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns230worker1 # [ 0.002768] Using GB pages for direct mapping231lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014232client # [ 0.000006] tsc: Detected 2400.012 MHz processor233worker1 # [ 0.002892] RAMDISK: [mem 0x5e367000-0x5ffcffff]234worker2 # [ 0.002823] Using GB pages for direct mapping235client # [ 0.000843] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000236worker2 # [ 0.002932] RAMDISK: [mem 0x5e367000-0x5ffcffff]237worker1 # [ 0.002903] ACPI: Early table checksum verification disabled238worker2 # [ 0.002941] ACPI: Early table checksum verification disabled239lb # [ 0.000000] DMI: Memory slots populated: 1/1240worker2 # [ 0.002945] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )241lb # [ 0.000000] Hypervisor detected: KVM242client # [ 0.000873] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs243lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000244worker1 # [ 0.002907] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )245lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00246worker2 # [ 0.002950] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)247client # [ 0.000876] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT248worker1 # [ 0.002912] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)249lb # [ 0.000001] kvm-clock: using sched offset of 496066690 cycles250client # [ 0.002825] found SMP MP-table at [mem 0x000f5450-0x000f545f]251worker2 # [ 0.002954] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)252worker1 # [ 0.002917] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)253client # [ 0.002840] Using GB pages for direct mapping254client # [ 0.002928] RAMDISK: [mem 0x5e366000-0x5ffcffff]255lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns256worker2 # [ 0.002962] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)257lb # [ 0.000006] tsc: Detected 2400.012 MHz processor258worker1 # [ 0.002925] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)259client # [ 0.002937] ACPI: Early table checksum verification disabled260worker2 # [ 0.002965] ACPI: FACS 0x000000005FFE0000 000040261lb # [ 0.000808] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000262worker1 # [ 0.002927] ACPI: FACS 0x000000005FFE0000 000040263client # [ 0.002941] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )264worker2 # [ 0.002966] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)265lb # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs266worker1 # [ 0.002928] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)267client # [ 0.002946] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)268worker2 # [ 0.002968] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)269lb # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT270worker1 # [ 0.002930] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)271client # [ 0.002951] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)272worker2 # [ 0.002969] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)273lb # [ 0.002735] found SMP MP-table at [mem 0x000f5450-0x000f545f]274lb # [ 0.002751] Using GB pages for direct mapping275worker1 # [ 0.002932] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)276client # [ 0.002959] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)277lb # [ 0.002915] RAMDISK: [mem 0x5e367000-0x5ffcffff]278worker2 # [ 0.002971] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)279client # [ 0.002961] ACPI: FACS 0x000000005FFE0000 000040280worker1 # [ 0.002933] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)281lb # [ 0.002924] ACPI: Early table checksum verification disabled282worker2 # [ 0.002972] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]283client # [ 0.002962] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)284worker1 # [ 0.002935] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]285lb # [ 0.002927] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )286worker2 # [ 0.002974] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]287client # [ 0.002964] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)288worker1 # [ 0.002936] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]289lb # [ 0.002932] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)290worker2 # [ 0.002974] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]291worker1 # [ 0.002936] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]292client # [ 0.002965] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)293worker2 # [ 0.002975] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]294lb # [ 0.002936] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)295worker1 # [ 0.002937] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]296client # [ 0.002967] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)297worker2 # [ 0.002975] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]298lb # [ 0.002944] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)299worker1 # [ 0.002937] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]300client # [ 0.002968] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]301lb # [ 0.002946] ACPI: FACS 0x000000005FFE0000 000040302worker2 # [ 0.002976] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]303worker1 # [ 0.002938] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]304client # [ 0.002970] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]305worker2 # [ 0.002976] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]306lb # [ 0.002948] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)307worker2 # [ 0.003219] No NUMA configuration found308worker1 # [ 0.002938] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]309client # [ 0.002970] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]310worker1 # [ 0.003174] No NUMA configuration found311lb # [ 0.002949] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)312worker2 # [ 0.003220] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]313client # [ 0.002971] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]314worker1 # [ 0.003175] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]315worker2 # [ 0.003223] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]316lb # [ 0.002951] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)317worker2 # [ 0.005586] Zone ranges:318client # [ 0.002971] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]319worker1 # [ 0.003178] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]320worker1 # [ 0.005935] Zone ranges:321worker2 # [ 0.005588] DMA [mem 0x0000000000001000-0x0000000000ffffff]322lb # [ 0.002952] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)323client # [ 0.002972] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]324worker1 # [ 0.005937] DMA [mem 0x0000000000001000-0x0000000000ffffff]325worker2 # [ 0.005589] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]326lb # [ 0.002954] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]327client # [ 0.002972] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]328worker2 # [ 0.005591] Normal empty329worker2 # [ 0.005591] Device empty330worker1 # [ 0.005939] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]331client # [ 0.003216] No NUMA configuration found332worker1 # [ 0.005941] Normal empty333lb # [ 0.002955] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]334worker2 # [ 0.005592] Movable zone start for each node335worker1 # [ 0.005942] Device empty336worker2 # [ 0.005593] Early memory node ranges337client # [ 0.003217] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]338worker1 # [ 0.005943] Movable zone start for each node339lb # [ 0.002955] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]340client # [ 0.003219] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]341worker1 # [ 0.005944] Early memory node ranges342worker2 # [ 0.005593] node 0: [mem 0x0000000000001000-0x000000000009efff]343client # [ 0.005573] Zone ranges:344lb # [ 0.002956] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]345worker1 # [ 0.005944] node 0: [mem 0x0000000000001000-0x000000000009efff]346worker2 # [ 0.005594] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]347client # [ 0.005574] DMA [mem 0x0000000000001000-0x0000000000ffffff]348lb # [ 0.002956] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]349worker1 # [ 0.005946] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]350worker2 # [ 0.005595] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]351client # [ 0.005576] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]352client # [ 0.005577] Normal empty353lb # [ 0.002956] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]354worker2 # [ 0.005619] On node 0, zone DMA: 1 pages in unavailable ranges355worker1 # [ 0.005948] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]356client # [ 0.005578] Device empty357client # [ 0.005579] Movable zone start for each node358lb # [ 0.002957] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]359worker1 # [ 0.005975] On node 0, zone DMA: 1 pages in unavailable ranges360worker2 # [ 0.005893] On node 0, zone DMA: 97 pages in unavailable ranges361client # [ 0.005580] Early memory node ranges362lb # [ 0.003195] No NUMA configuration found363worker2 # [ 0.033616] On node 0, zone DMA32: 40 pages in unavailable ranges364worker1 # [ 0.006319] On node 0, zone DMA: 97 pages in unavailable ranges365client # [ 0.005580] node 0: [mem 0x0000000000001000-0x000000000009efff]366worker2 # [ 0.034091] ACPI: PM-Timer IO Port: 0x608367lb # [ 0.003196] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]368worker1 # [ 0.035909] On node 0, zone DMA32: 40 pages in unavailable ranges369client # [ 0.005581] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]370worker2 # [ 0.034106] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])371lb # [ 0.003198] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]372worker1 # [ 0.036397] ACPI: PM-Timer IO Port: 0x608373lb # [ 0.005522] Zone ranges:374worker1 # [ 0.036414] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])375client # [ 0.005582] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]376worker2 # [ 0.034137] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23377lb # [ 0.005523] DMA [mem 0x0000000000001000-0x0000000000ffffff]378client # [ 0.005603] On node 0, zone DMA: 1 pages in unavailable ranges379worker2 # [ 0.034139] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)380worker1 # [ 0.036454] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23381lb # [ 0.005525] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]382client # [ 0.005884] On node 0, zone DMA: 97 pages in unavailable ranges383lb # [ 0.005526] Normal empty384worker2 # [ 0.034141] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)385worker1 # [ 0.036457] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)386lb # [ 0.005527] Device empty387client # [ 0.033762] On node 0, zone DMA32: 40 pages in unavailable ranges388lb # [ 0.005528] Movable zone start for each node389worker2 # [ 0.034142] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)390worker1 # [ 0.036458] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)391client # [ 0.034244] ACPI: PM-Timer IO Port: 0x608392lb # [ 0.005529] Early memory node ranges393worker2 # [ 0.034144] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)394client # [ 0.034258] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])395worker1 # [ 0.036460] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)396lb # [ 0.005529] node 0: [mem 0x0000000000001000-0x000000000009efff]397worker2 # [ 0.034144] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)398client # [ 0.034290] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23399worker1 # [ 0.036461] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)400lb # [ 0.005530] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]401client # [ 0.034293] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)402worker1 # [ 0.036462] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)403lb # [ 0.005531] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]404worker2 # [ 0.034147] ACPI: Using ACPI (MADT) for SMP configuration information405worker2 # [ 0.034148] ACPI: HPET id: 0x8086a201 base: 0xfed00000406client # [ 0.034295] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)407worker1 # [ 0.036464] ACPI: Using ACPI (MADT) for SMP configuration information408lb # [ 0.005553] On node 0, zone DMA: 1 pages in unavailable ranges409worker2 # [ 0.034153] TSC deadline timer available410worker1 # [ 0.036465] ACPI: HPET id: 0x8086a201 base: 0xfed00000411lb # [ 0.005821] On node 0, zone DMA: 97 pages in unavailable ranges412client # [ 0.034296] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)413worker2 # [ 0.034158] CPU topo: Max. logical packages: 1414worker1 # [ 0.036471] TSC deadline timer available415worker2 # [ 0.034159] CPU topo: Max. logical dies: 1416client # [ 0.034298] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)417worker1 # [ 0.036476] CPU topo: Max. logical packages: 1418lb # [ 0.033221] On node 0, zone DMA32: 40 pages in unavailable ranges419worker2 # [ 0.034159] CPU topo: Max. dies per package: 1420lb # [ 0.033692] ACPI: PM-Timer IO Port: 0x608421worker1 # [ 0.036476] CPU topo: Max. logical dies: 1422client # [ 0.034298] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)423lb # [ 0.033707] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])424worker2 # [ 0.034163] CPU topo: Max. threads per core: 1425worker1 # [ 0.036477] CPU topo: Max. dies per package: 1426client # [ 0.034301] ACPI: Using ACPI (MADT) for SMP configuration information427worker1 # [ 0.036480] CPU topo: Max. threads per core: 1428worker2 # [ 0.034164] CPU topo: Num. cores per package: 1429lb # [ 0.033733] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23430client # [ 0.034302] ACPI: HPET id: 0x8086a201 base: 0xfed00000431worker1 # [ 0.036481] CPU topo: Num. cores per package: 1432worker2 # [ 0.034164] CPU topo: Num. threads per package: 1433client # [ 0.034307] TSC deadline timer available434lb # [ 0.033735] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)435worker1 # [ 0.036481] CPU topo: Num. threads per package: 1436client # [ 0.034312] CPU topo: Max. logical packages: 1437worker2 # [ 0.034165] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs438lb # [ 0.033737] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)439client # [ 0.034313] CPU topo: Max. logical dies: 1440worker1 # [ 0.036493] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs441client # [ 0.034314] CPU topo: Max. dies per package: 1442lb # [ 0.033738] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)443worker2 # [ 0.034188] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()444worker1 # [ 0.036524] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()445client # [ 0.034317] CPU topo: Max. threads per core: 1446lb # [ 0.033740] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)447worker2 # [ 0.034224] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]448client # [ 0.034318] CPU topo: Num. cores per package: 1449worker1 # [ 0.036565] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]450lb # [ 0.033740] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)451client # [ 0.034318] CPU topo: Num. threads per package: 1452worker1 # [ 0.036566] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]453worker2 # [ 0.034225] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]454client # [ 0.034319] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs455lb # [ 0.033743] ACPI: Using ACPI (MADT) for SMP configuration information456worker1 # [ 0.036568] [mem 0x60000000-0xafffffff] available for PCI devices457worker2 # [ 0.034227] [mem 0x60000000-0xafffffff] available for PCI devices458lb # [ 0.033744] ACPI: HPET id: 0x8086a201 base: 0xfed00000459client # [ 0.034343] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()460worker1 # [ 0.036570] Booting paravirtualized kernel on KVM461lb # [ 0.033749] TSC deadline timer available462worker2 # [ 0.034229] Booting paravirtualized kernel on KVM463client # [ 0.034380] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]464lb # [ 0.033753] CPU topo: Max. logical packages: 1465lb # [ 0.033754] CPU topo: Max. logical dies: 1466worker1 # [ 0.036575] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns467client # [ 0.034382] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]468lb # [ 0.033755] CPU topo: Max. dies per package: 1469worker2 # [ 0.034233] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns470worker1 # [ 0.041081] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1471lb # [ 0.033760] CPU topo: Max. threads per core: 1472client # [ 0.034384] [mem 0x60000000-0xafffffff] available for PCI devices473worker2 # [ 0.038709] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1474client # [ 0.034385] Booting paravirtualized kernel on KVM475lb # [ 0.033761] CPU topo: Num. cores per package: 1476worker1 # [ 0.043401] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152477lb # [ 0.033762] CPU topo: Num. threads per package: 1478worker1 # [ 0.043452] kvm-guest: PV spinlocks disabled, single CPU479worker2 # [ 0.040829] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152480client # [ 0.034389] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns481lb # [ 0.033762] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs482worker2 # [ 0.040876] kvm-guest: PV spinlocks disabled, single CPU483client # [ 0.038890] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1484lb # [ 0.033786] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()485client # [ 0.041249] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152486lb # [ 0.033824] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]487client # [ 0.041298] kvm-guest: PV spinlocks disabled, single CPU488lb # [ 0.033825] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]489lb # [ 0.033827] [mem 0x60000000-0xafffffff] available for PCI devices490worker1 # [ 0.043454] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rvsngj39rzmaylbw0r3qiqzwv2igjh1n-nixos-system-worker1-test/init regInfo=/nix/store/r3vsrh4gibsjd93ai3f384ak7i0k5ajv-closure-info/registration console=ttyS0,115200n8 console=tty0491lb # [ 0.033829] Booting paravirtualized kernel on KVM492worker2 # [ 0.040878] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3wlw5bswpkdy4vjmzg1c10hvmwznrq47-nixos-system-worker2-test/init regInfo=/nix/store/fbifgg1m2lxf88xsfb1i43xcabqyik15-closure-info/registration console=ttyS0,115200n8 console=tty0493worker1 # [ 0.043566] Unknown kernel command line parameters "regInfo=/nix/store/r3vsrh4gibsjd93ai3f384ak7i0k5ajv-closure-info/registration", will be passed to user space.494lb # [ 0.033833] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns495worker1 # [ 0.043580] random: crng init done496client # [ 0.041300] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zhxi75b5nsabxqch8h65z6an848g1y3d-nixos-system-client-test/init regInfo=/nix/store/yyih6n0zkymmkrx5sbdz8k65ym6m6vqw-closure-info/registration console=ttyS0,115200n8 console=tty0497lb # [ 0.038319] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1498worker1 # [ 0.043581] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes499worker2 # [ 0.040975] Unknown kernel command line parameters "regInfo=/nix/store/fbifgg1m2lxf88xsfb1i43xcabqyik15-closure-info/registration", will be passed to user space.500lb # [ 0.040666] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152501worker2 # [ 0.040989] random: crng init done502worker1 # [ 0.046362] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)503lb # [ 0.040712] kvm-guest: PV spinlocks disabled, single CPU504client # [ 0.041399] Unknown kernel command line parameters "regInfo=/nix/store/yyih6n0zkymmkrx5sbdz8k65ym6m6vqw-closure-info/registration", will be passed to user space.505client # [ 0.041413] random: crng init done506worker2 # [ 0.040990] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes507worker1 # [ 0.047518] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)508client # [ 0.041414] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes509worker1 # [ 0.047560] Fallback order for Node 0: 0510worker2 # [ 0.043097] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)511worker1 # [ 0.047563] Built 1 zonelists, mobility grouping on. Total pages: 393078512client # [ 0.043500] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)513worker1 # [ 0.047565] Policy zone: DMA32514worker2 # [ 0.044459] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)515client # [ 0.044544] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)516worker1 # [ 0.050219] mem auto-init: stack:all(zero), heap alloc:on, heap free:off517worker2 # [ 0.044497] Fallback order for Node 0: 0518client # [ 0.044582] Fallback order for Node 0: 0519lb # [ 0.040714] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8fdxjbikvaji18xgirrp6mfk844mip85-nixos-system-lb-test/init regInfo=/nix/store/8716l27kqqvxrr52shr1gfnbwraiag7w-closure-info/registration console=ttyS0,115200n8 console=tty0520worker1 # [ 0.053912] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1521client # [ 0.044585] Built 1 zonelists, mobility grouping on. Total pages: 393078522worker2 # [ 0.044500] Built 1 zonelists, mobility grouping on. Total pages: 393078523worker1 # [ 0.057528] allocated 3145728 bytes of page_ext524client # [ 0.044586] Policy zone: DMA32525worker2 # [ 0.044501] Policy zone: DMA32526worker1 # [ 0.068425] ftrace: allocating 48731 entries in 192 pages527lb # [ 0.040812] Unknown kernel command line parameters "regInfo=/nix/store/8716l27kqqvxrr52shr1gfnbwraiag7w-closure-info/registration", will be passed to user space.528client # [ 0.047054] mem auto-init: stack:all(zero), heap alloc:on, heap free:off529worker2 # [ 0.046962] mem auto-init: stack:all(zero), heap alloc:on, heap free:off530lb # [ 0.040826] random: crng init done531worker1 # [ 0.068427] ftrace: allocated 192 pages with 2 groups532client # [ 0.050465] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1533worker1 # [ 0.069713] Dynamic Preempt: lazy534worker2 # [ 0.050407] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1535lb # [ 0.040827] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes536client # [ 0.054247] allocated 3145728 bytes of page_ext537worker1 # [ 0.069898] rcu: Preemptible hierarchical RCU implementation.538worker2 # [ 0.053704] allocated 3145728 bytes of page_ext539client # [ 0.064812] ftrace: allocating 48731 entries in 192 pages540lb # [ 0.042946] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)541worker1 # [ 0.069898] rcu: RCU event tracing is enabled.542client # [ 0.064815] ftrace: allocated 192 pages with 2 groups543worker2 # [ 0.064135] ftrace: allocating 48731 entries in 192 pages544client # [ 0.065760] Dynamic Preempt: lazy545worker1 # [ 0.069899] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.546lb # [ 0.044019] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)547worker2 # [ 0.064138] ftrace: allocated 192 pages with 2 groups548lb # [ 0.044067] Fallback order for Node 0: 0549client # [ 0.065891] rcu: Preemptible hierarchical RCU implementation.550worker1 # [ 0.069901] Trampoline variant of Tasks RCU enabled.551worker2 # [ 0.065042] Dynamic Preempt: lazy552client # [ 0.065891] rcu: RCU event tracing is enabled.553worker1 # [ 0.069901] Rude variant of Tasks RCU enabled.554lb # [ 0.044072] Built 1 zonelists, mobility grouping on. Total pages: 393078555worker2 # [ 0.065167] rcu: Preemptible hierarchical RCU implementation.556lb # [ 0.044073] Policy zone: DMA32557worker1 # [ 0.069902] Tracing variant of Tasks RCU enabled.558client # [ 0.065892] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.559worker2 # [ 0.065167] rcu: RCU event tracing is enabled.560client # [ 0.065894] Trampoline variant of Tasks RCU enabled.561lb # [ 0.046610] mem auto-init: stack:all(zero), heap alloc:on, heap free:off562worker1 # [ 0.069902] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.563client # [ 0.065895] Rude variant of Tasks RCU enabled.564worker2 # [ 0.065168] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.565lb # [ 0.050071] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1566client # [ 0.065895] Tracing variant of Tasks RCU enabled.567worker1 # [ 0.069903] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1568lb # [ 0.053524] allocated 3145728 bytes of page_ext569worker2 # [ 0.065169] Trampoline variant of Tasks RCU enabled.570lb # [ 0.064148] ftrace: allocating 48731 entries in 192 pages571worker2 # [ 0.065170] Rude variant of Tasks RCU enabled.572worker1 # [ 0.069965] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.573client # [ 0.065896] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.574lb # [ 0.064151] ftrace: allocated 192 pages with 2 groups575worker2 # [ 0.065170] Tracing variant of Tasks RCU enabled.576client # [ 0.065897] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1577lb # [ 0.065122] Dynamic Preempt: lazy578worker1 # [ 0.069967] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.579lb # [ 0.065259] rcu: Preemptible hierarchical RCU implementation.580worker2 # [ 0.065171] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.581client # [ 0.065912] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.582lb # [ 0.065259] rcu: RCU event tracing is enabled.583worker1 # [ 0.069968] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.584worker2 # [ 0.065172] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1585client # [ 0.065914] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.586lb # [ 0.065260] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.587worker1 # [ 0.074429] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16588lb # [ 0.065262] Trampoline variant of Tasks RCU enabled.589worker2 # [ 0.065195] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.590client # [ 0.065915] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.591worker1 # [ 0.074724] rcu: srcu_init: Setting srcu_struct sizes based on contention.592lb # [ 0.065262] Rude variant of Tasks RCU enabled.593client # [ 0.070283] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16594lb # [ 0.065263] Tracing variant of Tasks RCU enabled.595worker2 # [ 0.065197] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.596worker1 # [ 0.074733] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns597client # [ 0.070567] rcu: srcu_init: Setting srcu_struct sizes based on contention.598lb # [ 0.065263] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.599worker2 # [ 0.065198] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.600lb # [ 0.065264] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1601client # [ 0.070576] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns602worker1 # [ 0.074849] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)603worker1 # [ 0.078418] Console: colour VGA+ 80x25604worker2 # [ 0.069856] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16605worker1 # [ 0.078421] printk: legacy console [tty0] enabled606lb # [ 0.065321] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.607client # [ 0.070699] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)608worker1 # [ 0.108190] printk: legacy console [ttyS0] enabled609client # [ 0.074258] Console: colour VGA+ 80x25610worker2 # [ 0.070139] rcu: srcu_init: Setting srcu_struct sizes based on contention.611lb # [ 0.065323] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.612client # [ 0.074262] printk: legacy console [tty0] enabled613worker1 # [ 0.208914] ACPI: Core revision 20250807614client # [ 0.103783] printk: legacy console [ttyS0] enabled615worker2 # [ 0.070148] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns616lb # [ 0.065324] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.617client # [ 0.201282] ACPI: Core revision 20250807618lb # [ 0.069831] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16619worker1 # [ 0.209882] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns620worker2 # [ 0.070260] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)621lb # [ 0.070143] rcu: srcu_init: Setting srcu_struct sizes based on contention.622worker2 # [ 0.073803] Console: colour VGA+ 80x25623client # [ 0.202163] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns624worker1 # [ 0.211625] APIC: Switch to symmetric I/O mode setup625worker2 # [ 0.073807] printk: legacy console [tty0] enabled626worker1 # [ 0.212680] x2apic enabled627lb # [ 0.070150] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns628client # [ 0.203736] APIC: Switch to symmetric I/O mode setup629worker2 # [ 0.103312] printk: legacy console [ttyS0] enabled630client # [ 0.204709] x2apic enabled631worker1 # [ 0.213458] APIC: Switched APIC routing to: physical x2apic632lb # [ 0.070265] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)633worker2 # [ 0.208914] ACPI: Core revision 20250807634lb # [ 0.073856] Console: colour VGA+ 80x25635client # [ 0.205470] APIC: Switched APIC routing to: physical x2apic636lb # [ 0.073860] printk: legacy console [tty0] enabled637lb # [ 0.103379] printk: legacy console [ttyS0] enabled638worker2 # [ 0.209999] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns639worker1 # [ 0.215981] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1640client # [ 0.207352] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1641lb # [ 0.202836] ACPI: Core revision 20250807642worker2 # [ 0.211768] APIC: Switch to symmetric I/O mode setup643worker2 # [ 0.212928] x2apic enabled644client # [ 0.208334] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns645worker1 # [ 0.217051] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns646lb # [ 0.203712] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns647worker2 # [ 0.213786] APIC: Switched APIC routing to: physical x2apic648lb # [ 0.205396] APIC: Switch to symmetric I/O mode setup649client # [ 0.210000] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)650worker1 # [ 0.218854] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)651lb # [ 0.206399] x2apic enabled652client # [ 0.211087] x86/cpu: User Mode Instruction Prevention (UMIP) activated653worker1 # [ 0.219946] x86/cpu: User Mode Instruction Prevention (UMIP) activated654lb # [ 0.207201] APIC: Switched APIC routing to: physical x2apic655worker2 # [ 0.215838] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1656client # [ 0.212201] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127657worker1 # [ 0.221993] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127658client # [ 0.213727] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0659lb # [ 0.209175] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1660worker2 # [ 0.217074] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns661worker1 # [ 0.222852] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0662client # [ 0.215001] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto663lb # [ 0.210269] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns664worker2 # [ 0.219104] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)665worker1 # [ 0.223857] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto666client # [ 0.215997] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl667lb # [ 0.212043] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)668worker2 # [ 0.220212] x86/cpu: User Mode Instruction Prevention (UMIP) activated669worker1 # [ 0.225851] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl670client # [ 0.217997] Transient Scheduler Attacks: Vulnerable: No microcode671lb # [ 0.214133] x86/cpu: User Mode Instruction Prevention (UMIP) activated672worker2 # [ 0.221266] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127673client # [ 0.218996] Spectre V2 : Mitigation: Enhanced / Automatic IBRS674worker1 # [ 0.226851] Transient Scheduler Attacks: Vulnerable: No microcode675lb # [ 0.215218] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127676worker2 # [ 0.222102] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0677client # [ 0.219997] Speculative Return Stack Overflow: Mitigation: Safe RET678worker1 # [ 0.227851] Spectre V2 : Mitigation: Enhanced / Automatic IBRS679lb # [ 0.216040] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0680worker1 # [ 0.228851] Speculative Return Stack Overflow: Mitigation: Safe RET681worker2 # [ 0.223910] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto682lb # [ 0.217044] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto683worker2 # [ 0.225099] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl684worker2 # [ 0.226100] Transient Scheduler Attacks: Vulnerable: No microcode685lb # [ 0.219039] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl686client # [ 0.220997] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization687worker2 # [ 0.227841] Spectre V2 : Mitigation: Enhanced / Automatic IBRS688client # [ 0.223004] Spectre V2 : Enabling IBPB for BPF689lb # [ 0.220039] Transient Scheduler Attacks: Vulnerable: No microcode690worker1 # [ 0.229850] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization691worker2 # [ 0.228784] Speculative Return Stack Overflow: Mitigation: Safe RET692lb # [ 0.221762] Spectre V2 : Mitigation: Enhanced / Automatic IBRS693client # [ 0.223998] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier694worker1 # [ 0.231861] Spectre V2 : Enabling IBPB for BPF695lb # [ 0.222742] Speculative Return Stack Overflow: Mitigation: Safe RET696client # [ 0.224997] active return thunk: srso_alias_return_thunk697worker1 # [ 0.233423] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier698client # [ 0.226018] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'699worker1 # [ 0.233852] active return thunk: srso_alias_return_thunk700client # [ 0.226996] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'701worker2 # [ 0.229826] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization702worker1 # [ 0.234875] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'703client # [ 0.227997] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'704worker2 # [ 0.231107] Spectre V2 : Enabling IBPB for BPF705lb # [ 0.223806] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization706client # [ 0.228997] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'707worker1 # [ 0.235851] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'708worker2 # [ 0.232100] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier709lb # [ 0.225047] Spectre V2 : Enabling IBPB for BPF710client # [ 0.229997] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'711worker1 # [ 0.236850] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'712worker2 # [ 0.233100] active return thunk: srso_alias_return_thunk713lb # [ 0.226584] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier714client # [ 0.230996] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'715worker1 # [ 0.237850] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'716worker2 # [ 0.234121] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'717lb # [ 0.227040] active return thunk: srso_alias_return_thunk718worker1 # [ 0.238850] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'719client # [ 0.231997] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'720worker2 # [ 0.235099] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'721lb # [ 0.228698] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'722client # [ 0.232997] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256723worker1 # [ 0.239850] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'724worker2 # [ 0.236099] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'725lb # [ 0.230039] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'726client # [ 0.233996] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64727worker2 # [ 0.237100] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'728worker1 # [ 0.240850] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'729client # [ 0.234996] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512730lb # [ 0.231039] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'731worker2 # [ 0.238099] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'732worker1 # [ 0.241852] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256733client # [ 0.235996] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024734lb # [ 0.232039] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'735worker2 # [ 0.239099] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'736worker1 # [ 0.243583] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64737client # [ 0.236996] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8738lb # [ 0.233039] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'739worker1 # [ 0.244612] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512740worker2 # [ 0.240099] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'741lb # [ 0.233991] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'742client # [ 0.237997] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.743worker1 # [ 0.245596] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024744worker2 # [ 0.241100] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256745lb # [ 0.235038] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'746worker2 # [ 0.242808] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64747worker1 # [ 0.246610] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8748lb # [ 0.236039] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256749worker2 # [ 0.243099] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512750worker1 # [ 0.247620] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.751lb # [ 0.237038] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64752worker2 # [ 0.244099] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024753lb # [ 0.238038] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512754worker2 # [ 0.245099] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8755lb # [ 0.239039] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024756worker2 # [ 0.246099] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.757lb # [ 0.240039] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8758lb # [ 0.241038] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.759client # [ 0.274890] Freeing SMP alternatives memory: 44K760client # [ 0.275560] pid_max: default: 32768 minimum: 301761client # [ 0.276099] LSM: initializing lsm=capability,landlock,yama,bpf,ima762client # [ 0.277113] landlock: Up and running.763client # [ 0.277997] Yama: becoming mindful.764client # [ 0.279201] LSM support for eBPF active765worker1 # [ 0.286858] Freeing SMP alternatives memory: 44K766client # [ 0.280016] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)767worker2 # [ 0.283333] Freeing SMP alternatives memory: 44K768worker1 # [ 0.287725] pid_max: default: 32768 minimum: 301769worker2 # [ 0.284103] pid_max: default: 32768 minimum: 301770client # [ 0.281034] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)771worker1 # [ 0.288538] LSM: initializing lsm=capability,landlock,yama,bpf,ima772worker2 # [ 0.284920] LSM: initializing lsm=capability,landlock,yama,bpf,ima773worker1 # [ 0.289874] landlock: Up and running.774worker2 # [ 0.285944] landlock: Up and running.775lb # [ 0.279169] Freeing SMP alternatives memory: 44K776worker1 # [ 0.290543] Yama: becoming mindful.777worker2 # [ 0.286527] Yama: becoming mindful.778client # [ 0.283595] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)779lb # [ 0.279953] pid_max: default: 32768 minimum: 301780worker1 # [ 0.291081] LSM support for eBPF active781worker2 # [ 0.287321] LSM support for eBPF active782lb # [ 0.280675] LSM: initializing lsm=capability,landlock,yama,bpf,ima783worker2 # [ 0.288199] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)784client # [ 0.284527] Performance Events: Fam17h+ core perfctr, AMD PMU driver.785worker1 # [ 0.292001] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)786lb # [ 0.281161] landlock: Up and running.787client # [ 0.285002] ... version: 2788lb # [ 0.282480] Yama: becoming mindful.789worker2 # [ 0.289137] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)790client # [ 0.285707] ... bit width: 48791worker1 # [ 0.292894] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)792lb # [ 0.283263] LSM support for eBPF active793client # [ 0.285999] ... generic counters: 6794client # [ 0.286669] ... generic bitmap: 000000000000003f795lb # [ 0.284157] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)796worker2 # [ 0.291744] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)797client # [ 0.287009] ... fixed-purpose counters: 0798worker1 # [ 0.296007] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)799lb # [ 0.285082] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)800client # [ 0.287704] ... fixed-purpose bitmap: 0000000000000000801worker2 # [ 0.292643] Performance Events: Fam17h+ core perfctr, AMD PMU driver.802client # [ 0.287999] ... value mask: 0000ffffffffffff803worker1 # [ 0.297498] Performance Events: Fam17h+ core perfctr, AMD PMU driver.804worker2 # [ 0.293105] ... version: 2805client # [ 0.288863] ... max period: 00007fffffffffff806worker2 # [ 0.293809] ... bit width: 48807worker1 # [ 0.297861] ... version: 2808lb # [ 0.287751] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)809client # [ 0.289643] ... global_ctrl mask: 000000000000003f810worker2 # [ 0.294102] ... generic counters: 6811worker1 # [ 0.298619] ... bit width: 48812client # [ 0.290121] signal: max sigframe size: 3376813worker1 # [ 0.298853] ... generic counters: 6814worker2 # [ 0.294777] ... generic bitmap: 000000000000003f815lb # [ 0.288587] Performance Events: Fam17h+ core perfctr, AMD PMU driver.816client # [ 0.290910] rcu: Hierarchical SRCU implementation.817worker2 # [ 0.295115] ... fixed-purpose counters: 0818worker1 # [ 0.299558] ... generic bitmap: 000000000000003f819lb # [ 0.289044] ... version: 2820client # [ 0.291574] rcu: Max phase no-delay instances is 400.821worker2 # [ 0.295792] ... fixed-purpose bitmap: 0000000000000000822worker1 # [ 0.299853] ... fixed-purpose counters: 0823lb # [ 0.289752] ... bit width: 48824worker2 # [ 0.296102] ... value mask: 0000ffffffffffff825lb # [ 0.290042] ... generic counters: 6826worker1 # [ 0.300576] ... fixed-purpose bitmap: 0000000000000000827worker2 # [ 0.296960] ... max period: 00007fffffffffff828lb # [ 0.290736] ... generic bitmap: 000000000000003f829worker1 # [ 0.300852] ... value mask: 0000ffffffffffff830worker2 # [ 0.297743] ... global_ctrl mask: 000000000000003f831lb # [ 0.291094] ... fixed-purpose counters: 0832worker1 # [ 0.301794] ... max period: 00007fffffffffff833worker2 # [ 0.298256] signal: max sigframe size: 3376834lb # [ 0.291812] ... fixed-purpose bitmap: 0000000000000000835worker1 # [ 0.302586] ... global_ctrl mask: 000000000000003f836worker2 # [ 0.299019] rcu: Hierarchical SRCU implementation.837lb # [ 0.292042] ... value mask: 0000ffffffffffff838worker1 # [ 0.302964] signal: max sigframe size: 3376839worker2 # [ 0.299675] rcu: Max phase no-delay instances is 400.840lb # [ 0.292948] ... max period: 00007fffffffffff841client # [ 0.296631] smp: Bringing up secondary CPUs ...842worker1 # [ 0.303824] rcu: Hierarchical SRCU implementation.843client # [ 0.297014] smp: Brought up 1 node, 1 CPU844lb # [ 0.293722] ... global_ctrl mask: 000000000000003f845worker1 # [ 0.304440] rcu: Max phase no-delay instances is 400.846client # [ 0.297697] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)847lb # [ 0.294160] signal: max sigframe size: 3376848lb # [ 0.295031] rcu: Hierarchical SRCU implementation.849lb # [ 0.295677] rcu: Max phase no-delay instances is 400.850client # [ 0.298238] Memory: 1454612K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)851client # [ 0.299259] devtmpfs: initialized852worker2 # [ 0.304691] smp: Bringing up secondary CPUs ...853worker2 # [ 0.305116] smp: Brought up 1 node, 1 CPU854client # [ 0.300083] x86/mm: Memory block size: 128MB855worker2 # [ 0.305777] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)856worker1 # [ 0.309775] smp: Bringing up secondary CPUs ...857worker1 # [ 0.310437] smp: Brought up 1 node, 1 CPU858client # [ 0.301838] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)859worker1 # [ 0.310855] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)860worker2 # [ 0.306253] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)861lb # [ 0.300701] smp: Bringing up secondary CPUs ...862client # [ 0.302867] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).863lb # [ 0.301056] smp: Brought up 1 node, 1 CPU864worker2 # [ 0.307380] devtmpfs: initialized865client # [ 0.304095] pinctrl core: initialized pinctrl subsystem866worker2 # [ 0.308143] x86/mm: Memory block size: 128MB867lb # [ 0.301729] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)868worker1 # [ 0.312069] Memory: 1454544K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)869client # [ 0.305121] PM: RTC time: 07:56:09, date: 2026-09-20870worker1 # [ 0.313186] devtmpfs: initialized871worker2 # [ 0.309862] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)872worker1 # [ 0.314024] x86/mm: Memory block size: 128MB873lb # [ 0.302170] Memory: 1454540K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)874lb # [ 0.303296] devtmpfs: initialized875worker2 # [ 0.310962] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).876lb # [ 0.304177] x86/mm: Memory block size: 128MB877worker2 # [ 0.312200] pinctrl core: initialized pinctrl subsystem878worker1 # [ 0.315819] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)879client # [ 0.308939] NET: Registered PF_NETLINK/PF_ROUTE protocol family880worker2 # [ 0.313281] PM: RTC time: 07:56:09, date: 2026-09-20881worker1 # [ 0.316763] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).882client # [ 0.310199] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations883lb # [ 0.305977] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)884worker1 # [ 0.317937] pinctrl core: initialized pinctrl subsystem885client # [ 0.311021] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations886lb # [ 0.306940] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).887worker1 # [ 0.319137] PM: RTC time: 07:56:09, date: 2026-09-20888lb # [ 0.308136] pinctrl core: initialized pinctrl subsystem889client # [ 0.312293] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations890worker2 # [ 0.316762] NET: Registered PF_NETLINK/PF_ROUTE protocol family891client # [ 0.313012] audit: initializing netlink subsys (disabled)892lb # [ 0.309256] PM: RTC time: 07:56:09, date: 2026-09-20893worker2 # [ 0.317616] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations894client # [ 0.314164] thermal_sys: Registered thermal governor 'fair_share'895worker2 # [ 0.318131] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations896client # [ 0.314166] thermal_sys: Registered thermal governor 'bang_bang'897worker1 # [ 0.322883] NET: Registered PF_NETLINK/PF_ROUTE protocol family898client # [ 0.315000] thermal_sys: Registered thermal governor 'step_wise'899worker2 # [ 0.319367] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations900worker1 # [ 0.324418] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations901client # [ 0.315929] thermal_sys: Registered thermal governor 'user_space'902lb # [ 0.313099] NET: Registered PF_NETLINK/PF_ROUTE protocol family903worker2 # [ 0.320112] audit: initializing netlink subsys (disabled)904worker1 # [ 0.324888] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations905client # [ 0.316727] audit: type=2000 audit(1789890970.255:1): state=initialized audit_enabled=0 res=1906worker2 # [ 0.321198] thermal_sys: Registered thermal governor 'fair_share'907lb # [ 0.314520] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations908client # [ 0.318002] thermal_sys: Registered thermal governor 'power_allocator'909worker2 # [ 0.321200] thermal_sys: Registered thermal governor 'bang_bang'910worker1 # [ 0.326150] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations911lb # [ 0.315064] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations912client # [ 0.318018] cpuidle: using governor menu913worker2 # [ 0.322102] thermal_sys: Registered thermal governor 'step_wise'914worker1 # [ 0.326866] audit: initializing netlink subsys (disabled)915worker2 # [ 0.323007] thermal_sys: Registered thermal governor 'user_space'916client # [ 0.320199] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5917lb # [ 0.316331] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations918worker1 # [ 0.328060] thermal_sys: Registered thermal governor 'fair_share'919lb # [ 0.317052] audit: initializing netlink subsys (disabled)920worker2 # [ 0.323796] audit: type=2000 audit(1789890970.249:1): state=initialized audit_enabled=0 res=1921worker1 # [ 0.328062] thermal_sys: Registered thermal governor 'bang_bang'922client # [ 0.321247] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]923worker2 # [ 0.325104] thermal_sys: Registered thermal governor 'power_allocator'924lb # [ 0.318043] audit: type=2000 audit(1789890970.261:1): state=initialized audit_enabled=0 res=1925worker1 # [ 0.328854] thermal_sys: Registered thermal governor 'step_wise'926client # [ 0.322003] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry927worker2 # [ 0.325128] cpuidle: using governor menu928worker1 # [ 0.329828] thermal_sys: Registered thermal governor 'user_space'929lb # [ 0.319194] thermal_sys: Registered thermal governor 'fair_share'930client # [ 0.323012] PCI: Using configuration type 1 for base access931worker2 # [ 0.327124] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5932lb # [ 0.319196] thermal_sys: Registered thermal governor 'bang_bang'933worker1 # [ 0.330577] audit: type=2000 audit(1789890970.255:1): state=initialized audit_enabled=0 res=1934client # [ 0.324094] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.935lb # [ 0.320042] thermal_sys: Registered thermal governor 'step_wise'936worker1 # [ 0.331858] thermal_sys: Registered thermal governor 'power_allocator'937worker2 # [ 0.328354] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]938lb # [ 0.320960] thermal_sys: Registered thermal governor 'user_space'939worker1 # [ 0.331893] cpuidle: using governor menu940worker2 # [ 0.329105] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry941lb # [ 0.321811] thermal_sys: Registered thermal governor 'power_allocator'942worker2 # [ 0.330114] PCI: Using configuration type 1 for base access943worker1 # [ 0.334153] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5944lb # [ 0.322068] cpuidle: using governor menu945worker2 # [ 0.331210] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.946lb # [ 0.324274] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5947worker1 # [ 0.335135] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]948worker1 # [ 0.335856] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry949lb # [ 0.325278] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]950worker1 # [ 0.336866] PCI: Using configuration type 1 for base access951client # [ 0.331243] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages952lb # [ 0.326045] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry953lb # [ 0.327054] PCI: Using configuration type 1 for base access954client # [ 0.332001] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page955worker1 # [ 0.338031] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.956lb # [ 0.328146] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.957worker2 # [ 0.338379] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages958worker2 # [ 0.339103] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page959client # [ 0.337001] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages960worker1 # [ 0.342958] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages961client # [ 0.338001] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page962worker1 # [ 0.343855] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page963lb # [ 0.335060] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages964worker2 # [ 0.344103] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages965lb # [ 0.336042] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page966worker2 # [ 0.345102] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page967worker1 # [ 0.348854] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages968worker1 # [ 0.349852] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page969client # [ 0.346597] ACPI: Added _OSI(Module Device)970lb # [ 0.341042] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages971client # [ 0.347001] ACPI: Added _OSI(Processor Device)972lb # [ 0.342043] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page973client # [ 0.347769] ACPI: Added _OSI(Processor Aggregator Device)974worker2 # [ 0.353753] ACPI: Added _OSI(Module Device)975worker2 # [ 0.354103] ACPI: Added _OSI(Processor Device)976worker2 # [ 0.354869] ACPI: Added _OSI(Processor Aggregator Device)977worker1 # [ 0.360277] ACPI: Added _OSI(Module Device)978worker1 # [ 0.360855] ACPI: Added _OSI(Processor Device)979client # [ 0.354591] ACPI: 1 ACPI AML tables successfully acquired and loaded980worker1 # [ 0.361569] ACPI: Added _OSI(Processor Aggregator Device)981lb # [ 0.353316] ACPI: Added _OSI(Module Device)982client # [ 0.357964] ACPI: Interpreter enabled983lb # [ 0.354043] ACPI: Added _OSI(Processor Device)984client # [ 0.358470] ACPI: PM: (supports S0 S3 S4 S5)985worker2 # [ 0.361676] ACPI: 1 ACPI AML tables successfully acquired and loaded986lb # [ 0.354768] ACPI: Added _OSI(Processor Aggregator Device)987client # [ 0.359000] ACPI: Using IOAPIC for interrupt routing988client # [ 0.359875] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug989worker2 # [ 0.365061] ACPI: Interpreter enabled990worker2 # [ 0.365591] ACPI: PM: (supports S0 S3 S4 S5)991worker2 # [ 0.366102] ACPI: Using IOAPIC for interrupt routing992worker1 # [ 0.370364] ACPI: 1 ACPI AML tables successfully acquired and loaded993worker2 # [ 0.366992] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug994client # [ 0.364999] PCI: Using E820 reservations for host bridge windows995lb # [ 0.360778] ACPI: 1 ACPI AML tables successfully acquired and loaded996client # [ 0.366123] ACPI: Enabled 2 GPEs in block 00 to 3F997worker1 # [ 0.374261] ACPI: Interpreter enabled998worker1 # [ 0.374871] ACPI: PM: (supports S0 S3 S4 S5)999lb # [ 0.364452] ACPI: Interpreter enabled1000worker1 # [ 0.375645] ACPI: Using IOAPIC for interrupt routing1001worker2 # [ 0.372102] PCI: Using E820 reservations for host bridge windows1002lb # [ 0.365058] ACPI: PM: (supports S0 S3 S4 S5)1003worker2 # [ 0.373162] ACPI: Enabled 2 GPEs in block 00 to 3F1004lb # [ 0.365788] ACPI: Using IOAPIC for interrupt routing1005worker1 # [ 0.377909] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1006worker1 # [ 0.378854] PCI: Using E820 reservations for host bridge windows1007lb # [ 0.368109] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1008client # [ 0.374870] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1009lb # [ 0.369042] PCI: Using E820 reservations for host bridge windows1010worker1 # [ 0.381967] ACPI: Enabled 2 GPEs in block 00 to 3F1011client # [ 0.376577] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1012lb # [ 0.372181] ACPI: Enabled 2 GPEs in block 00 to 3F1013client # [ 0.377078] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1014worker2 # [ 0.381810] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1015client # [ 0.378122] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1016client # [ 0.379398] PCI host bridge to bus 0000:001017worker2 # [ 0.382790] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1018client # [ 0.380004] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1019worker2 # [ 0.384199] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1020client # [ 0.381001] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1021worker2 # [ 0.385227] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1022client # [ 0.381999] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1023worker2 # [ 0.386487] PCI host bridge to bus 0000:001024worker1 # [ 0.390022] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1025client # [ 0.382999] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1026worker2 # [ 0.387106] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1027lb # [ 0.379898] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1028worker1 # [ 0.390858] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1029client # [ 0.383999] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1030worker2 # [ 0.388102] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1031lb # [ 0.380773] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1032worker1 # [ 0.391932] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1033client # [ 0.384999] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1034worker2 # [ 0.389102] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1035client # [ 0.386000] pci_bus 0000:00: root bus resource [bus 00-ff]1036lb # [ 0.382122] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1037worker1 # [ 0.392974] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1038worker2 # [ 0.390102] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1039worker1 # [ 0.394225] PCI host bridge to bus 0000:001040lb # [ 0.383166] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1041client # [ 0.386965] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1042worker2 # [ 0.391101] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1043worker1 # [ 0.394856] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1044lb # [ 0.384420] PCI host bridge to bus 0000:001045worker2 # [ 0.392113] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1046worker1 # [ 0.395853] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1047client # [ 0.388408] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1048lb # [ 0.385046] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1049worker2 # [ 0.393102] pci_bus 0000:00: root bus resource [bus 00-ff]1050lb # [ 0.386042] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1051worker1 # [ 0.396852] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1052worker2 # [ 0.394129] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1053lb # [ 0.387042] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1054worker1 # [ 0.397853] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1055lb # [ 0.388041] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1056worker1 # [ 0.398858] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1057worker2 # [ 0.395572] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1058lb # [ 0.389041] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1059worker1 # [ 0.399853] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1060worker1 # [ 0.400883] pci_bus 0000:00: root bus resource [bus 00-ff]1061lb # [ 0.390041] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1062lb # [ 0.391042] pci_bus 0000:00: root bus resource [bus 00-ff]1063worker1 # [ 0.401962] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1064lb # [ 0.392052] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1065client # [ 0.391079] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1066worker1 # [ 0.403318] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1067client # [ 0.392012] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1068lb # [ 0.393500] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1069client # [ 0.393044] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1070worker2 # [ 0.398280] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1071client # [ 0.394331] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1072worker2 # [ 0.399162] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1073client # [ 0.395727] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1074worker2 # [ 0.400124] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1075worker2 # [ 0.401445] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1076client # [ 0.398034] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1077client # [ 0.398930] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1078lb # [ 0.396134] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1079worker2 # [ 0.402887] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1080worker1 # [ 0.405930] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1081client # [ 0.399731] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1082lb # [ 0.397055] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1083worker1 # [ 0.406865] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1084client # [ 0.400006] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1085lb # [ 0.398013] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1086worker1 # [ 0.407875] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1087worker2 # [ 0.406131] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1088lb # [ 0.399264] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1089worker2 # [ 0.407022] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1090client # [ 0.401802] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1091worker1 # [ 0.409099] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1092worker2 # [ 0.407833] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1093lb # [ 0.400798] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1094worker1 # [ 0.410660] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1095client # [ 0.404032] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1096worker2 # [ 0.408108] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1097client # [ 0.404842] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1098worker2 # [ 0.409731] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1099client # [ 0.405761] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1100lb # [ 0.404066] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1101worker1 # [ 0.413881] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1102lb # [ 0.404993] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1103client # [ 0.407423] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1104worker1 # [ 0.414791] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1105lb # [ 0.405775] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1106worker2 # [ 0.412085] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1107lb # [ 0.406048] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1108worker1 # [ 0.415607] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1109worker2 # [ 0.412740] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1110worker1 # [ 0.416859] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1111worker2 # [ 0.413123] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1112lb # [ 0.407783] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1113client # [ 0.410007] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1114worker1 # [ 0.418436] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1115worker2 # [ 0.414676] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1116client # [ 0.411006] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1117lb # [ 0.410050] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1118client # [ 0.411965] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1119lb # [ 0.410924] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1120worker1 # [ 0.420790] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1121lb # [ 0.411819] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1122client # [ 0.413460] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1123worker1 # [ 0.421577] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1124worker2 # [ 0.418051] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1125worker2 # [ 0.418720] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1126worker1 # [ 0.421875] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1127lb # [ 0.413446] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1128client # [ 0.415034] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1129worker2 # [ 0.419124] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1130client # [ 0.415893] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1131worker1 # [ 0.423457] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1132worker2 # [ 0.420662] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1133client # [ 0.416762] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1134lb # [ 0.416059] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1135lb # [ 0.416965] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1136worker1 # [ 0.425880] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1137client # [ 0.417555] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1138worker2 # [ 0.422941] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1139lb # [ 0.417841] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1140worker1 # [ 0.426700] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1141worker2 # [ 0.423711] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1142worker1 # [ 0.427596] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1143lb # [ 0.419419] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1144client # [ 0.420033] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1145worker2 # [ 0.424123] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1146client # [ 0.420931] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1147worker1 # [ 0.428452] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1148client # [ 0.421783] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1149worker2 # [ 0.425680] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1150lb # [ 0.422051] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1151lb # [ 0.422921] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1152client # [ 0.423601] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1153worker2 # [ 0.427918] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1154lb # [ 0.423803] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1155worker1 # [ 0.430880] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1156worker2 # [ 0.428736] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1157worker1 # [ 0.432587] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1158worker2 # [ 0.429124] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1159lb # [ 0.425602] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1160client # [ 0.425964] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1161worker1 # [ 0.432876] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1162client # [ 0.427006] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1163worker2 # [ 0.430707] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1164lb # [ 0.427072] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1165client # [ 0.427983] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1166worker1 # [ 0.434407] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1167lb # [ 0.427906] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1168lb # [ 0.428823] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1169client # [ 0.429438] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1170worker1 # [ 0.435868] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1171worker2 # [ 0.433110] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1172worker1 # [ 0.436756] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1173lb # [ 0.430521] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1174client # [ 0.431007] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1175worker2 # [ 0.434699] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1176worker1 # [ 0.437564] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1177client # [ 0.431863] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1178worker2 # [ 0.435123] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1179client # [ 0.432760] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1180client # [ 0.433005] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1181worker1 # [ 0.438451] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1182worker2 # [ 0.436728] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1183lb # [ 0.433240] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1184lb # [ 0.434048] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1185client # [ 0.435161] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1186lb # [ 0.435063] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1187worker2 # [ 0.438881] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1188worker1 # [ 0.441837] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1189worker2 # [ 0.439740] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1190worker1 # [ 0.442494] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1191client # [ 0.436877] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1192lb # [ 0.436684] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1193worker2 # [ 0.440123] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1194worker1 # [ 0.442875] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1195client # [ 0.437741] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1196lb # [ 0.438071] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1197worker1 # [ 0.444422] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1198worker2 # [ 0.441107] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1199client # [ 0.438538] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1200lb # [ 0.438926] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1201lb # [ 0.439769] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1202worker2 # [ 0.442907] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1203client # [ 0.440007] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1204lb # [ 0.440048] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1205worker1 # [ 0.446853] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1206worker2 # [ 0.445116] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1207worker1 # [ 0.448511] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1208client # [ 0.441014] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1209worker2 # [ 0.446084] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1210lb # [ 0.441656] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1211worker1 # [ 0.448875] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1212client # [ 0.442023] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1213worker1 # [ 0.449858] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1214worker2 # [ 0.447504] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1215lb # [ 0.442970] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1216client # [ 0.443605] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1217lb # [ 0.443763] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1218worker1 # [ 0.451404] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1219client # [ 0.445006] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1220lb # [ 0.444614] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1221client # [ 0.445902] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1222worker1 # [ 0.452866] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1223worker2 # [ 0.450049] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1224client # [ 0.446731] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1225worker1 # [ 0.453797] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1226worker2 # [ 0.451109] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1227lb # [ 0.446060] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1228worker2 # [ 0.452090] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1229client # [ 0.447634] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1230worker1 # [ 0.455202] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1231lb # [ 0.447034] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1232worker2 # [ 0.453572] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1233lb # [ 0.448064] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1234client # [ 0.448674] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1235worker1 # [ 0.457550] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1236lb # [ 0.449606] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1237client # [ 0.449898] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1238worker2 # [ 0.455132] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1239worker1 # [ 0.457859] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1240worker2 # [ 0.455958] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1241client # [ 0.451539] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1242worker1 # [ 0.458781] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1243lb # [ 0.451049] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1244worker2 # [ 0.456828] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1245lb # [ 0.451907] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1246worker1 # [ 0.460205] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1247lb # [ 0.452772] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1248worker2 # [ 0.457737] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1249worker1 # [ 0.462703] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1250lb # [ 0.453621] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1251worker2 # [ 0.458725] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1252worker1 # [ 0.463466] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1253worker2 # [ 0.459325] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1254lb # [ 0.455048] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1255worker1 # [ 0.463875] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1256worker2 # [ 0.460740] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1257lb # [ 0.456222] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1258worker1 # [ 0.465430] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1259lb # [ 0.457644] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1260worker1 # [ 0.466678] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1261worker1 # [ 0.467689] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1262client # [ 0.452198] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1263worker1 # [ 0.469484] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1264client # [ 0.454572] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1265client # [ 0.455242] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1266client # [ 0.456561] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1267client # [ 0.457256] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1268client # [ 0.458290] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1269worker2 # [ 0.461307] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1270client # [ 0.459254] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1271worker2 # [ 0.463736] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1272lb # [ 0.458249] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1273lb # [ 0.460607] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1274client # [ 0.460888] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1275worker2 # [ 0.464385] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1276client # [ 0.461642] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1277lb # [ 0.461283] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1278worker2 # [ 0.465714] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1279client # [ 0.462311] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1280worker1 # [ 0.470044] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1281lb # [ 0.462607] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1282worker2 # [ 0.466380] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1283client # [ 0.463909] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1284lb # [ 0.463321] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1285worker2 # [ 0.467405] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1286lb # [ 0.464346] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1287worker2 # [ 0.468376] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1288worker1 # [ 0.473685] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1289lb # [ 0.465314] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1290client # [ 0.467667] ACPI: PCI: Interrupt link LNKA configured for IRQ 101291worker2 # [ 0.470155] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1292worker1 # [ 0.474768] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1293client # [ 0.468102] ACPI: PCI: Interrupt link LNKB configured for IRQ 101294worker2 # [ 0.470989] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1295lb # [ 0.466903] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1296client # [ 0.469099] ACPI: PCI: Interrupt link LNKC configured for IRQ 111297lb # [ 0.467655] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1298worker1 # [ 0.476860] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1299client # [ 0.470096] ACPI: PCI: Interrupt link LNKD configured for IRQ 111300worker2 # [ 0.472363] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1301lb # [ 0.468358] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1302client # [ 0.471098] ACPI: PCI: Interrupt link LNKE configured for IRQ 101303worker1 # [ 0.478020] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1304worker2 # [ 0.473682] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1305client # [ 0.472094] ACPI: PCI: Interrupt link LNKF configured for IRQ 101306lb # [ 0.469967] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1307worker1 # [ 0.479144] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1308client # [ 0.473098] ACPI: PCI: Interrupt link LNKG configured for IRQ 111309client # [ 0.474131] ACPI: PCI: Interrupt link LNKH configured for IRQ 111310worker1 # [ 0.480111] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1311client # [ 0.475041] ACPI: PCI: Interrupt link GSIA configured for IRQ 161312worker2 # [ 0.477292] ACPI: PCI: Interrupt link LNKA configured for IRQ 101313client # [ 0.476015] ACPI: PCI: Interrupt link GSIB configured for IRQ 171314lb # [ 0.473697] ACPI: PCI: Interrupt link LNKA configured for IRQ 101315client # [ 0.476971] ACPI: PCI: Interrupt link GSIC configured for IRQ 181316worker2 # [ 0.478226] ACPI: PCI: Interrupt link LNKB configured for IRQ 101317worker1 # [ 0.482882] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1318lb # [ 0.474152] ACPI: PCI: Interrupt link LNKB configured for IRQ 101319client # [ 0.477701] ACPI: PCI: Interrupt link GSID configured for IRQ 191320worker2 # [ 0.479220] ACPI: PCI: Interrupt link LNKC configured for IRQ 111321worker1 # [ 0.483746] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1322lb # [ 0.475145] ACPI: PCI: Interrupt link LNKC configured for IRQ 111323client # [ 0.478011] ACPI: PCI: Interrupt link GSIE configured for IRQ 201324worker2 # [ 0.480209] ACPI: PCI: Interrupt link LNKD configured for IRQ 111325lb # [ 0.476142] ACPI: PCI: Interrupt link LNKD configured for IRQ 111326client # [ 0.478932] ACPI: PCI: Interrupt link GSIF configured for IRQ 211327worker1 # [ 0.484859] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1328worker2 # [ 0.481203] ACPI: PCI: Interrupt link LNKE configured for IRQ 101329lb # [ 0.477140] ACPI: PCI: Interrupt link LNKE configured for IRQ 101330client # [ 0.479694] ACPI: PCI: Interrupt link GSIG configured for IRQ 221331worker1 # [ 0.486639] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1332worker2 # [ 0.482201] ACPI: PCI: Interrupt link LNKF configured for IRQ 101333client # [ 0.480012] ACPI: PCI: Interrupt link GSIH configured for IRQ 231334lb # [ 0.478145] ACPI: PCI: Interrupt link LNKF configured for IRQ 101335worker2 # [ 0.483205] ACPI: PCI: Interrupt link LNKG configured for IRQ 111336lb # [ 0.479297] ACPI: PCI: Interrupt link LNKG configured for IRQ 111337worker2 # [ 0.484204] ACPI: PCI: Interrupt link LNKH configured for IRQ 111338client # [ 0.482019] iommu: Default domain type: Translated1339lb # [ 0.480166] ACPI: PCI: Interrupt link LNKH configured for IRQ 111340client # [ 0.482945] iommu: DMA domain TLB invalidation policy: lazy mode1341worker2 # [ 0.485140] ACPI: PCI: Interrupt link GSIA configured for IRQ 161342lb # [ 0.481084] ACPI: PCI: Interrupt link GSIA configured for IRQ 161343worker1 # [ 0.489805] ACPI: PCI: Interrupt link LNKA configured for IRQ 101344client # [ 0.483965] ACPI: bus type USB registered1345worker2 # [ 0.486111] ACPI: PCI: Interrupt link GSIB configured for IRQ 171346lb # [ 0.482033] ACPI: PCI: Interrupt link GSIB configured for IRQ 171347client # [ 0.484523] usbcore: registered new interface driver usbfs1348worker2 # [ 0.487046] ACPI: PCI: Interrupt link GSIC configured for IRQ 181349worker1 # [ 0.490668] ACPI: PCI: Interrupt link LNKB configured for IRQ 101350lb # [ 0.482979] ACPI: PCI: Interrupt link GSIC configured for IRQ 181351client # [ 0.485015] usbcore: registered new interface driver hub1352worker2 # [ 0.487911] ACPI: PCI: Interrupt link GSID configured for IRQ 191353worker1 # [ 0.491951] ACPI: PCI: Interrupt link LNKC configured for IRQ 111354lb # [ 0.483749] ACPI: PCI: Interrupt link GSID configured for IRQ 191355client # [ 0.485921] usbcore: registered new device driver usb1356worker2 # [ 0.488840] ACPI: PCI: Interrupt link GSIE configured for IRQ 201357lb # [ 0.484058] ACPI: PCI: Interrupt link GSIE configured for IRQ 201358worker1 # [ 0.492948] ACPI: PCI: Interrupt link LNKD configured for IRQ 111359worker2 # [ 0.489115] ACPI: PCI: Interrupt link GSIF configured for IRQ 211360client # [ 0.487458] NetLabel: Initializing1361lb # [ 0.484992] ACPI: PCI: Interrupt link GSIF configured for IRQ 211362worker1 # [ 0.493953] ACPI: PCI: Interrupt link LNKE configured for IRQ 101363client # [ 0.488000] NetLabel: domain hash size = 1281364lb # [ 0.485749] ACPI: PCI: Interrupt link GSIG configured for IRQ 221365worker2 # [ 0.490115] ACPI: PCI: Interrupt link GSIG configured for IRQ 221366worker1 # [ 0.494949] ACPI: PCI: Interrupt link LNKF configured for IRQ 101367client # [ 0.488713] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1368worker2 # [ 0.491057] ACPI: PCI: Interrupt link GSIH configured for IRQ 231369lb # [ 0.486054] ACPI: PCI: Interrupt link GSIH configured for IRQ 231370worker1 # [ 0.495952] ACPI: PCI: Interrupt link LNKG configured for IRQ 111371client # [ 0.489034] NetLabel: unlabeled traffic allowed by default1372worker1 # [ 0.496947] ACPI: PCI: Interrupt link LNKH configured for IRQ 111373client # [ 0.489917] PCI: Using ACPI for IRQ routing1374lb # [ 0.488118] iommu: Default domain type: Translated1375worker2 # [ 0.493206] iommu: Default domain type: Translated1376worker2 # [ 0.494038] iommu: DMA domain TLB invalidation policy: lazy mode1377worker1 # [ 0.497886] ACPI: PCI: Interrupt link GSIA configured for IRQ 161378worker2 # [ 0.495246] ACPI: bus type USB registered1379worker1 # [ 0.499601] ACPI: PCI: Interrupt link GSIB configured for IRQ 171380lb # [ 0.488901] iommu: DMA domain TLB invalidation policy: lazy mode1381worker2 # [ 0.495962] usbcore: registered new interface driver usbfs1382lb # [ 0.490336] ACPI: bus type USB registered1383worker2 # [ 0.496859] usbcore: registered new interface driver hub1384lb # [ 0.491109] usbcore: registered new interface driver usbfs1385worker2 # [ 0.497114] usbcore: registered new device driver usb1386worker1 # [ 0.499865] ACPI: PCI: Interrupt link GSIC configured for IRQ 181387lb # [ 0.492017] usbcore: registered new interface driver hub1388worker1 # [ 0.501706] ACPI: PCI: Interrupt link GSID configured for IRQ 191389lb # [ 0.492787] usbcore: registered new device driver usb1390worker1 # [ 0.502638] ACPI: PCI: Interrupt link GSIE configured for IRQ 201391lb # [ 0.493996] NetLabel: Initializing1392worker1 # [ 0.503743] ACPI: PCI: Interrupt link GSIF configured for IRQ 211393lb # [ 0.494492] NetLabel: domain hash size = 1281394worker2 # [ 0.499902] NetLabel: Initializing1395worker1 # [ 0.504786] ACPI: PCI: Interrupt link GSIG configured for IRQ 221396worker2 # [ 0.500579] NetLabel: domain hash size = 1281397lb # [ 0.495042] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1398worker2 # [ 0.501102] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1399worker1 # [ 0.505568] ACPI: PCI: Interrupt link GSIH configured for IRQ 231400lb # [ 0.495956] NetLabel: unlabeled traffic allowed by default1401lb # [ 0.496694] PCI: Using ACPI for IRQ routing1402worker2 # [ 0.502022] NetLabel: unlabeled traffic allowed by default1403worker2 # [ 0.502816] PCI: Using ACPI for IRQ routing1404worker1 # [ 0.506977] iommu: Default domain type: Translated1405worker1 # [ 0.507737] iommu: DMA domain TLB invalidation policy: lazy mode1406worker1 # [ 0.508832] ACPI: bus type USB registered1407worker1 # [ 0.509373] usbcore: registered new interface driver usbfs1408worker1 # [ 0.509879] usbcore: registered new interface driver hub1409worker1 # [ 0.510737] usbcore: registered new device driver usb1410worker1 # [ 0.512388] NetLabel: Initializing1411worker1 # [ 0.512853] NetLabel: domain hash size = 1281412worker1 # [ 0.513578] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1413worker1 # [ 0.513940] NetLabel: unlabeled traffic allowed by default1414worker1 # [ 0.514831] PCI: Using ACPI for IRQ routing1415client # [ 0.535024] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416client # [ 0.535996] pci 0000:00:01.0: vgaarb: bridge control possible1417client # [ 0.535996] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418client # [ 0.536002] vgaarb: loaded1419client # [ 0.536739] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420client # [ 0.537001] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421client # [ 0.541093] clocksource: Switched to clocksource kvm-clock1422lb # [ 0.540118] pci 0000:00:01.0: vgaarb: setting as boot VGA device1423lb # [ 0.541037] pci 0000:00:01.0: vgaarb: bridge control possible1424worker2 # [ 0.546516] pci 0000:00:01.0: vgaarb: setting as boot VGA device1425worker2 # [ 0.547098] pci 0000:00:01.0: vgaarb: bridge control possible1426lb # [ 0.541037] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1427lb # [ 0.541046] vgaarb: loaded1428client # [ 0.544567] VFS: Disk quotas dquot_6.6.01429worker2 # [ 0.547098] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1430lb # [ 0.541808] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01431worker2 # [ 0.547108] vgaarb: loaded1432client # [ 0.545275] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1433lb # [ 0.542042] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1434client # [ 0.546609] pnp: PnP ACPI init1435worker2 # [ 0.547980] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01436client # [ 0.547461] ACPI: IRQ 4 override to edge(!), high(!)1437worker2 # [ 0.548741] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1438client # [ 0.548518] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1439client # [ 0.550134] pnp: PnP ACPI: found 6 devices1440lb # [ 0.545172] clocksource: Switched to clocksource kvm-clock1441worker2 # [ 0.552233] clocksource: Switched to clocksource kvm-clock1442lb # [ 0.546784] VFS: Disk quotas dquot_6.6.01443worker1 # [ 0.558494] pci 0000:00:01.0: vgaarb: setting as boot VGA device1444worker1 # [ 0.558849] pci 0000:00:01.0: vgaarb: bridge control possible1445worker1 # [ 0.558849] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1446lb # [ 0.549348] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1447worker1 # [ 0.558858] vgaarb: loaded1448lb # [ 0.550689] pnp: PnP ACPI init1449worker2 # [ 0.556216] VFS: Disk quotas dquot_6.6.01450worker1 # [ 0.559623] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01451lb # [ 0.551520] ACPI: IRQ 4 override to edge(!), high(!)1452worker1 # [ 0.559854] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1453worker2 # [ 0.557065] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1454worker2 # [ 0.558510] pnp: PnP ACPI init1455lb # [ 0.552519] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1456client # [ 0.557744] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1457worker2 # [ 0.559377] ACPI: IRQ 4 override to edge(!), high(!)1458lb # [ 0.554025] pnp: PnP ACPI: found 6 devices1459client # [ 0.559231] clocksource: Switched to clocksource acpi_pm1460client # [ 0.560176] NET: Registered PF_INET protocol family1461worker2 # [ 0.560390] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1462worker1 # [ 0.562947] clocksource: Switched to clocksource kvm-clock1463worker2 # [ 0.562060] pnp: PnP ACPI: found 6 devices1464client # [ 0.561299] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1465worker1 # [ 0.566599] VFS: Disk quotas dquot_6.6.01466worker1 # [ 0.567405] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1467worker1 # [ 0.568832] pnp: PnP ACPI init1468lb # [ 0.561706] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1469worker1 # [ 0.569695] ACPI: IRQ 4 override to edge(!), high(!)1470lb # [ 0.563129] clocksource: Switched to clocksource acpi_pm1471worker1 # [ 0.570711] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1472lb # [ 0.564080] NET: Registered PF_INET protocol family1473worker2 # [ 0.569821] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1474worker1 # [ 0.572325] pnp: PnP ACPI: found 6 devices1475worker2 # [ 0.571275] clocksource: Switched to clocksource acpi_pm1476lb # [ 0.565546] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1477worker2 # [ 0.572290] NET: Registered PF_INET protocol family1478worker2 # [ 0.573538] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1479worker1 # [ 0.579944] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1480client # [ 0.578303] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1481worker1 # [ 0.581412] clocksource: Switched to clocksource acpi_pm1482client # [ 0.579940] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1483worker1 # [ 0.582433] NET: Registered PF_INET protocol family1484client # [ 0.581250] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1485worker1 # [ 0.583710] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1486client # [ 0.582588] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1487client # [ 0.583851] TCP: Hash tables configured (established 16384 bind 16384)1488client # [ 0.585023] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1489client # [ 0.586394] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1490client # [ 0.587492] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1491lb # [ 0.582515] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1492client # [ 0.588791] NET: Registered PF_UNIX/PF_LOCAL protocol family1493client # [ 0.589824] NET: Registered PF_XDP protocol family1494lb # [ 0.584147] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1495client # [ 0.590693] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1496lb # [ 0.585471] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1497client # [ 0.591704] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1498lb # [ 0.586809] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1499worker2 # [ 0.592629] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1500client # [ 0.592775] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1501lb # [ 0.588065] TCP: Hash tables configured (established 16384 bind 16384)1502client # [ 0.593844] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1503worker2 # [ 0.594301] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1504lb # [ 0.589184] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1505client # [ 0.594919] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1506worker2 # [ 0.595664] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1507lb # [ 0.590431] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1508client # [ 0.595972] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1509lb # [ 0.591504] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1510worker2 # [ 0.597037] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1511client # [ 0.597686] ACPI: \_SB_.GSIA: Enabled at IRQ 161512lb # [ 0.592722] NET: Registered PF_UNIX/PF_LOCAL protocol family1513worker2 # [ 0.598295] TCP: Hash tables configured (established 16384 bind 16384)1514lb # [ 0.593682] NET: Registered PF_XDP protocol family1515worker2 # [ 0.599474] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1516lb # [ 0.594520] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1517client # [ 0.600334] ACPI: \_SB_.GSIB: Enabled at IRQ 171518worker1 # [ 0.601950] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1519worker2 # [ 0.600817] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1520lb # [ 0.595518] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1521worker2 # [ 0.601902] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1522lb # [ 0.596475] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1523client # [ 0.602235] ACPI: \_SB_.GSIC: Enabled at IRQ 181524worker1 # [ 0.603633] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1525worker2 # [ 0.603167] NET: Registered PF_UNIX/PF_LOCAL protocol family1526lb # [ 0.597538] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1527worker1 # [ 0.605024] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1528worker2 # [ 0.604211] NET: Registered PF_XDP protocol family1529lb # [ 0.598595] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1530client # [ 0.604205] ACPI: \_SB_.GSID: Enabled at IRQ 191531worker2 # [ 0.605142] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1532worker1 # [ 0.606555] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1533lb # [ 0.599652] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1534client # [ 0.605911] PCI: CLS 0 bytes, default 641535worker2 # [ 0.606181] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1536worker1 # [ 0.607895] TCP: Hash tables configured (established 16384 bind 16384)1537lb # [ 0.601376] ACPI: \_SB_.GSIA: Enabled at IRQ 161538worker2 # [ 0.607254] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1539client # [ 0.606811] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1540worker1 # [ 0.609237] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1541worker2 # [ 0.608430] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1542client # [ 0.608563] Trying to unpack rootfs image as initramfs...1543worker1 # [ 0.610646] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1544lb # [ 0.603941] ACPI: \_SB_.GSIB: Enabled at IRQ 171545worker2 # [ 0.609587] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1546worker1 # [ 0.611835] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1547worker2 # [ 0.610690] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1548lb # [ 0.605881] ACPI: \_SB_.GSIC: Enabled at IRQ 181549worker1 # [ 0.613215] NET: Registered PF_UNIX/PF_LOCAL protocol family1550worker2 # [ 0.612784] ACPI: \_SB_.GSIA: Enabled at IRQ 161551worker1 # [ 0.614368] NET: Registered PF_XDP protocol family1552lb # [ 0.607813] ACPI: \_SB_.GSID: Enabled at IRQ 191553worker1 # [ 0.615348] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1554lb # [ 0.609565] PCI: CLS 0 bytes, default 641555worker1 # [ 0.616441] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1556worker2 # [ 0.615191] ACPI: \_SB_.GSIB: Enabled at IRQ 171557worker1 # [ 0.617539] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1558lb # [ 0.610462] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1559worker2 # [ 0.617202] ACPI: \_SB_.GSIC: Enabled at IRQ 181560worker1 # [ 0.618708] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1561lb # [ 0.612160] Trying to unpack rootfs image as initramfs...1562worker1 # [ 0.619828] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1563worker2 # [ 0.619249] ACPI: \_SB_.GSID: Enabled at IRQ 191564worker1 # [ 0.620973] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1565worker1 # [ 0.622833] ACPI: \_SB_.GSIA: Enabled at IRQ 161566worker2 # [ 0.621361] PCI: CLS 0 bytes, default 641567worker2 # [ 0.622294] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1568worker1 # [ 0.625254] ACPI: \_SB_.GSIB: Enabled at IRQ 171569worker2 # [ 0.624067] Trying to unpack rootfs image as initramfs...1570worker1 # [ 0.627307] ACPI: \_SB_.GSIC: Enabled at IRQ 181571worker1 # [ 0.629297] ACPI: \_SB_.GSID: Enabled at IRQ 191572worker1 # [ 0.631024] PCI: CLS 0 bytes, default 641573worker1 # [ 0.631978] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1574worker1 # [ 0.633832] Trying to unpack rootfs image as initramfs...1575client # [ 0.653877] Initialise system trusted keyrings1576client # [ 0.657492] workingset: timestamp_bits=40 max_order=19 bucket_order=01577lb # [ 0.658349] Initialise system trusted keyrings1578lb # [ 0.661961] workingset: timestamp_bits=40 max_order=19 bucket_order=01579worker2 # [ 0.671608] Initialise system trusted keyrings1580worker2 # [ 0.675039] workingset: timestamp_bits=40 max_order=19 bucket_order=01581worker1 # [ 0.679921] Initialise system trusted keyrings1582client # [ 0.679014] Key type asymmetric registered1583client # [ 0.679802] Asymmetric key parser 'x509' registered1584worker1 # [ 0.683267] workingset: timestamp_bits=40 max_order=19 bucket_order=01585client # [ 0.682515] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1586client # [ 0.685513] io scheduler mq-deadline registered1587client # [ 0.686282] io scheduler kyber registered1588lb # [ 0.683653] Key type asymmetric registered1589client # [ 0.690478] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1590lb # [ 0.685928] Asymmetric key parser 'x509' registered1591client # [ 0.691776] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1592lb # [ 0.686772] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1593lb # [ 0.690051] io scheduler mq-deadline registered1594lb # [ 0.690798] io scheduler kyber registered1595worker2 # [ 0.697029] Key type asymmetric registered1596worker2 # [ 0.697795] Asymmetric key parser 'x509' registered1597client # [ 0.698554] Linux agpgart interface v0.1031598worker2 # [ 0.698722] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1599client # [ 0.699535] ACPI: bus type drm_connector registered1600lb # [ 0.694611] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1601lb # [ 0.696919] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1602worker2 # [ 0.704185] io scheduler mq-deadline registered1603worker2 # [ 0.705011] io scheduler kyber registered1604worker1 # [ 0.707334] Key type asymmetric registered1605lb # [ 0.700556] Linux agpgart interface v0.1031606worker1 # [ 0.708080] Asymmetric key parser 'x509' registered1607client # [ 0.705654] usbcore: registered new interface driver usbserial_generic1608lb # [ 0.701366] ACPI: bus type drm_connector registered1609worker1 # [ 0.708977] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1610client # [ 0.707067] usbserial: USB Serial support registered for generic1611worker2 # [ 0.709194] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1612client # [ 0.708377] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1613lb # [ 0.704353] usbcore: registered new interface driver usbserial_generic1614worker1 # [ 0.712356] io scheduler mq-deadline registered1615client # [ 0.708377] Please enable it if your BIOS has the CPPC option.1616worker2 # [ 0.710559] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1617lb # [ 0.705418] usbserial: USB Serial support registered for generic1618worker1 # [ 0.713154] io scheduler kyber registered1619lb # [ 0.708925] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1620lb # [ 0.708925] Please enable it if your BIOS has the CPPC option.1621worker2 # [ 0.716033] Linux agpgart interface v0.1031622worker1 # [ 0.717845] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1623worker2 # [ 0.716824] ACPI: bus type drm_connector registered1624lb # [ 0.711127] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1625client # [ 0.716477] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1626worker1 # [ 0.719296] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1627client # [ 0.718277] drop_monitor: Initializing network drop monitor service1628lb # [ 0.715053] drop_monitor: Initializing network drop monitor service1629worker2 # [ 0.721554] usbcore: registered new interface driver usbserial_generic1630lb # [ 0.716242] NET: Registered PF_INET6 protocol family1631client # [ 0.721644] NET: Registered PF_INET6 protocol family1632worker2 # [ 0.722641] usbserial: USB Serial support registered for generic1633worker1 # [ 0.724616] Linux agpgart interface v0.1031634worker1 # [ 0.725456] ACPI: bus type drm_connector registered1635lb # [ 0.719385] Segment Routing with IPv61636client # [ 0.724898] Segment Routing with IPv61637worker2 # [ 0.725980] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1638worker1 # [ 0.728662] usbcore: registered new interface driver usbserial_generic1639lb # [ 0.721932] In-situ OAM (IOAM) with IPv61640worker2 # [ 0.725980] Please enable it if your BIOS has the CPPC option.1641client # [ 0.727477] In-situ OAM (IOAM) with IPv61642worker1 # [ 0.729807] usbserial: USB Serial support registered for generic1643lb # [ 0.723036] IPI shorthand broadcast: enabled1644worker2 # [ 0.728256] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1645worker2 # [ 0.731198] drop_monitor: Initializing network drop monitor service1646client # [ 0.730911] IPI shorthand broadcast: enabled1647worker1 # [ 0.733145] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1648worker2 # [ 0.732483] NET: Registered PF_INET6 protocol family1649worker1 # [ 0.733145] Please enable it if your BIOS has the CPPC option.1650worker1 # [ 0.735502] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1651worker2 # [ 0.736657] Segment Routing with IPv61652lb # [ 0.731457] sched_clock: Marking stable (594013905, 136887790)->(802936046, -72034351)1653worker1 # [ 0.739303] drop_monitor: Initializing network drop monitor service1654worker1 # [ 0.740539] NET: Registered PF_INET6 protocol family1655worker2 # [ 0.740004] In-situ OAM (IOAM) with IPv61656worker2 # [ 0.741225] IPI shorthand broadcast: enabled1657worker1 # [ 0.743664] Segment Routing with IPv61658lb # [ 0.737209] registered taskstats version 11659lb # [ 0.738188] Loading compiled-in X.509 certificates1660client # [ 0.742778] sched_clock: Marking stable (608023673, 134420302)->(814034300, -71590325)1661worker1 # [ 0.747153] In-situ OAM (IOAM) with IPv61662worker1 # [ 0.748323] IPI shorthand broadcast: enabled1663client # [ 0.747763] registered taskstats version 11664client # [ 0.749034] Loading compiled-in X.509 certificates1665worker2 # [ 0.749900] sched_clock: Marking stable (605017330, 143950916)->(824022500, -75054254)1666worker2 # [ 0.754268] registered taskstats version 11667worker2 # [ 0.755342] Loading compiled-in X.509 certificates1668worker1 # [ 0.756946] sched_clock: Marking stable (616017615, 140116000)->(834518947, -78385332)1669worker1 # [ 0.760389] registered taskstats version 11670worker1 # [ 0.761417] Loading compiled-in X.509 certificates1671lb # [ 0.756925] Demotion targets for Node 0: null1672lb # [ 0.757827] Key type .fscrypt registered1673lb # [ 0.758524] Key type fscrypt-provisioning registered1674lb # [ 0.762035] ima: No TPM chip found, activating TPM-bypass!1675client # [ 0.767955] Demotion targets for Node 0: null1676lb # [ 0.762963] ima: Allocated hash algorithm: sha11677lb # [ 0.763741] ima: No architecture policies found1678lb # [ 0.766109] PM: Magic number: 10:154:9261679client # [ 0.771505] Key type .fscrypt registered1680client # [ 0.772264] Key type fscrypt-provisioning registered1681lb # [ 0.767787] RAS: Correctable Errors collector initialized.1682client # [ 0.773241] ima: No TPM chip found, activating TPM-bypass!1683worker2 # [ 0.774836] Demotion targets for Node 0: null1684client # [ 0.775448] ima: Allocated hash algorithm: sha11685client # [ 0.776254] ima: No architecture policies found1686worker2 # [ 0.778053] Key type .fscrypt registered1687client # [ 0.778453] PM: Magic number: 10:154:9261688worker2 # [ 0.778764] Key type fscrypt-provisioning registered1689worker2 # [ 0.779851] ima: No TPM chip found, activating TPM-bypass!1690client # [ 0.780234] RAS: Correctable Errors collector initialized.1691worker1 # [ 0.782711] Demotion targets for Node 0: null1692worker2 # [ 0.781984] ima: Allocated hash algorithm: sha11693worker1 # [ 0.783873] Key type .fscrypt registered1694lb # [ 0.776762] clk: Disabling unused clocks1695worker2 # [ 0.782805] ima: No architecture policies found1696worker1 # [ 0.787143] Key type fscrypt-provisioning registered1697lb # [ 0.780921] PM: genpd: Disabling unused power domains1698worker1 # [ 0.788067] ima: No TPM chip found, activating TPM-bypass!1699worker2 # [ 0.786994] PM: Magic number: 10:154:9261700worker1 # [ 0.788990] ima: Allocated hash algorithm: sha11701worker2 # [ 0.788889] RAS: Correctable Errors collector initialized.1702client # [ 0.789200] clk: Disabling unused clocks1703worker1 # [ 0.791212] ima: No architecture policies found1704worker1 # [ 0.794149] PM: Magic number: 10:154:9261705client # [ 0.793461] PM: genpd: Disabling unused power domains1706worker1 # [ 0.795838] RAS: Correctable Errors collector initialized.1707worker2 # [ 0.797807] clk: Disabling unused clocks1708worker2 # [ 0.801988] PM: genpd: Disabling unused power domains1709worker1 # [ 0.804884] clk: Disabling unused clocks1710worker1 # [ 0.807162] PM: genpd: Disabling unused power domains1711lb # [ 0.954039] Freeing initrd memory: 29092K1712lb # [ 0.957275] Freeing unused decrypted memory: 2028K1713lb # [ 0.959918] Freeing unused kernel image (initmem) memory: 3644K1714lb # [ 0.961075] Write protecting the kernel read-only data: 32768k1715lb # [ 0.962944] Freeing unused kernel image (text/rodata gap) memory: 1208K1716lb # [ 0.964430] Freeing unused kernel image (rodata/data gap) memory: 752K1717client # [ 0.971702] Freeing initrd memory: 29096K1718client # [ 0.975023] Freeing unused decrypted memory: 2028K1719client # [ 0.977714] Freeing unused kernel image (initmem) memory: 3644K1720client # [ 0.978844] Write protecting the kernel read-only data: 32768k1721client # [ 0.980827] Freeing unused kernel image (text/rodata gap) memory: 1208K1722client # [ 0.982405] Freeing unused kernel image (rodata/data gap) memory: 752K1723worker2 # [ 0.993819] Freeing initrd memory: 29092K1724worker1 # [ 0.995615] Freeing initrd memory: 29092K1725worker1 # [ 0.998973] Freeing unused decrypted memory: 2028K1726worker2 # [ 0.997458] Freeing unused decrypted memory: 2028K1727worker1 # [ 1.001762] Freeing unused kernel image (initmem) memory: 3644K1728worker2 # [ 1.000535] Freeing unused kernel image (initmem) memory: 3644K1729worker1 # [ 1.002890] Write protecting the kernel read-only data: 32768k1730worker2 # [ 1.001601] Write protecting the kernel read-only data: 32768k1731worker1 # [ 1.004844] Freeing unused kernel image (text/rodata gap) memory: 1208K1732worker2 # [ 1.003613] Freeing unused kernel image (text/rodata gap) memory: 1208K1733worker1 # [ 1.006527] Freeing unused kernel image (rodata/data gap) memory: 752K1734worker2 # [ 1.005189] Freeing unused kernel image (rodata/data gap) memory: 752K1735lb # [ 1.015572] x86/mm: Checked W+X mappings: passed, no W+X pages found.1736lb # [ 1.016621] Run /init as init process1737lb # [ 1.027034] systemd[1]: Inserted module 'autofs4'1738client # [ 1.033534] x86/mm: Checked W+X mappings: passed, no W+X pages found.1739client # [ 1.034680] Run /init as init process1740client # [ 1.045118] systemd[1]: Inserted module 'autofs4'1741lb # [ 1.043379] fuse: init (API version 7.45)1742lb # [ 1.049286] ACPI: \_SB_.GSIG: Enabled at IRQ 221743worker2 # [ 1.056175] x86/mm: Checked W+X mappings: passed, no W+X pages found.1744worker1 # [ 1.057979] x86/mm: Checked W+X mappings: passed, no W+X pages found.1745worker2 # [ 1.057301] Run /init as init process1746worker1 # [ 1.059189] Run /init as init process1747lb # [ 1.052363] ACPI: \_SB_.GSIH: Enabled at IRQ 231748lb # [ 1.055586] ACPI: \_SB_.GSIE: Enabled at IRQ 201749client # [ 1.061544] fuse: init (API version 7.45)1750lb # [ 1.058057] ACPI: \_SB_.GSIF: Enabled at IRQ 211751client # [ 1.067596] ACPI: \_SB_.GSIG: Enabled at IRQ 221752worker1 # [ 1.069991] systemd[1]: Inserted module 'autofs4'1753worker2 # [ 1.068613] systemd[1]: Inserted module 'autofs4'1754client # [ 1.070228] ACPI: \_SB_.GSIH: Enabled at IRQ 231755client # [ 1.073568] ACPI: \_SB_.GSIE: Enabled at IRQ 201756client # [ 1.075957] ACPI: \_SB_.GSIF: Enabled at IRQ 211757worker1 # [ 1.086660] fuse: init (API version 7.45)1758worker2 # [ 1.086089] fuse: init (API version 7.45)1759lb # [ 1.084936] systemd[1]: Successfully made /usr/ read-only.1760worker1 # [ 1.092696] ACPI: \_SB_.GSIG: Enabled at IRQ 221761worker2 # [ 1.092402] ACPI: \_SB_.GSIG: Enabled at IRQ 221762worker1 # [ 1.095241] ACPI: \_SB_.GSIH: Enabled at IRQ 231763worker2 # [ 1.095022] ACPI: \_SB_.GSIH: Enabled at IRQ 231764worker1 # [ 1.098236] ACPI: \_SB_.GSIE: Enabled at IRQ 201765worker2 # [ 1.097939] ACPI: \_SB_.GSIE: Enabled at IRQ 201766worker1 # [ 1.100486] ACPI: \_SB_.GSIF: Enabled at IRQ 211767worker2 # [ 1.100352] ACPI: \_SB_.GSIF: Enabled at IRQ 211768client # [ 1.102362] systemd[1]: Successfully made /usr/ read-only.1769worker1 # [ 1.128070] systemd[1]: Successfully made /usr/ read-only.1770worker2 # [ 1.129171] systemd[1]: Successfully made /usr/ read-only.1771lb # [ 1.420484] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772lb # [ 1.425250] systemd[1]: Detected virtualization kvm.1773lb # [ 1.426071] systemd[1]: Detected architecture x86-64.1774lb # [ 1.426932] systemd[1]: Running in initrd.1775lb # [ 1.428031] systemd[1]: Initializing machine ID from random generator.1776lb # [ 1.429186] systemd[1]: Hostname set to <lb>.1777client # [ 1.439333] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778client # [ 1.451610] systemd[1]: Detected virtualization kvm.1779client # [ 1.453710] systemd[1]: Detected architecture x86-64.1780client # [ 1.455793] systemd[1]: Running in initrd.1781client # [ 1.458239] systemd[1]: Initializing machine ID from random generator.1782client # [ 1.461048] systemd[1]: Hostname set to <client>.1783worker1 # [ 1.465023] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1784worker2 # [ 1.465774] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1785worker1 # [ 1.477603] systemd[1]: Detected virtualization kvm.1786worker2 # [ 1.478233] systemd[1]: Detected virtualization kvm.1787worker1 # [ 1.479830] systemd[1]: Detected architecture x86-64.1788worker2 # [ 1.480231] systemd[1]: Detected architecture x86-64.1789worker2 # [ 1.481140] systemd[1]: Running in initrd.1790worker1 # [ 1.482157] systemd[1]: Running in initrd.1791worker2 # [ 1.482456] systemd[1]: Initializing machine ID from random generator.1792worker2 # [ 1.483647] systemd[1]: Hostname set to <worker2>.1793worker1 # [ 1.484971] systemd[1]: Initializing machine ID from random generator.1794worker1 # [ 1.488025] systemd[1]: Hostname set to <worker1>.1795lb # [ 1.618573] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796lb # [ 1.658468] systemd[1]: Queued start job for default target Initrd Default Target.1797client # [ 1.664249] systemd[1]: bpf-restrict-fs: LSM BPF program attached1798lb # [ 1.663307] systemd[1]: Created slice Slice /system/modprobe.1799lb # [ 1.664585] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1800lb # [ 1.666041] systemd[1]: Expecting device /dev/disk/by-label/nixos...1801lb # [ 1.667213] systemd[1]: Reached target Path Units.1802lb # [ 1.668101] systemd[1]: Reached target Slice Units.1803lb # [ 1.669017] systemd[1]: Reached target Swaps.1804lb # [ 1.669836] systemd[1]: Reached target Timer Units.1805lb # [ 1.670957] systemd[1]: Listening on D-Bus System Message Bus Socket.1806lb # [ 1.672254] systemd[1]: Listening on Journal Socket (/dev/log).1807lb # [ 1.673442] systemd[1]: Listening on Journal Sockets.1808lb # [ 1.674445] systemd[1]: Listening on udev Control Socket.1809lb # [ 1.675510] systemd[1]: Listening on udev Kernel Socket.1810lb # [ 1.676487] systemd[1]: Reached target Socket Units.1811lb # [ 1.678372] systemd[1]: Starting Create List of Static Device Nodes...1812lb # [ 1.683004] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1813lb # [ 1.689635] systemd[1]: Starting Load Kernel Module configfs...1814worker2 # [ 1.695423] systemd[1]: bpf-restrict-fs: LSM BPF program attached1815client # [ 1.706209] systemd[1]: Queued start job for default target Initrd Default Target.1816worker1 # [ 1.709010] systemd[1]: bpf-restrict-fs: LSM BPF program attached1817client # [ 1.711004] systemd[1]: Created slice Slice /system/modprobe.1818lb # [ 1.706043] systemd[1]: Starting Journal Service...1819client # [ 1.712229] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1820client # [ 1.713610] systemd[1]: Expecting device /dev/disk/by-label/nixos...1821client # [ 1.714689] systemd[1]: Reached target Path Units.1822client # [ 1.715543] systemd[1]: Reached target Slice Units.1823client # [ 1.716381] systemd[1]: Reached target Swaps.1824client # [ 1.717156] systemd[1]: Reached target Timer Units.1825client # [ 1.718198] systemd[1]: Listening on D-Bus System Message Bus Socket.1826client # [ 1.719388] systemd[1]: Listening on Journal Socket (/dev/log).1827client # [ 1.720567] systemd[1]: Listening on Journal Sockets.1828client # [ 1.721665] systemd[1]: Listening on udev Control Socket.1829client # [ 1.722671] systemd[1]: Listening on udev Kernel Socket.1830client # [ 1.723630] systemd[1]: Reached target Socket Units.1831lb # [ 1.720005] systemd[1]: Starting Load Kernel Modules...1832client # [ 1.725837] systemd[1]: Starting Create List of Static Device Nodes...1833client # [ 1.731530] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1834client # [ 1.737012] systemd[1]: Starting Load Kernel Module configfs...1835lb # [ 1.723997] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1836lb # [ 1.741790] netfs: FS-Cache loaded1837worker2 # [ 1.750476] systemd[1]: Queued start job for default target Initrd Default Target.1838worker2 # [ 1.754425] systemd[1]: Created slice Slice /system/modprobe.1839lb # [ 1.749298] 9pnet: Installing 9P2000 support1840worker2 # [ 1.755620] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1841worker2 # [ 1.757071] systemd[1]: Expecting device /dev/disk/by-label/nixos...1842client # [ 1.757562] systemd[1]: Starting Journal Service...1843worker2 # [ 1.758144] systemd[1]: Reached target Path Units.1844worker2 # [ 1.758995] systemd[1]: Reached target Slice Units.1845worker2 # [ 1.759834] systemd[1]: Reached target Swaps.1846worker2 # [ 1.760596] systemd[1]: Reached target Timer Units.1847worker1 # [ 1.762234] systemd[1]: Queued start job for default target Initrd Default Target.1848worker2 # [ 1.761567] systemd[1]: Listening on D-Bus System Message Bus Socket.1849worker2 # [ 1.762719] systemd[1]: Listening on Journal Socket (/dev/log).1850worker2 # [ 1.763827] systemd[1]: Listening on Journal Sockets.1851worker2 # [ 1.764791] systemd[1]: Listening on udev Control Socket.1852worker1 # [ 1.766880] systemd[1]: Created slice Slice /system/modprobe.1853worker2 # [ 1.765849] systemd[1]: Listening on udev Kernel Socket.1854worker2 # [ 1.766834] systemd[1]: Reached target Socket Units.1855worker1 # [ 1.768224] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1856worker1 # [ 1.769702] systemd[1]: Expecting device /dev/disk/by-label/nixos...1857worker2 # [ 1.768900] systemd[1]: Starting Create List of Static Device Nodes...1858worker1 # [ 1.770900] systemd[1]: Reached target Path Units.1859client # [ 1.769759] systemd[1]: Starting Load Kernel Modules...1860worker1 # [ 1.771861] systemd[1]: Reached target Slice Units.1861worker1 # [ 1.772934] systemd[1]: Reached target Swaps.1862lb # [ 1.766195] systemd[1]: Starting Coldplug All udev Devices...1863worker1 # [ 1.773811] systemd[1]: Reached target Timer Units.1864worker1 # [ 1.774975] systemd[1]: Listening on D-Bus System Message Bus Socket.1865worker1 # [ 1.776357] systemd[1]: Listening on Journal Socket (/dev/log).1866worker2 # [ 1.775061] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1867worker1 # [ 1.777611] systemd[1]: Listening on Journal Sockets.1868worker1 # [ 1.778757] systemd[1]: Listening on udev Control Socket.1869worker1 # [ 1.779908] systemd[1]: Listening on udev Kernel Socket.1870worker1 # [ 1.780937] systemd[1]: Reached target Socket Units.1871lb # [ 1.775688] systemd-journald[67]: Collecting audit messages is disabled.1872worker1 # [ 1.783432] systemd[1]: Starting Create List of Static Device Nodes...1873worker2 # [ 1.783034] systemd[1]: Starting Load Kernel Module configfs...1874worker1 # [ 1.788423] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1875lb # [ 1.783476] systemd[1]: Finished Create List of Static Device Nodes.1876client # [ 1.781578] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1877worker1 # [ 1.796248] systemd[1]: Starting Load Kernel Module configfs...1878client # [ 1.796767] netfs: FS-Cache loaded1879lb # [ 1.792235] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1880worker2 # [ 1.798766] systemd[1]: Starting Journal Service...1881client # [ 1.802380] 9pnet: Installing 9P2000 support1882lb # [ 1.800391] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1883lb # [ 1.805416] systemd[1]: modprobe@configfs.service: Deactivated successfully.1884worker1 # [ 1.815147] systemd[1]: Starting Journal Service...1885worker2 # [ 1.814077] systemd[1]: Starting Load Kernel Modules...1886client # [ 1.813707] systemd[1]: Starting Coldplug All udev Devices...1887lb # [ 1.813379] systemd[1]: Finished Load Kernel Module configfs.1888lb # [ 1.820445] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1889worker1 # [ 1.829297] systemd[1]: Starting Load Kernel Modules...1890client # [ 1.829514] systemd[1]: Finished Create List of Static Device Nodes.1891lb # [ 1.823430] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1892worker2 # [ 1.819081] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1893worker2 # [ 1.836195] netfs: FS-Cache loaded1894client # [ 1.837811] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1895lb # [ 1.833203] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1896lb # [ 1.835929] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1897worker2 # [ 1.842706] 9pnet: Installing 9P2000 support1898client # [ 1.846527] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1899worker1 # [ 1.839310] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1900client # [ 1.851807] systemd-journald[67]: Collecting audit messages is disabled.1901worker2 # [ 1.855153] systemd[1]: Starting Coldplug All udev Devices...1902client # [ 1.856041] systemd[1]: modprobe@configfs.service: Deactivated successfully.1903worker1 # [ 1.862674] netfs: FS-Cache loaded1904client # [ 1.860875] systemd[1]: Finished Load Kernel Module configfs.1905client # [ 1.866062] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1906worker1 # [ 1.869649] 9pnet: Installing 9P2000 support1907worker2 # [ 1.871431] systemd[1]: Finished Create List of Static Device Nodes.1908client # [ 1.870627] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1909lb # [ 1.869591] systemd[1]: Finished Load Kernel Modules.1910worker2 # [ 1.875819] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1911client # [ 1.877677] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1912client # [ 1.878958] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1913worker1 # [ 1.885562] systemd[1]: Starting Coldplug All udev Devices...1914lb # [ 1.879123] systemd[1]: Starting Apply Kernel Variables...1915worker2 # [ 1.888527] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1916worker2 # [ 1.895538] systemd[1]: modprobe@configfs.service: Deactivated successfully.1917worker2 # [ 1.898316] systemd-journald[67]: Collecting audit messages is disabled.1918lb # [ 1.895044] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1919worker2 # [ 1.903020] systemd[1]: Finished Load Kernel Module configfs.1920worker1 # [ 1.907238] systemd[1]: Finished Create List of Static Device Nodes.1921worker2 # [ 1.907506] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1922client # [ 1.910069] systemd[1]: Finished Load Kernel Modules.1923worker2 # [ 1.909983] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1924lb # [ 1.767249] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.905487] systemd[1]: Starting Create Static Device Nodes in /dev...1925lb # 1926lb # [ 1.769790] systemd-modules-load[68]: Inserted module 'virtio_balloon'1927lb # [ 1.773391] systemd-modules-load[68]: Inserted module 'virtio_gpu'1928worker1 # [ 1.918230] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1929worker2 # [ 1.917090] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1930client # [ 1.918665] systemd[1]: Starting Apply Kernel Variables...1931worker2 # [ 1.918882] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1932lb # [ 1.916290] systemd[1]: Started Journal Service.1933worker1 # [ 1.924575] systemd-journald[67]: Collecting audit messages is disabled.1934worker1 # [ 1.925932] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1935worker1 # [ 1.932697] systemd[1]: modprobe@configfs.service: Deactivated successfully.1936lb # [ 1.790600] systemd[1]: Finished Apply Kernel Variables.1937client # [ 1.933619] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1938worker1 # [ 1.939657] systemd[1]: Finished Load Kernel Module configfs.1939worker1 # [ 1.944805] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1940client # [ 1.943661] systemd[1]: Starting Create Static Device Nodes in /dev...1941worker1 # [ 1.949477] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1942worker2 # [ 1.952682] systemd[1]: Finished Load Kernel Modules.1943lb # [ 1.811203] systemd[1]: Finished Create Static Device Nodes in /dev.1944lb # [ 1.813299] systemd[1]: Reached target Preparation for Local File Systems.1945lb # [ 1.814301] systemd[1]: Reached target Local File Systems.1946worker1 # [ 1.960377] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1947lb # [ 1.818075] systemd[1]: Starting Create System Files and Directories...1948client # [ 1.961040] systemd[1]: Finished Apply Kernel Variables.1949worker1 # [ 1.964354] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1950worker2 # [ 1.965165] systemd[1]: Starting Apply Kernel Variables...1951lb # [ 1.823089] systemd[1]: Starting Rule-based Manager for Device Events and Files...1952worker2 # [ 1.977086] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1953client # [ 1.841566] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.978826] systemd[1]: Started Journal Service.1954client # 1955client # [ 1.846357] systemd-modules-load[68]: Inserted module 'virtio_balloon'1956client # [ 1.847431] systemd-modules-load[68]: Inserted module 'virtio_gpu'1957worker2 # [ 1.988088] systemd[1]: Starting Create Static Device Nodes in /dev...1958client # [ 1.859936] systemd[1]: Finished Create Static Device Nodes in /dev.1959worker1 # [ 1.999276] systemd[1]: Finished Load Kernel Modules.1960client # [ 1.863102] systemd[1]: Reached target Preparation for Local File Systems.1961client # [ 1.864116] systemd[1]: Reached target Local File Systems.1962lb # [ 1.859298] systemd[1]: Finished Create System Files and Directories.1963client # [ 1.867064] systemd[1]: Starting Create System Files and Directories...1964worker1 # [ 2.009253] systemd[1]: Starting Apply Kernel Variables...1965client # [ 1.873075] systemd[1]: Starting Rule-based Manager for Device Events and Files...1966worker2 # [ 2.011759] systemd[1]: Finished Apply Kernel Variables.1967worker2 # [ 2.023238] systemd[1]: Started Journal Service.1968worker2 # [ 1.877650] systemd-modules-load[68]: Inserted module 'dm_mod'1969worker2 # [ 1.882027] systemd-modules-load[68]: Inserted module 'virtio_balloon'1970lb # [ 1.884465] systemd-udevd[83]: Using default interface naming scheme 'v261'.1971worker1 # [ 2.028261] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1972worker2 # [ 1.884208] systemd-modules-load[68]: Inserted module 'virtio_gpu'1973worker1 # [ 2.041263] systemd[1]: Starting Create Static Device Nodes in /dev...1974worker2 # [ 1.897223] systemd[1]: Finished Create Static Device Nodes in /dev.1975client # [ 1.908303] systemd[1]: Finished Create System Files and Directories.1976worker2 # [ 1.900096] systemd[1]: Reached target Preparation for Local File Systems.1977worker2 # [ 1.901160] systemd[1]: Reached target Local File Systems.1978worker2 # [ 1.903948] systemd[1]: Starting Create System Files and Directories...1979lb # [ 1.910287] systemd[1]: Started Rule-based Manager for Device Events and Files.1980worker2 # [ 1.913416] systemd[1]: Starting Rule-based Manager for Device Events and Files...1981worker1 # [ 1.920372] systemd-modules-load[68]: Inserted module 'dm_mod'[ 2.062283] systemd[1]: Started Journal Service.1982worker1 # 1983worker1 # [ 1.925412] systemd-modules-load[68]: Inserted module 'virtio_balloon'1984worker1 # [ 1.926540] systemd-modules-load[68]: Inserted module 'virtio_gpu'1985client # [ 1.933420] systemd-udevd[83]: Using default interface naming scheme 'v261'.1986worker1 # [ 1.935129] systemd[1]: Finished Apply Kernel Variables.1987worker2 # [ 1.944460] systemd[1]: Finished Create System Files and Directories.1988client # [ 1.959121] systemd[1]: Started Rule-based Manager for Device Events and Files.1989worker1 # [ 1.957222] systemd[1]: Finished Create Static Device Nodes in /dev.1990worker1 # [ 1.958274] systemd[1]: Reached target Preparation for Local File Systems.1991lb # [ 1.954761] systemd[1]: Finished Coldplug All udev Devices.1992worker1 # [ 1.959241] systemd[1]: Reached target Local File Systems.1993lb # [ 1.955810] systemd[1]: Reached target System Initialization.1994lb # [ 1.957162] systemd[1]: Reached target Basic System.1995worker1 # [ 1.962141] systemd[1]: Starting Create System Files and Directories...1996worker1 # [ 1.969070] systemd[1]: Starting Rule-based Manager for Device Events and Files...1997worker2 # [ 1.967421] systemd-udevd[83]: Using default interface naming scheme 'v261'.1998worker2 # [ 1.993050] systemd[1]: Started Rule-based Manager for Device Events and Files.1999client # [ 2.009284] systemd[1]: Finished Coldplug All udev Devices.2000client # [ 2.010243] systemd[1]: Reached target System Initialization.
loading 1,531 hidden lines…
3532worker2 # [ 9.374363] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os3533lb # [ 9.377291] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3534lb # [ 9.381700] systemd[1]: Stopped Virtual Console Setup.3535lb # [ 9.395595] systemd[1]: Starting Virtual Console Setup...3536lb # [ 9.464208] dhcpcd[649]: dhcpcd-10.3.2 starting3537lb # [ 9.477424] dhcpcd[709]: dev: loaded udev3538client # [ 9.494688] dhcpcd[556]: dhcpcd-10.3.2 starting3539client # [ 9.503572] dhcpcd[565]: dev: loaded udev3540worker2 # [ 9.640569] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console3541lb # [ 9.498874] systemd[1]: Finished Extra networking commands..3542lb # [ 9.502478] systemd[1]: Reached target Network.3543lb # [ 9.644219] 8021q: 802.1Q VLAN Support v1.83544lb # [ 9.644798] 8021q: adding VLAN 0 to HW filter on device eth13545worker2 # [ 9.652023] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input33546lb # [ 9.513595] systemd[1]: Starting PostgreSQL Server...3547client # [ 9.656354] 8021q: 802.1Q VLAN Support v1.83548lb # [ 9.519795] systemd[1]: Starting Permit User Sessions...3549lb # [ 9.661695] ppdev: user-space parallel port driver3550client # [ 9.549304] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3551lb # [ 9.709107] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660)3552worker1 # [ 9.558212] mousedev: PS/2 mouse device common for all mice3553worker1 # [ 9.678689] rtc_cmos 00:04: RTC can wake from S43554worker1 # [ 9.701473] rtc_cmos 00:04: registered as rtc03555lb # [ 9.603803] systemd[1]: Finished Permit User Sessions.3556worker1 # [ 9.701566] rtc_cmos 00:04: setting system clock to 2026-09-20T07:56:19 UTC (1789890979)3557worker1 # [ 9.701649] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs3558client # [ 9.755284] cfg80211: Loading compiled-in X.509 certificates for regulatory database3559lb # [ 9.615846] systemd[1]: Started Getty on tty1.3560lb # [ 9.620274] systemd[1]: Reached target Login Prompts.3561worker1 # [ 9.703239] systemd-journald[286]: Time jumped backwards, rotating.3562worker1 # [ 9.726406] parport_pc 00:02: reported by Plug and Play ACPI3563worker1 # [ 9.726494] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]3564client # [ 9.637212] systemd[1]: Finished nftables firewall.3565client # [ 9.639378] systemd[1]: Reached target Preparation for Network.3566client # [ 9.643428] systemd[1]: Starting Address configuration of eth1...3567client # [ 9.647699] systemd[1]: Starting Extra networking commands....3568client # [ 9.784921] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3569client # [ 9.786531] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3570client # [ 9.789340] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23571client # [ 9.790198] cfg80211: failed to load regulatory.db3572lb # [ 9.661099] systemd-logind[555]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3573worker1 # [ 9.731553] Console: switching to colour dummy device 80x253574worker1 # [ 9.743874] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input43575lb # [ 9.818641] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0)3576worker1 # [ 9.688273] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.3577worker1 # [ 9.689775] systemd[1]: Finished Create SUID/SGID Wrappers.3578worker1 # [ 9.745387] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized3579worker1 # [ 9.851533] [drm] Found bochs VGA, ID 0xb0c5.3580worker1 # [ 9.851535] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.3581client # [ 9.853657] 8021q: adding VLAN 0 to HW filter on device eth03582client # [ 9.721683] dhcpcd[565]: eth0: waiting for carrier3583client # [ 9.722777] dhcpcd[565]: eth0: carrier acquired3584client # [ 9.859528] 8021q: adding VLAN 0 to HW filter on device eth13585worker1 # [ 9.868465] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic3586client # [ 9.735349] dhcpcd[565]: DUID 00:01:00:01:32:42:4e:23:52:54:00:12:34:563587client # [ 9.736365] dhcpcd[565]: eth0: IAID 00:12:34:563588client # [ 9.737088] dhcpcd[565]: eth0: adding address fe80::5054:ff:fe12:34563589client # [ 9.743528] network-addresses-eth1-start[579]: adding address 192.168.1.1/24... done3590worker1 # [ 9.880890] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 03591client # [ 9.756133] network-addresses-eth1-start[579]: adding address 2001:db8:1::1/64... done3592worker1 # [ 9.894301] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt3593worker1 # [ 9.895012] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD3594client # [ 9.771863] systemd[1]: Finished Address configuration of eth1.3595worker2 # [ 9.712306] ACPI: button: Power Button [PWRF]3596client # [ 9.797136] systemd[1]: Finished Extra networking commands..3597client # [ 9.798934] systemd[1]: Reached target Network.3598client # [ 9.802313] systemd[1]: Starting Permit User Sessions...3599worker2 # [ 9.759741] mousedev: PS/2 mouse device common for all mice3600worker2 # [ 9.823521] rtc_cmos 00:04: RTC can wake from S43601worker2 # [ 9.855311] rtc_cmos 00:04: registered as rtc03602worker2 # [ 9.855394] rtc_cmos 00:04: setting system clock to 2026-09-20T07:56:19 UTC (1789890979)3603client # [ 9.826885] systemd[1]: Finished Permit User Sessions.3604client # [ 9.830491] systemd[1]: Started Getty on tty1.3605client # [ 9.831802] systemd[1]: Reached target Login Prompts.3606lb # [ 9.966029] cfg80211: Loading compiled-in X.509 certificates for regulatory database3607lb # [ 9.842988] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3608worker2 # [ 9.855500] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs3609worker2 # [ 9.857560] systemd-journald[286]: Time jumped backwards, rotating.3610worker2 # [ 9.900733] parport_pc 00:02: reported by Plug and Play ACPI3611lb # [ 9.996992] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3612lb # [ 9.997744] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3613lb # [ 10.007975] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23614lb # [ 10.009018] cfg80211: failed to load regulatory.db3615worker1 # [ 9.882291] systemd[1]: Finished register-nix-paths.service.3616worker1 # [ 9.885143] systemd[1]: Reached target System Initialization.3617worker1 # [ 9.887633] systemd[1]: Started Discard unused filesystem blocks once a week.3618worker1 # [ 9.888870] systemd[1]: Started Daily Cleanup of Temporary Directories.3619worker1 # [ 9.889949] systemd[1]: Reached target Timer Units.3620worker1 # [ 9.891141] systemd[1]: Listening on D-Bus System Message Bus Socket.3621worker1 # [ 9.892289] systemd[1]: Listening on Nix Daemon Socket.3622worker1 # [ 9.894127] systemd[1]: Listening on Nix worker-protocol over gRPC.3623worker1 # [ 9.895111] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.3624worker1 # [ 9.897147] systemd[1]: Reached target Socket Units.3625lb # [ 9.893745] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3626worker1 # [ 9.897990] systemd[1]: Reached target Basic System.3627worker2 # [ 9.900891] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]3628worker2 # [ 9.925754] Console: switching to colour dummy device 80x253629worker1 # [ 9.900259] systemd[1]: Started backdoor.service.3630worker2 # [ 9.934324] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input43631lb # [ 9.896453] systemd[1]: Stopped Virtual Console Setup.3632worker1 # [ 9.977833] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input63633worker1 # [ 9.905061] systemd[1]: Starting Import lastlog data into lastlog2 database...3634worker1 # [ 9.909065] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3635worker1 # [ 9.914158] systemd[1]: Starting Post-Boot Actions...3636worker1 # [ 9.921580] systemd[1]: Started Reset console on configuration changes.3637lb # [ 9.922439] postgresql-pre-start[728]: The files belonging to this database system will be owned by user "postgres".3638lb # [ 9.924089] postgresql-pre-start[728]: This user must also own the server process.3639worker1 # [ 9.929380] systemd[1]: Starting resolvconf update...3640worker2 # [ 9.925732] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.3641lb # [ 9.928128] systemd[1]: Starting Virtual Console Setup...3642worker2 # [ 9.929425] systemd[1]: Finished Create SUID/SGID Wrappers.3643worker1 # [ 9.938961] systemd[1]: Starting D-Bus System Message Bus...3644lb # [ 9.936856] postgresql-pre-start[728]: The database cluster will be initialized with locale "en_US.UTF-8".3645lb # [ 9.938075] postgresql-pre-start[728]: The default database encoding has accordingly been set to "UTF8".3646lb # [ 9.939210] postgresql-pre-start[728]: The default text search configuration will be set to "english".3647lb # [ 9.940331] postgresql-pre-start[728]: Data page checksums are enabled.3648lb # [ 9.941235] postgresql-pre-start[728]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3649worker2 # [ 10.021313] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized3650worker2 # [ 10.085684] [drm] Found bochs VGA, ID 0xb0c5.3651worker2 # [ 10.085687] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.3652lb # [ 9.944172] postgresql-pre-start[728]: creating subdirectories ... ok3653lb # [ 9.946555] postgresql-pre-start[728]: selecting dynamic shared memory implementation ... posix3654worker2 # [ 10.103224] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic3655worker2 # [ 10.103977] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 03656worker2 # [ 10.119718] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt3657worker2 # [ 10.120454] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD3658worker2 # [ 9.988312] systemd[1]: Finished register-nix-paths.service.3659worker2 # [ 9.989262] systemd[1]: Reached target System Initialization.3660worker2 # [ 9.990813] systemd[1]: Started Discard unused filesystem blocks once a week.3661worker2 # [ 9.992897] systemd[1]: Started Daily Cleanup of Temporary Directories.3662worker2 # [ 9.994190] systemd[1]: Reached target Timer Units.3663worker2 # [ 9.995946] systemd[1]: Listening on D-Bus System Message Bus Socket.3664worker1 # [ 10.002315] systemd[1]: Starting Virtual Console Setup...3665worker2 # [ 9.997576] systemd[1]: Listening on Nix Daemon Socket.3666worker2 # [ 10.001128] systemd[1]: Listening on Nix worker-protocol over gRPC.3667worker2 # [ 10.002073] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.3668worker2 # [ 10.004187] systemd[1]: Reached target Socket Units.3669worker2 # [ 10.004913] systemd[1]: Reached target Basic System.3670worker2 # [ 10.007222] systemd[1]: Started backdoor.service.3671worker2 # [ 10.011124] systemd[1]: Starting Import lastlog data into lastlog2 database...3672worker2 # [ 10.016094] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3673lb # [ 10.158223] 8021q: adding VLAN 0 to HW filter on device eth03674worker1 # [ 10.027205] systemd[1]: Finished Post-Boot Actions.3675lb # [ 10.023328] dhcpcd[709]: eth0: waiting for carrier3676worker2 # [ 10.022186] systemd[1]: Starting Post-Boot Actions...3677lb # [ 10.024620] dhcpcd[709]: eth0: carrier acquired3678worker2 # [ 10.032741] systemd[1]: Started Reset console on configuration changes.3679worker2 # [ 10.039733] systemd[1]: Starting resolvconf update...3680lb # [ 10.041931] dhcpcd[709]: DUID 00:01:00:01:32:42:4e:24:52:54:00:12:34:563681lb # [ 10.042861] dhcpcd[709]: eth0: IAID 00:12:34:563682lb # [ 10.043512] dhcpcd[709]: eth0: adding address fe80::5054:ff:fe12:34563683worker1 # [ 9.978126] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input53684worker2 # [ 10.049862] systemd[1]: Starting D-Bus System Message Bus...3685worker1 # [ 10.080274] nsncd[577]: Sep 20 07:56:20.013 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3686worker1 # [ 10.086266] systemd[1]: Started Name Service Cache Daemon (nsncd).3687lb # [ 10.219656] kvm_amd: TSC scaling supported3688worker1 # connecting to host...3689lb # [ 10.220523] kvm_amd: Nested Virtualization enabled3690lb # [ 10.221752] kvm_amd: Nested Paging enabled3691lb # [ 10.222728] kvm_amd: LBR virtualization supported3692worker1 # [ 10.089604] systemd[1]: Reached target Host and Network Name Lookups.3693lb # [ 10.223831] kvm_amd: Virtual VMLOAD VMSAVE supported3694lb # [ 10.224795] kvm_amd: Virtual GIF supported3695worker1 # [ 10.092177] systemd[1]: Reached target User and Group Name Lookups.3696lb # [ 10.225616] kvm_amd: Virtual NMI enabled3697worker1 # [ 10.093975] systemd[1]: Starting User Login Management...3698worker1 # [ 10.042309] Console: switching to colour frame buffer device 160x503699worker1 # [ 10.255939] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device3700worker1 # [ 10.112149] systemd[1]: Finished Import lastlog data into lastlog2 database.3701worker1 # [ 10.129498] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3702worker1 # [ 10.130559] systemd[1]: Stopped Virtual Console Setup.3703worker1 # [ 10.134432] systemd[1]: Starting Virtual Console Setup...3704lb # [ 10.146933] postgresql-pre-start[728]: selecting default "max_connections" ... 1003705worker2 # [ 10.147818] systemd[1]: Finished Post-Boot Actions.3706worker1 # [ 10.181551] dbus-broker-launch[581]: Looking up NSS user entry for 'systemd-timesync'...3707worker2 # [ 10.178913] nsncd[575]: Sep 20 07:56:19.966 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3708worker2 # connecting to host...3709worker2 # [ 10.187474] systemd[1]: Started Name Service Cache Daemon (nsncd).3710worker2 # [ 10.192272] systemd[1]: Reached target Host and Network Name Lookups.3711worker1 # [ 10.199544] dbus-broker-launch[581]: NSS returned no entry for 'systemd-timesync'3712worker2 # [ 10.194599] systemd[1]: Reached target User and Group Name Lookups.3713worker2 # [ 10.196672] systemd[1]: Starting User Login Management...3714worker1 # [ 10.201353] dbus-broker-launch[581]: Invalid user-name in /nix/store/pzs6i23mwy5m8gakj05x4d0nyhml04hg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3715lb # [ 10.337918] EDAC MC: Ver: 3.0.03716worker1 # [ 10.233872] systemd[1]: Started D-Bus System Message Bus.3717worker2 # [ 10.230157] systemd[1]: Finished Import lastlog data into lastlog2 database.3718lb # [ 10.249358] postgresql-pre-start[728]: selecting default "shared_buffers" ... 128MB3719worker1 # [ 10.267113] systemd[1]: Stopped target Host and Network Name Lookups.3720worker1 # [ 10.269383] systemd[1]: Stopping Host and Network Name Lookups...3721worker1 # [ 10.271533] systemd[1]: Stopped target User and Group Name Lookups.3722worker1 # [ 10.274737] systemd[1]: Stopping User and Group Name Lookups...3723worker1 # [ 10.277940] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3724worker1 # [ 10.279412] systemd[1]: nscd.service: Deactivated successfully.3725worker2 # [ 10.276671] dbus-broker-launch[579]: Looking up NSS user entry for 'systemd-timesync'...3726worker1 # [ 10.282627] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3727worker1 # [ 10.288904] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3728worker2 # [ 10.296268] dbus-broker-launch[579]: NSS returned no entry for 'systemd-timesync'3729worker1 # [ 10.303831] dbus-broker-launch[581]: Ready3730worker2 # [ 10.299379] dbus-broker-launch[579]: Invalid user-name in /nix/store/pzs6i23mwy5m8gakj05x4d0nyhml04hg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3731worker1 # [ 10.311528] systemd-logind[601]: Watching system buttons on /dev/input/event2 (Power Button)3732worker1 # [ 10.313956] systemd-logind[601]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3733worker1 # [ 10.316914] systemd-logind[601]: New seat seat0.3734lb # [ 10.314741] systemd-vconsole-setup[741]: Configuration of first virtual console was skipped, ignoring remaining ones.3735worker1 # [ 10.321068] systemd[1]: Started User Login Management.3736lb # [ 10.318410] systemd[1]: Finished Virtual Console Setup.3737worker1 # [ 10.325602] systemd[1]: Starting linger-users.service...3738worker1 # [ 10.470252] ppdev: user-space parallel port driver3739worker2 # [ 10.333581] systemd[1]: Started D-Bus System Message Bus.3740client: (finished: waiting for unit network-addresses-eth1.service, in 11.04 seconds)3741worker2 # [ 10.359083] systemd[1]: Stopped target Host and Network Name Lookups.3742client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3743worker2 # [ 10.360982] systemd[1]: Stopping Host and Network Name Lookups...3744worker2 # [ 10.362544] systemd[1]: Stopped target User and Group Name Lookups.3745worker2 # [ 10.366171] systemd[1]: Stopping User and Group Name Lookups...3746worker2 # [ 10.368921] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3747worker1 # [ 10.377060] systemd[1]: Started Name Service Cache Daemon (nsncd).3748worker1 # [ 10.379392] systemd[1]: Reached target Host and Network Name Lookups.3749worker1 # [ 10.380359] systemd[1]: Reached target User and Group Name Lookups.3750worker2 # [ 10.375888] systemd[1]: nscd.service: Deactivated successfully.3751worker2 # [ 10.376904] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3752worker1 # [ 10.383178] nsncd[652]: Sep 20 07:56:20.316 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3753worker1 # [ 10.396257] systemd[1]: linger-users.service: Deactivated successfully.3754worker1 # [ 10.398865] systemd[1]: Finished linger-users.service.3755client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3756worker1 # [ 10.406100] systemd[1]: Finished resolvconf update.3757lb: waiting for unit network-addresses-eth1.service3758lb: waiting for the VM to finish booting3759worker1 # [ 10.406760] systemd[1]: Reached target Preparation for Network.3760lb: Guest shell says: b'Spawning backdoor root shell...\n'3761lb: connected to guest root shell3762lb: (connecting took 0.00 seconds)3763lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3764worker1 # [ 10.413124] systemd[1]: Starting DHCP Client...3765worker1 # [ 10.416743] systemd[1]: Starting Address configuration of eth1...3766worker2 # [ 10.305896] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input63767worker1 # [ 10.421270] systemd[1]: Starting Extra networking commands....3768worker2 # [ 10.306177] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input53769lb: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds)3770lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3771lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.02 seconds)3772worker2 # [ 10.500838] Console: switching to colour frame buffer device 160x503773worker1: waiting for unit network-addresses-eth1.service3774worker1: waiting for the VM to finish booting3775worker1: Guest shell says: b'Spawning backdoor root shell...\n'3776worker1: connected to guest root shell3777worker1: (connecting took 0.00 seconds)3778worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3779worker1 # [ 10.631586] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660)3780worker2 # [ 10.646329] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device3781worker2 # [ 10.387107] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3782worker2 # [ 10.505602] dbus-broker-launch[579]: Ready3783worker2 # [ 10.514167] systemd[1]: Starting Virtual Console Setup...3784worker2 # [ 10.518375] nsncd[648]: Sep 20 07:56:20.262 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3785worker2 # [ 10.520791] systemd[1]: Started Name Service Cache Daemon (nsncd).3786worker2 # [ 10.526636] systemd[1]: Reached target Host and Network Name Lookups.3787worker2 # [ 10.527904] systemd[1]: Reached target User and Group Name Lookups.3788worker1 # [ 10.537053] systemd-logind[601]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3789worker2 # [ 10.532113] systemd[1]: Finished resolvconf update.3790worker2 # [ 10.532858] systemd[1]: Reached target Preparation for Network.3791worker2 # [ 10.535659] systemd[1]: Starting DHCP Client...3792worker2 # [ 10.537336] systemd[1]: Starting Address configuration of eth1...3793worker2 # [ 10.538304] systemd[1]: Starting Extra networking commands....3794worker2 # [ 10.543924] systemd-logind[598]: New seat seat0.3795worker2 # [ 10.544764] systemd[1]: Started User Login Management.3796worker2 # [ 10.546668] systemd-logind[598]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3797worker2 # [ 10.549340] systemd-logind[598]: Watching system buttons on /dev/input/event2 (Power Button)3798worker2 # [ 10.553243] systemd[1]: Starting linger-users.service...3799client # [ 10.564718] dhcpcd[565]: eth0: soliciting a DHCP lease3800worker1 # [ 10.581139] network-addresses-eth1-start[681]: adding address 192.168.1.3/24... done3801client # [ 10.724473] NET: Registered PF_PACKET protocol family3802worker2 # [ 10.586875] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3803client # [ 10.596865] dhcpcd[565]: eth0: offered 10.0.2.15 from 10.0.2.23804worker2 # [ 10.591800] systemd[1]: Stopped Virtual Console Setup.3805worker1 # [ 10.738532] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0)3806client # [ 10.601362] dhcpcd[565]: eth0: probing address 10.0.2.15/243807worker2 # [ 10.599451] systemd[1]: Starting Virtual Console Setup...3808worker1 # [ 10.605852] network-addresses-eth1-start[681]: adding address 2001:db8:1::3/64... done3809worker1 # [ 10.635679] systemd[1]: Finished Address configuration of eth1.3810worker1 # [ 10.648216] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3811worker1 # [ 10.649636] systemd[1]: Stopped Virtual Console Setup.3812worker1 # [ 10.654737] systemd[1]: Starting Virtual Console Setup...3813worker2 # [ 10.649942] systemd[1]: linger-users.service: Deactivated successfully.3814worker2 # [ 10.652457] systemd[1]: Finished linger-users.service.3815worker2 # [ 10.717621] network-addresses-eth1-start[675]: adding address 192.168.1.4/24... done3816worker1 # [ 10.735887] dhcpcd[693]: dhcpcd-10.3.2 starting3817worker2 # [ 10.738598] network-addresses-eth1-start[675]: adding address 2001:db8:1::4/64... done3818worker1 # [ 10.745299] systemd[1]: Finished Extra networking commands..3819worker1 # [ 10.746118] systemd[1]: Reached target Network.3820worker1 # [ 10.749458] systemd[1]: Starting Permit User Sessions...3821worker1 # [ 10.753259] dhcpcd[754]: dev: loaded udev3822worker2 # [ 10.766446] systemd[1]: Finished Address configuration of eth1.3823worker2 # [ 10.914948] ppdev: user-space parallel port driver3824worker1 # [ 10.955254] 8021q: 802.1Q VLAN Support v1.83825worker1 # [ 10.955695] 8021q: adding VLAN 0 to HW filter on device eth13826worker1 # [ 10.826803] systemd[1]: Finished Permit User Sessions.3827worker1 # [ 10.835217] systemd[1]: Started Getty on tty1.3828worker1 # [ 10.835904] systemd[1]: Reached target Login Prompts.3829worker1 # [ 10.856069] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3830worker2 # [ 10.852612] dhcpcd[689]: dhcpcd-10.3.2 starting3831worker2 # [ 10.864750] systemd[1]: Finished Extra networking commands..3832worker2 # [ 10.868586] systemd[1]: Reached target Network.3833worker2 # [ 10.871444] dhcpcd[748]: dev: loaded udev3834worker2 # [ 10.873370] systemd[1]: Starting Permit User Sessions...3835worker2 # [ 11.018734] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660)3836worker1 # [ 11.029039] kvm_amd: TSC scaling supported3837worker1 # [ 11.030666] kvm_amd: Nested Virtualization enabled3838worker1 # [ 11.033416] kvm_amd: Nested Paging enabled3839worker1 # [ 11.033866] kvm_amd: LBR virtualization supported3840worker1 # [ 11.035779] kvm_amd: Virtual VMLOAD VMSAVE supported3841worker1 # [ 11.037150] kvm_amd: Virtual GIF supported3842worker1 # [ 11.037539] kvm_amd: Virtual NMI enabled3843worker2 # [ 11.038631] 8021q: 802.1Q VLAN Support v1.83844worker2 # [ 11.041320] 8021q: adding VLAN 0 to HW filter on device eth13845worker2 # [ 10.909776] systemd-logind[598]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3846worker1 # [ 11.074865] cfg80211: Loading compiled-in X.509 certificates for regulatory database3847worker2 # [ 11.084500] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0)3848worker2 # [ 10.955792] systemd[1]: Finished Permit User Sessions.3849worker2 # [ 10.961823] systemd[1]: Started Getty on tty1.3850worker1 # [ 11.108456] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3851worker2 # [ 10.963559] systemd[1]: Reached target Login Prompts.3852worker1 # [ 11.111173] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3853worker1 # [ 11.112967] EDAC MC: Ver: 3.0.03854worker1 # [ 11.114482] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23855worker1 # [ 11.115370] cfg80211: failed to load regulatory.db3856worker2 # [ 10.991918] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3857worker2 # [ 10.995317] systemd[1]: Stopped Virtual Console Setup.3858worker2 # [ 11.010202] systemd[1]: Starting Virtual Console Setup...3859worker1 # [ 11.169835] 8021q: adding VLAN 0 to HW filter on device eth03860worker1 # [ 11.031061] dhcpcd[754]: eth0: waiting for carrier3861worker1 # [ 11.033267] dhcpcd[754]: libudev: received NULL device3862worker1 # [ 11.033991] dhcpcd[754]: libudev: received NULL device3863worker1 # [ 11.035104] dhcpcd[754]: eth0: carrier acquired3864worker1 # [ 11.044942] dhcpcd[754]: DUID 00:01:00:01:32:42:4e:24:52:54:00:12:34:563865worker1 # [ 11.046099] dhcpcd[754]: eth0: IAID 00:12:34:563866worker1 # [ 11.046787] dhcpcd[754]: eth0: adding address fe80::5054:ff:fe12:34563867worker2 # [ 11.206296] cfg80211: Loading compiled-in X.509 certificates for regulatory database3868worker2 # [ 11.087317] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3869worker2 # [ 11.239064] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3870worker2 # [ 11.239747] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3871worker2 # [ 11.243543] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23872worker2 # [ 11.244546] cfg80211: failed to load regulatory.db3873worker1 # [ 11.129921] systemd-vconsole-setup[726]: Configuration of first virtual console was skipped, ignoring remaining ones.3874worker1 # [ 11.133644] systemd[1]: Finished Virtual Console Setup.3875worker2 # [ 11.353355] kvm_amd: TSC scaling supported3876worker2 # [ 11.353842] kvm_amd: Nested Virtualization enabled3877worker2 # [ 11.354628] 8021q: adding VLAN 0 to HW filter on device eth03878worker2 # [ 11.212162] dhcpcd[748]: eth0: waiting for carrier3879worker2 # [ 11.212921] dhcpcd[748]: eth0: carrier acquired3880worker2 # [ 11.357999] kvm_amd: Nested Paging enabled3881worker2 # [ 11.358484] kvm_amd: LBR virtualization supported3882worker2 # [ 11.359282] kvm_amd: Virtual VMLOAD VMSAVE supported3883worker2 # [ 11.360126] kvm_amd: Virtual GIF supported3884worker2 # [ 11.360688] kvm_amd: Virtual NMI enabled3885worker2 # [ 11.229757] dhcpcd[748]: DUID 00:01:00:01:32:42:4e:25:52:54:00:12:34:563886worker2 # [ 11.230928] dhcpcd[748]: eth0: IAID 00:12:34:563887worker2 # [ 11.231930] dhcpcd[748]: eth0: adding address fe80::5054:ff:fe12:34563888worker2 # [ 11.432476] EDAC MC: Ver: 3.0.03889lb # [ 11.321414] dhcpcd[709]: eth0: soliciting a DHCP lease3890lb # [ 11.473133] NET: Registered PF_PACKET protocol family3891lb # [ 11.341425] dhcpcd[709]: eth0: offered 10.0.2.15 from 10.0.2.23892worker2 # [ 11.341979] dhcpcd[748]: eth0: soliciting a DHCP lease3893lb # [ 11.344168] dhcpcd[709]: eth0: probing address 10.0.2.15/243894worker2 # [ 11.502185] NET: Registered PF_PACKET protocol family3895worker2 # [ 11.363645] dhcpcd[748]: eth0: offered 10.0.2.15 from 10.0.2.23896worker2 # [ 11.366229] dhcpcd[748]: eth0: probing address 10.0.2.15/243897worker2 # [ 11.421046] systemd-vconsole-setup[756]: Configuration of first virtual console was skipped, ignoring remaining ones.3898worker2 # [ 11.425147] systemd[1]: Finished Virtual Console Setup.3899worker1: (finished: waiting for unit network-addresses-eth1.service, in 1.16 seconds)3900worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3901lb # [ 11.656091] dhcpcd[709]: eth0: soliciting an IPv6 router3902lb # [ 11.657697] dhcpcd[709]: eth0: Router Advertisement from fe80::23903lb # [ 11.658951] dhcpcd[709]: eth0: adding address fec0::5054:ff:fe12:3456/643904lb # [ 11.660399] dhcpcd[709]: eth0: adding route to fec0::/643905lb # [ 11.661670] dhcpcd[709]: eth0: adding default route via fe80::23906worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3907worker2: waiting for unit network-addresses-eth1.service3908worker2: waiting for the VM to finish booting3909worker2: Guest shell says: b'Spawning backdoor root shell...\n'3910worker2: connected to guest root shell3911worker2: (connecting took 0.00 seconds)3912worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3913worker1 # [ 11.692541] dhcpcd[754]: eth0: soliciting a DHCP lease3914worker1 # [ 11.847547] NET: Registered PF_PACKET protocol family3915worker1 # [ 11.712555] dhcpcd[754]: eth0: offered 10.0.2.15 from 10.0.2.23916worker1 # [ 11.716137] dhcpcd[754]: eth0: probing address 10.0.2.15/243917worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds)3918worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3919worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3920lb: waiting for unit niks3.service3921lb # [ 12.029721] postgresql-pre-start[728]: selecting default time zone ... UTC3922lb # [ 12.033823] postgresql-pre-start[728]: creating configuration files ... ok3923client # [ 12.057453] dhcpcd[565]: eth0: soliciting an IPv6 router3924client # [ 12.060426] dhcpcd[565]: eth0: Router Advertisement from fe80::23925client # [ 12.062575] dhcpcd[565]: eth0: adding address fec0::5054:ff:fe12:3456/643926client # [ 12.064853] dhcpcd[565]: eth0: adding route to fec0::/643927client # [ 12.066172] dhcpcd[565]: eth0: adding default route via fe80::23928lb # [ 12.277632] postgresql-pre-start[728]: running bootstrap script ... ok3929lb # [ 12.831477] postgresql-pre-start[728]: performing post-bootstrap initialization ... ok3930lb # [ 12.976758] postgresql-pre-start[728]: syncing data to disk ... ok3931lb # [ 12.977690] postgresql-pre-start[728]: initdb: warning: enabling "trust" authentication for local connections3932lb # [ 12.978904] postgresql-pre-start[728]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3933lb # [ 12.981130] postgresql-pre-start[728]: Success. You can now start the database server using:3934lb # [ 12.982334] postgresql-pre-start[728]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3935lb # [ 13.082266] postgres[798]: [798] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3936lb # [ 13.087320] postgres[798]: [798] LOG: listening on IPv6 address "::1", port 54323937lb # [ 13.088396] postgres[798]: [798] LOG: listening on IPv4 address "127.0.0.1", port 54323938lb # [ 13.090862] postgres[798]: [798] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3939lb # [ 13.104256] postgres[807]: [807] LOG: database system was shut down at 2026-09-20 07:56:22 GMT3940lb # [ 13.107981] postgres[798]: [798] LOG: database system is ready to accept connections3941lb # [ 13.113480] systemd[1]: Started PostgreSQL Server.3942lb # [ 13.120110] systemd[1]: Starting PostgreSQL Setup Scripts...3943worker2 # [ 13.249862] dhcpcd[748]: eth0: soliciting an IPv6 router3944worker2 # [ 13.251265] dhcpcd[748]: eth0: Router Advertisement from fe80::23945worker2 # [ 13.252101] dhcpcd[748]: eth0: adding address fec0::5054:ff:fe12:3456/643946worker2 # [ 13.252931] dhcpcd[748]: eth0: adding route to fec0::/643947worker2 # [ 13.253708] dhcpcd[748]: eth0: adding default route via fe80::23948lb # [ 13.323353] postgresql-setup-start[818]: CREATE DATABASE3949lb # [ 13.371871] postgresql-setup-start[823]: CREATE ROLE3950lb # [ 13.397177] postgresql-setup-start[825]: ALTER DATABASE3951lb # [ 13.403460] systemd[1]: Finished PostgreSQL Setup Scripts.3952lb # [ 13.405281] systemd[1]: Reached target PostgreSQL.3953worker1 # [ 13.848882] dhcpcd[754]: eth0: soliciting an IPv6 router3954worker1 # [ 13.850700] dhcpcd[754]: eth0: Router Advertisement from fe80::23955worker1 # [ 13.851844] dhcpcd[754]: eth0: adding address fec0::5054:ff:fe12:3456/643956worker1 # [ 13.852975] dhcpcd[754]: eth0: adding route to fec0::/643957worker1 # [ 13.853826] dhcpcd[754]: eth0: adding default route via fe80::23958client # [ 15.744984] dhcpcd[565]: eth0: leased 10.0.2.15 for 86400 seconds3959client # [ 15.748820] dhcpcd[565]: eth0: adding route to 10.0.2.0/243960client # [ 15.751410] dhcpcd[565]: eth0: adding default route via 10.0.2.23961client # [ 15.852337] systemd[1]: Started DHCP Client.3962client # [ 15.854370] systemd[1]: Reached target Multi-User System.3963client # [ 15.855798] systemd[1]: Startup finished in 903ms (kernel) + 4.036s (initrd) + 10.915s (userspace) = 15.855s.3964worker2 # [ 16.100826] dhcpcd[748]: eth0: leased 10.0.2.15 for 86400 seconds3965worker2 # [ 16.102310] dhcpcd[748]: eth0: adding route to 10.0.2.0/243966worker2 # [ 16.103329] dhcpcd[748]: eth0: adding default route via 10.0.2.23967worker2 # [ 16.187146] systemd[1]: Started DHCP Client.3968worker2 # [ 16.189191] systemd[1]: Reached target Multi-User System.3969worker2 # [ 16.190565] systemd[1]: Startup finished in 917ms (kernel) + 5.004s (initrd) + 10.268s (userspace) = 16.190s.3970lb # [ 16.796604] dhcpcd[709]: eth0: leased 10.0.2.15 for 86400 seconds3971lb # [ 16.797799] dhcpcd[709]: eth0: adding route to 10.0.2.0/243972lb # [ 16.799084] dhcpcd[709]: eth0: adding default route via 10.0.2.23973lb # [ 16.894523] systemd[1]: Started DHCP Client.3974lb # [ 16.896572] systemd[1]: Reached target Network is Online.3975lb # [ 16.900914] systemd[1]: Started Envoy reverse proxy.3976lb # [ 16.904225] systemd[1]: Started mock-oidc.service.3977lb # [ 16.995183] mock-oidc-server[917]: Mock OIDC Server running3978lb # [ 16.996087] mock-oidc-server[917]: OIDC Address: 192.168.1.2:80803979lb # [ 16.996956] mock-oidc-server[917]: Issue Address: 0.0.0.0:80813980lb # [ 16.997916] mock-oidc-server[917]: Issuer: http://192.168.1.2:8080/oidc3981lb # [ 16.999548] mock-oidc-server[917]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3982lb # [ 17.000936] mock-oidc-server[917]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3983lb # [ 17.002494] mock-oidc-server[917]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3984worker1 # [ 17.306869] dhcpcd[754]: eth0: leased 10.0.2.15 for 86400 seconds3985worker1 # [ 17.307825] dhcpcd[754]: eth0: adding route to 10.0.2.0/243986worker1 # [ 17.308574] dhcpcd[754]: eth0: adding default route via 10.0.2.23987worker1 # [ 17.432958] systemd[1]: Started DHCP Client.3988worker1 # [ 17.434948] systemd[1]: Reached target Multi-User System.3989worker1 # [ 17.436249] systemd[1]: Startup finished in 922ms (kernel) + 5.060s (initrd) + 11.452s (userspace) = 17.435s.3990lb # [ 17.456510] envoy[916]: [2026-09-20 07:56:27.632][916][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3991lb # [ 17.458871] envoy[916]: [2026-09-20 07:56:27.634][916][info][main] [source/server/server.cc:469] statically linked extensions:3992lb # [ 17.460645] envoy[916]: [2026-09-20 07:56:27.634][916][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3993lb # [ 17.462560] envoy[916]: [2026-09-20 07:56:27.634][916][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3994lb # [ 17.464688] envoy[916]: [2026-09-20 07:56:27.634][916][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3995lb # [ 17.467275] envoy[916]: [2026-09-20 07:56:27.634][916][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3996lb # [ 17.469669] envoy[916]: [2026-09-20 07:56:27.634][916][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3997lb # [ 17.471412] envoy[916]: [2026-09-20 07:56:27.634][916][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3998lb # [ 17.474089] envoy[916]: [2026-09-20 07:56:27.636][916][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3999lb # [ 17.476166] envoy[916]: [2026-09-20 07:56:27.636][916][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24000lb # [ 17.477732] envoy[916]: [2026-09-20 07:56:27.636][916][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4001lb # [ 17.482192] envoy[916]: [2026-09-20 07:56:27.636][916][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4002lb # [ 17.517473] envoy[916]: [2026-09-20 07:56:27.636][916][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4003lb # [ 17.522277] envoy[916]: [2026-09-20 07:56:27.638][916][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4004lb # [ 17.524984] envoy[916]: [2026-09-20 07:56:27.638][916][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts4005lb # [ 17.527575] envoy[916]: [2026-09-20 07:56:27.640][916][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4006lb # [ 17.529868] envoy[916]: [2026-09-20 07:56:27.640][916][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4007lb # [ 17.534133] envoy[916]: [2026-09-20 07:56:27.640][916][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4008lb # [ 17.536595] envoy[916]: [2026-09-20 07:56:27.640][916][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4009lb # [ 17.540398] envoy[916]: [2026-09-20 07:56:27.640][916][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4010lb # [ 17.542389] envoy[916]: [2026-09-20 07:56:27.640][916][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84011lb # [ 17.544082] envoy[916]: [2026-09-20 07:56:27.640][916][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4012lb # [ 17.545754] envoy[916]: [2026-09-20 07:56:27.640][916][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4013lb # [ 17.547322] envoy[916]: [2026-09-20 07:56:27.645][916][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4014lb # [ 17.553222] envoy[916]: [2026-09-20 07:56:27.645][916][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4015lb # [ 17.555336] envoy[916]: [2026-09-20 07:56:27.649][916][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4016lb # [ 17.557128] envoy[916]: [2026-09-20 07:56:27.649][916][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4017lb # [ 17.558995] envoy[916]: [2026-09-20 07:56:27.649][916][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4018lb # [ 17.561474] envoy[916]: [2026-09-20 07:56:27.649][916][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4019lb # [ 17.563344] envoy[916]: [2026-09-20 07:56:27.649][916][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4020lb # [ 17.565620] envoy[916]: [2026-09-20 07:56:27.649][916][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4021lb # [ 17.568129] envoy[916]: [2026-09-20 07:56:27.649][916][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4022lb # [ 17.569845] envoy[916]: [2026-09-20 07:56:27.649][916][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4023lb # [ 17.572160] envoy[916]: [2026-09-20 07:56:27.649][916][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4024lb # [ 17.573803] envoy[916]: [2026-09-20 07:56:27.650][916][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4025lb # [ 17.579693] envoy[916]: [2026-09-20 07:56:27.650][916][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4026lb # [ 17.581557] envoy[916]: [2026-09-20 07:56:27.657][916][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4027lb # [ 17.585102] envoy[916]: [2026-09-20 07:56:27.657][916][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4028lb # [ 17.588202] envoy[916]: [2026-09-20 07:56:27.657][916][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4029lb # [ 17.590682] envoy[916]: [2026-09-20 07:56:27.657][916][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4030lb # [ 17.592489] envoy[916]: [2026-09-20 07:56:27.657][916][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4031lb # [ 17.595722] envoy[916]: [2026-09-20 07:56:27.657][916][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4032lb # [ 17.597632] envoy[916]: [2026-09-20 07:56:27.657][916][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4033lb # [ 17.603752] envoy[916]: [2026-09-20 07:56:27.657][916][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4034lb # [ 17.605643] envoy[916]: [2026-09-20 07:56:27.657][916][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4035lb # [ 17.607417] envoy[916]: [2026-09-20 07:56:27.658][916][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4036lb # [ 17.612106] envoy[916]: [2026-09-20 07:56:27.658][916][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4037lb # [ 17.614238] envoy[916]: [2026-09-20 07:56:27.658][916][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4038lb # [ 17.616338] envoy[916]: [2026-09-20 07:56:27.658][916][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4039lb # [ 17.619273] envoy[916]: [2026-09-20 07:56:27.658][916][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4040lb # [ 17.622134] envoy[916]: [2026-09-20 07:56:27.658][916][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4041lb # [ 17.625210] envoy[916]: [2026-09-20 07:56:27.658][916][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4042lb # [ 17.629632] envoy[916]: [2026-09-20 07:56:27.658][916][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4043lb # [ 17.631209] envoy[916]: [2026-09-20 07:56:27.658][916][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4044lb # [ 17.633777] envoy[916]: [2026-09-20 07:56:27.658][916][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4045lb # [ 17.635352] envoy[916]: [2026-09-20 07:56:27.658][916][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4046lb # [ 17.636819] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4047lb # [ 17.639573] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4048lb # [ 17.641577] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4049lb # [ 17.647231] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4050lb # [ 17.649130] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4051lb # [ 17.651184] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4052lb # [ 17.655877] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4053lb # [ 17.657921] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4054lb # [ 17.662560] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4055lb # [ 17.664607] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4056lb # [ 17.667136] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4057lb # [ 17.670099] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24058lb # [ 17.672417] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options4059lb # [ 17.676467] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4060lb # [ 17.678873] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4061lb # [ 17.680765] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4062lb # [ 17.683316] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4063lb # [ 17.685801] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4064lb # [ 17.688427] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4065lb # [ 17.690137] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4066lb # [ 17.691912] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4067lb # [ 17.693700] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4068lb # [ 17.695463] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24069lb # [ 17.697263] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4070lb # [ 17.699743] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4071lb # [ 17.701590] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4072lb # [ 17.704327] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4073lb # [ 17.706283] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4074lb # [ 17.714164] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4075lb # [ 17.715781] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4076lb # [ 17.726802] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4077lb # [ 17.730763] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4078lb # [ 17.733092] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4079lb # [ 17.736262] envoy[916]: [2026-09-20 07:56:27.684][916][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4080lb # [ 17.738794] envoy[916]: [2026-09-20 07:56:27.685][916][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4081lb # [ 17.740365] envoy[916]: [2026-09-20 07:56:27.685][916][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14082lb # [ 17.742677] envoy[916]: [2026-09-20 07:56:27.685][916][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4083lb # [ 17.744731] envoy[916]: [2026-09-20 07:56:27.685][916][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4084lb # [ 17.746646] envoy[916]: [2026-09-20 07:56:27.685][916][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4085lb # [ 17.752993] envoy[916]: [2026-09-20 07:56:27.685][916][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4086lb # [ 17.755898] envoy[916]: [2026-09-20 07:56:27.685][916][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4087lb # [ 17.765599] envoy[916]: [2026-09-20 07:56:27.685][916][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4088lb # [ 17.771546] envoy[916]: [2026-09-20 07:56:27.685][916][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4089lb # [ 17.773502] envoy[916]: [2026-09-20 07:56:27.685][916][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4090lb # [ 17.775592] envoy[916]: [2026-09-20 07:56:27.685][916][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4091lb # [ 17.777630] envoy[916]: [2026-09-20 07:56:27.685][916][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4092lb # [ 17.780246] envoy[916]: [2026-09-20 07:56:27.685][916][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4093lb # [ 17.784121] envoy[916]: [2026-09-20 07:56:27.685][916][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation4094lb # [ 17.786627] envoy[916]: [2026-09-20 07:56:27.685][916][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4095lb # [ 17.788842] envoy[916]: [2026-09-20 07:56:27.685][916][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4096lb # [ 17.791181] envoy[916]: [2026-09-20 07:56:27.840][916][info][main] [source/server/server.cc:531] HTTP header map info:4097lb # [ 17.792656] envoy[916]: [2026-09-20 07:56:27.875][916][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4098lb # [ 17.807437] envoy[916]: [2026-09-20 07:56:27.875][916][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4099lb # [ 17.809383] envoy[916]: [2026-09-20 07:56:27.875][916][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4100lb # [ 17.818656] envoy[916]: [2026-09-20 07:56:27.875][916][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4101lb # [ 17.855799] envoy[916]: [2026-09-20 07:56:28.031][916][info][main] [source/server/server.cc:968] runtime: {}4102lb # [ 17.862391] envoy[916]: [2026-09-20 07:56:28.038][916][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4103lb # [ 17.864570] envoy[916]: [2026-09-20 07:56:28.040][916][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014104lb # [ 17.867310] envoy[916]: [2026-09-20 07:56:28.043][916][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014105lb # [ 17.870239] envoy[916]: [2026-09-20 07:56:28.046][916][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4106lb # [ 17.872116] envoy[916]: [2026-09-20 07:56:28.048][916][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4107lb # [ 17.873760] envoy[916]: [2026-09-20 07:56:28.048][916][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4108worker1 # [ 17.925967] systemd[1]: Starting Nix worker-protocol over gRPC...4109lb # [ 17.922118] envoy[916]: [2026-09-20 07:56:28.098][916][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4110worker2 # [ 17.926225] systemd[1]: Starting Nix worker-protocol over gRPC...4111lb # [ 17.946093] envoy[916]: [2026-09-20 07:56:28.122][916][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4112lb # [ 17.948761] envoy[916]: [2026-09-20 07:56:28.124][916][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4113lb # [ 17.952129] envoy[916]: [2026-09-20 07:56:28.124][916][info][main] [source/server/server.cc:1077] starting main dispatch loop4114worker2 # [ 18.115400] nix-grpc-daemon[850]: ts=2026-09-20T07:56:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4115worker2 # [ 18.123477] nix-grpc-daemon[850]: ts=2026-09-20T07:56:27Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14116worker1 # [ 18.144712] nix-grpc-daemon[846]: ts=2026-09-20T07:56:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4117worker1 # [ 18.156570] nix-grpc-daemon[846]: ts=2026-09-20T07:56:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14118worker2 # [ 18.154295] nix-grpc-daemon[850]: ts=2026-09-20T07:56:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4119worker2 # [ 18.158396] systemd[1]: Started Nix worker-protocol over gRPC.4120worker2 # [ 18.179774] nix-grpc-daemon[850]: ts=2026-09-20T07:56:27Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4121worker1 # [ 18.200080] nix-grpc-daemon[846]: ts=2026-09-20T07:56:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4122worker1 # [ 18.203209] systemd[1]: Started Nix worker-protocol over gRPC.4123lb # [ 18.240211] envoy[916]: [2026-09-20 07:56:28.415][916][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4124worker1 # [ 18.246519] nix-grpc-daemon[846]: ts=2026-09-20T07:56:28Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4125lb # [ 18.244828] envoy[916]: [2026-09-20 07:56:28.420][916][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4126lb # [ 18.251308] envoy[916]: [2026-09-20 07:56:28.420][916][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4127lb # [ 18.255436] envoy[916]: [2026-09-20 07:56:28.425][916][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4128worker2 # [ 18.381183] nix-grpc-daemon[850]: ts=2026-09-20T07:56:28Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4129worker1 # [ 18.447430] nix-grpc-daemon[846]: ts=2026-09-20T07:56:28Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4130worker2 # [ 18.781899] nix-grpc-daemon[850]: ts=2026-09-20T07:56:28Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4131worker1 # [ 18.847859] nix-grpc-daemon[846]: ts=2026-09-20T07:56:28Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4132worker2 # [ 19.586068] nix-grpc-daemon[850]: ts=2026-09-20T07:56:29Z level=info event=scheduler_connected addr=lb:500514133worker1 # [ 19.606543] nix-grpc-daemon[846]: ts=2026-09-20T07:56:29Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04134worker1 # [ 19.650131] nix-grpc-daemon[846]: ts=2026-09-20T07:56:29Z level=info event=scheduler_connected addr=lb:500514135worker1 # [ 19.652380] nix-grpc-daemon[846]: ts=2026-09-20T07:56:29Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04136lb # [ 30.806749] rustfs-bucket-start[1055]: mb s3://farm4137lb # [ 30.813174] systemd[1]: Finished rustfs-bucket.service.4138lb # [ 30.820620] systemd[1]: Starting niks3 server...4139lb # [ 31.032069] postgres[1071]: [1071] ERROR: relation "goose_db_version" does not exist at character 364140lb # [ 31.033274] postgres[1071]: [1071] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4141lb # [ 31.068896] niks3-server[1066]: 2026/09/20 07:56:41 OK 20241026095416_initial_model.sql (17.28ms)4142lb # [ 31.072946] niks3-server[1066]: 2026/09/20 07:56:41 OK 20251210153512_drop_unused_gin_index.sql (4.17ms)4143lb # [ 31.078032] niks3-server[1066]: 2026/09/20 07:56:41 OK 20251218171726_add_pins.sql (5.02ms)4144lb # [ 31.083587] niks3-server[1066]: 2026/09/20 07:56:41 OK 20260628120000_add_object_size_and_stats.sql (5.64ms)4145lb # [ 31.088050] niks3-server[1066]: 2026/09/20 07:56:41 OK 20260905000000_add_claims.sql (2.94ms)4146lb # [ 31.089188] niks3-server[1066]: 2026/09/20 07:56:41 goose: successfully migrated database to version: 202609050000004147lb # [ 31.095305] niks3-server[1066]: 2026/09/20 07:56:41 OK 1_commit_pending_closure.sql (7.24ms)4148lb # [ 31.097831] niks3-server[1066]: 2026/09/20 07:56:41 OK 2_object_stats_trigger.sql (2.53ms)4149lb # [ 31.098890] niks3-server[1066]: 2026/09/20 07:56:41 goose: up to current file version: 24150lb # [ 31.105484] niks3-server[1066]: 2026/09/20 07:56:41 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4151lb # [ 31.177668] niks3-server[1066]: 2026/09/20 07:56:41 INFO Read proxy enabled — serving cache objects from S34152lb # [ 31.179703] niks3-server[1066]: 2026/09/20 07:56:41 INFO Using socket-activated listener address=0.0.0.0:57514153lb # [ 31.188512] niks3-server[1066]: 2026/09/20 07:56:41 INFO systemd watchdog enabled interval=15s4154lb # [ 31.190219] systemd[1]: Started niks3 server.4155lb # [ 31.192593] systemd[1]: Reached target Multi-User System.4156lb # [ 31.195332] niks3-server[1066]: 2026/09/20 07:56:41 INFO Starting HTTP server address=0.0.0.0:57514157lb # [ 31.196534] systemd[1]: Startup finished in 883ms (kernel) + 3.974s (initrd) + 26.337s (userspace) = 31.195s.4158lb: (finished: waiting for unit niks3.service, in 19.49 seconds)4159lb: waiting for TCP port 5751 on localhost4160lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4161lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds)4162lb: waiting for unit envoy.service4163lb: (finished: waiting for unit envoy.service, in 0.05 seconds)4164lb: waiting for TCP port 50051 on localhost4165lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4166lb # [ 31.402662] envoy[916]: conn peer=[::1]:42006 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=34167lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)4168lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4169??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4170 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284171lb: must succeed: curl -sf localhost:9901/clusters4172lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4173lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.06 seconds)4174lb: waiting until exactly no endpoints of sched are unhealthy4175lb: must succeed: curl -sf localhost:9901/clusters4176lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4177lb: (finished: waiting until exactly no endpoints of sched are unhealthy, in 0.04 seconds)4178subtest: both builders hold a WorkerSession on the scheduler4179worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4180worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)4181(finished: subtest: both builders hold a WorkerSession on the scheduler, in 0.07 seconds)4182subtest: balancer auth: client cert, bearer token, nothing, unknown CN4183worker2 # [ 32.061574] nix-grpc-daemon[850]: ts=2026-09-20T07:56:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:482284184worker2 # [ 32.070738] systemd[1]: Started Nix Daemon.4185worker2 # [ 32.299027] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4186worker2 # [ 32.359728] nix-grpc-daemon[850]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 1/5)4187worker2 # [ 32.415539] nix-grpc-daemon[850]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 171 ms (attempt 2/5)4188worker2 # [ 32.589618] nix-grpc-daemon[850]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 352 ms (attempt 3/5)4189worker2 # [ 32.947488] nix-grpc-daemon[850]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 766 ms (attempt 4/5)4190worker2 # [ 33.717738] nix-grpc-daemon[850]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4191worker2 # [ 33.744260] nix-grpc-daemon[850]: ts=2026-09-20T07:56:43Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:482284192worker2 # [ 33.757535] nix-grpc-daemon[850]: ts=2026-09-20T07:56:43Z level=debug event=path_info_miss path=zhxi75b5nsabxqch8h65z6an848g1y3d-nixos-system-client-test error="error: path '/nix/store/zhxi75b5nsabxqch8h65z6an848g1y3d-nixos-system-client-test' is required, but there is no substituter that can build it"4193worker1 # [ 33.777478] nix-grpc-daemon[846]: ts=2026-09-20T07:56:43Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:581844194worker1 # [ 33.785627] systemd[1]: Started Nix Daemon.4195worker1 # [ 33.984326] nix-daemon[907]: accepted connection from pid 846, user nix-grpc-daemon (trusted)4196worker1 # [ 34.014612] nix-grpc-daemon[846]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 4 ms (attempt 1/5)4197worker1 # [ 34.021172] nix-grpc-daemon[846]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 2/5)4198worker1 # [ 34.065338] nix-grpc-daemon[846]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 300 ms (attempt 3/5)4199worker1 # [ 34.365581] nix-grpc-daemon[846]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 221 ms (attempt 4/5)4200worker1 # [ 34.592036] nix-grpc-daemon[846]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4201worker1 # [ 34.606099] nix-grpc-daemon[846]: ts=2026-09-20T07:56:44Z level=debug event=path_info_miss path=zhxi75b5nsabxqch8h65z6an848g1y3d-nixos-system-client-test error="error: path '/nix/store/zhxi75b5nsabxqch8h65z6an848g1y3d-nixos-system-client-test' is required, but there is no substituter that can build it"4202client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4203client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.08 seconds)4204client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4205client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4206worker1 # [ 34.953594] nix-grpc-daemon[846]: ts=2026-09-20T07:56:44Z level=info event=oidc_jwks provider=mock keys=14207worker1 # [ 34.957608] nix-grpc-daemon[846]: ts=2026-09-20T07:56:44Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:581844208worker1 # [ 34.977339] nix-grpc-daemon[846]: ts=2026-09-20T07:56:44Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:581844209worker1 # [ 34.986343] nix-grpc-daemon[846]: ts=2026-09-20T07:56:44Z level=debug event=path_info_miss path=zhxi75b5nsabxqch8h65z6an848g1y3d-nixos-system-client-test error="error: path '/nix/store/zhxi75b5nsabxqch8h65z6an848g1y3d-nixos-system-client-test' is required, but there is no substituter that can build it"4210worker2 # [ 34.993694] nix-grpc-daemon[850]: ts=2026-09-20T07:56:44Z level=info event=oidc_jwks provider=mock keys=14211worker2 # [ 34.995312] nix-grpc-daemon[850]: ts=2026-09-20T07:56:44Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:482284212worker2 # [ 35.000796] nix-grpc-daemon[850]: ts=2026-09-20T07:56:44Z level=debug event=path_info_miss path=zhxi75b5nsabxqch8h65z6an848g1y3d-nixos-system-client-test error="error: path '/nix/store/zhxi75b5nsabxqch8h65z6an848g1y3d-nixos-system-client-test' is required, but there is no substituter that can build it"4213client: must succeed: rm -r /var/lib/nix-grpc-store4214client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4215worker2 # [ 35.247574] nix-grpc-daemon[850]: ts=2026-09-20T07:56:45Z level=info event=denied method=QueryMissing cn=- role=none4216worker2 # [ 35.475562] nix-grpc-daemon[850]: ts=2026-09-20T07:56:45Z level=info event=denied method=QueryMissing cn=stranger role=none4217(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.83 seconds)4218subtest: DAG build is scheduled across workers and lands in the cache4219client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24220worker2 # [ 35.677131] nix-grpc-daemon[850]: ts=2026-09-20T07:56:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:482284221client # don't know how to build these paths:4222client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4223worker1 # [ 35.717095] nix-grpc-daemon[846]: ts=2026-09-20T07:56:45Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04224worker1 # [ 35.719096] nix-grpc-daemon[846]: ts=2026-09-20T07:56:45Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=14225worker2 # [ 35.762122] nix-grpc-daemon[850]: ts=2026-09-20T07:56:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482284226worker2 # [ 35.779948] nix-grpc-daemon[850]: ts=2026-09-20T07:56:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482284227client # copying 1 paths to 'lb:50051'...4228worker2 # [ 35.788145] nix-grpc-daemon[850]: ts=2026-09-20T07:56:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:482284229client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4230worker2 # [ 35.804431] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4231worker2 # [ 35.823314] nix-grpc-daemon[850]: ts=2026-09-20T07:56:45Z level=info event=niks3_push_started pid=8834232worker2 # [ 36.243794] nix-daemon[873]: accepted connection from pid 895, user nix-grpc-daemon (trusted)4233worker2 # [ 36.261509] nix-daemon[873]: reaped child process 898, status = succeeded4234worker2 # [ 36.417156] nix-daemon[873]: accepted connection from pid 900, user nix-grpc-daemon (trusted)4235worker2 # [ 36.433379] nix-daemon[873]: reaped child process 903, status = succeeded4236lb # [ 36.444898] niks3-server[1066]: 2026/09/20 07:56:46 INFO Received uploads request method=POST path=/api/pending_closures4237worker2 # [ 36.464174] nix-grpc-daemon[883]: time=2026-09-20T07:56:46.250Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4238worker2 # [ 36.466347] nix-grpc-daemon[883]: time=2026-09-20T07:56:46.252Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4239lb # [ 36.504358] niks3-server[1066]: 2026/09/20 07:56:46 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4240lb # [ 36.506792] niks3-server[1066]: 2026/09/20 07:56:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4241lb # [ 36.518179] niks3-server[1066]: 2026/09/20 07:56:46 INFO Signed narinfos id=1 count=14242worker2 # [ 36.519336] nix-grpc-daemon[883]: time=2026-09-20T07:56:46.307Z level=INFO msg="Uploading 1 narinfos"4243lb # [ 36.543198] niks3-server[1066]: 2026/09/20 07:56:46 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4244lb # [ 36.570083] niks3-server[1066]: 2026/09/20 07:56:46 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4245lb # [ 36.602184] niks3-server[1066]: 2026/09/20 07:56:46 INFO Completed upload id=14246worker2 # [ 36.601473] nix-grpc-daemon[883]: time=2026-09-20T07:56:46.389Z level=INFO msg="Upload complete. (522ms)"4247lb # [ 36.610648] niks3-server[1066]: 2026/09/20 07:56:46 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4248worker2 # [ 36.607777] nix-grpc-daemon[850]: ts=2026-09-20T07:56:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=0 paths=1 nar_bytes_in=5044249worker2 # [ 36.616424] nix-grpc-daemon[850]: ts=2026-09-20T07:56:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482284250worker2 # [ 36.627406] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4251worker2 # [ 36.644118] nix-daemon[873]: reaped child process 881, status = succeeded4252client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4253client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4254worker2 # [ 36.654212] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4255client # farm-a> LOG-farm-a-t14256worker2 # [ 37.676187] nix-daemon[873]: reaped child process 907, status = succeeded4257worker2 # [ 37.822987] nix-daemon[873]: accepted connection from pid 923, user nix-grpc-daemon (trusted)4258worker2 # [ 37.838412] nix-daemon[873]: reaped child process 926, status = succeeded4259lb # [ 37.849081] niks3-server[1066]: 2026/09/20 07:56:48 INFO Received uploads request method=POST path=/api/pending_closures4260worker2 # [ 37.855120] nix-grpc-daemon[883]: time=2026-09-20T07:56:47.643Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4261worker2 # [ 37.856894] nix-grpc-daemon[883]: time=2026-09-20T07:56:47.645Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4262lb # [ 37.881451] niks3-server[1066]: 2026/09/20 07:56:48 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4263lb # [ 37.884771] niks3-server[1066]: 2026/09/20 07:56:48 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4264lb # [ 37.889190] niks3-server[1066]: 2026/09/20 07:56:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4265lb # [ 37.890965] niks3-server[1066]: 2026/09/20 07:56:48 INFO Signed narinfos id=2 count=14266worker2 # [ 37.891882] nix-grpc-daemon[883]: time=2026-09-20T07:56:47.679Z level=INFO msg="Uploading 1 narinfos"4267lb # [ 37.896339] niks3-server[1066]: 2026/09/20 07:56:48 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4268lb # [ 37.904183] niks3-server[1066]: 2026/09/20 07:56:48 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4269lb # [ 37.908133] niks3-server[1066]: 2026/09/20 07:56:48 INFO Completed upload id=24270worker2 # [ 37.908483] nix-grpc-daemon[883]: time=2026-09-20T07:56:47.696Z level=INFO msg="Upload complete. (239ms)"4271lb # [ 37.910392] niks3-server[1066]: 2026/09/20 07:56:48 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4272worker2 # [ 37.912975] nix-grpc-daemon[850]: ts=2026-09-20T07:56:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14273worker2 # [ 37.923050] nix-daemon[873]: reaped child process 905, status = succeeded4274worker1 # [ 37.930529] nix-grpc-daemon[846]: ts=2026-09-20T07:56:47Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04275worker1 # [ 37.932704] nix-grpc-daemon[846]: ts=2026-09-20T07:56:47Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=14276lb # [ 37.930970] envoy[916]: conn peer=[2001:db8:1::1]:59038 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=26004277lb # [ 37.932608] envoy[916]: conn peer=[2001:db8:1::1]:35688 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=854278lb # [ 37.934073] envoy[916]: conn peer=[2001:db8:1::1]:35698 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=124279lb # [ 37.935508] envoy[916]: conn peer=[2001:db8:1::1]:35712 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=74280worker2 # [ 37.969641] nix-grpc-daemon[850]: ts=2026-09-20T07:56:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482284281worker2 # [ 37.979061] nix-grpc-daemon[850]: ts=2026-09-20T07:56:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482284282worker2 # [ 37.989200] nix-grpc-daemon[883]: time=2026-09-20T07:56:47.777Z level=INFO msg="All 1 paths already cached"4283client # copying 1 paths to 'lb:50051'...4284worker2 # [ 37.995101] nix-grpc-daemon[850]: ts=2026-09-20T07:56:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:482284285client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4286worker2 # [ 38.007124] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4287worker2 # [ 38.188445] nix-daemon[873]: accepted connection from pid 930, user nix-grpc-daemon (trusted)4288worker2 # [ 38.206376] nix-daemon[873]: reaped child process 933, status = succeeded4289worker2 # [ 38.365805] nix-daemon[873]: accepted connection from pid 936, user nix-grpc-daemon (trusted)4290worker2 # [ 38.384277] nix-daemon[873]: reaped child process 939, status = succeeded4291lb # [ 38.396303] niks3-server[1066]: 2026/09/20 07:56:48 INFO Received uploads request method=POST path=/api/pending_closures4292worker2 # [ 38.404727] nix-grpc-daemon[883]: time=2026-09-20T07:56:48.193Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4293worker2 # [ 38.406376] nix-grpc-daemon[883]: time=2026-09-20T07:56:48.194Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4294lb # [ 38.431719] niks3-server[1066]: 2026/09/20 07:56:48 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4295lb # [ 38.444759] niks3-server[1066]: 2026/09/20 07:56:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4296lb # [ 38.447385] niks3-server[1066]: 2026/09/20 07:56:48 INFO Signed narinfos id=3 count=14297worker2 # [ 38.446782] nix-grpc-daemon[883]: time=2026-09-20T07:56:48.234Z level=INFO msg="Uploading 1 narinfos"4298lb # [ 38.453706] niks3-server[1066]: 2026/09/20 07:56:48 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4299lb # [ 38.458810] niks3-server[1066]: 2026/09/20 07:56:48 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4300lb # [ 38.463605] niks3-server[1066]: 2026/09/20 07:56:48 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4301lb # [ 38.466906] niks3-server[1066]: 2026/09/20 07:56:48 INFO Completed upload id=34302worker2 # [ 38.465721] nix-grpc-daemon[883]: time=2026-09-20T07:56:48.254Z level=INFO msg="Upload complete. (449ms)"4303worker2 # [ 38.469101] nix-grpc-daemon[850]: ts=2026-09-20T07:56:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=0 paths=1 nar_bytes_in=6244304worker2 # [ 38.471760] nix-grpc-daemon[850]: ts=2026-09-20T07:56:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482284305worker2 # [ 38.477359] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4306worker2 # [ 38.485302] nix-daemon[873]: reaped child process 928, status = succeeded4307client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4308client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4309worker2 # [ 38.489086] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4310client # farm-b> LOG-farm-b-t14311worker2 # [ 39.517720] nix-daemon[873]: reaped child process 943, status = succeeded4312worker2 # [ 39.682186] nix-daemon[873]: accepted connection from pid 958, user nix-grpc-daemon (trusted)4313worker2 # [ 39.698729] nix-daemon[873]: reaped child process 961, status = succeeded4314lb # [ 39.709255] niks3-server[1066]: 2026/09/20 07:56:49 INFO Received uploads request method=POST path=/api/pending_closures4315worker2 # [ 39.715663] nix-grpc-daemon[883]: time=2026-09-20T07:56:49.503Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4316worker2 # [ 39.718107] nix-grpc-daemon[883]: time=2026-09-20T07:56:49.505Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4317lb # [ 39.742386] niks3-server[1066]: 2026/09/20 07:56:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4318lb # [ 39.745696] niks3-server[1066]: 2026/09/20 07:56:49 INFO Signed narinfos id=4 count=14319worker2 # [ 39.744364] nix-grpc-daemon[883]: time=2026-09-20T07:56:49.532Z level=INFO msg="Uploading 1 narinfos"4320lb # [ 39.747760] niks3-server[1066]: 2026/09/20 07:56:49 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4321lb # [ 39.753062] niks3-server[1066]: 2026/09/20 07:56:49 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4322lb # [ 39.758696] niks3-server[1066]: 2026/09/20 07:56:49 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4323lb # [ 39.770935] niks3-server[1066]: 2026/09/20 07:56:49 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4324lb # [ 39.781175] niks3-server[1066]: 2026/09/20 07:56:49 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4325lb # [ 39.790707] niks3-server[1066]: 2026/09/20 07:56:49 INFO Completed upload id=44326worker2 # [ 39.789721] nix-grpc-daemon[883]: time=2026-09-20T07:56:49.578Z level=INFO msg="Upload complete. (289ms)"4327worker2 # [ 39.793451] nix-grpc-daemon[850]: ts=2026-09-20T07:56:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14328worker1 # [ 39.803925] nix-grpc-daemon[846]: ts=2026-09-20T07:56:49Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04329worker1 # [ 39.806556] nix-grpc-daemon[846]: ts=2026-09-20T07:56:49Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=14330worker2 # [ 39.803306] nix-daemon[873]: reaped child process 941, status = succeeded4331worker2 # [ 39.842177] nix-grpc-daemon[850]: ts=2026-09-20T07:56:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482284332worker2 # [ 39.850980] nix-grpc-daemon[850]: ts=2026-09-20T07:56:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482284333client # copying 1 paths to 'lb:50051'...4334worker2 # [ 39.858782] nix-grpc-daemon[883]: time=2026-09-20T07:56:49.646Z level=INFO msg="All 2 paths already cached"4335client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4336worker2 # [ 39.861464] nix-grpc-daemon[850]: ts=2026-09-20T07:56:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:482284337worker2 # [ 39.871117] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4338worker2 # [ 40.034048] nix-daemon[873]: accepted connection from pid 965, user nix-grpc-daemon (trusted)4339worker2 # [ 40.050611] nix-daemon[873]: reaped child process 969, status = succeeded4340worker2 # [ 40.202412] nix-daemon[873]: accepted connection from pid 971, user nix-grpc-daemon (trusted)4341worker2 # [ 40.216867] nix-daemon[873]: reaped child process 974, status = succeeded4342lb # [ 40.227610] niks3-server[1066]: 2026/09/20 07:56:50 INFO Received uploads request method=POST path=/api/pending_closures4343worker2 # [ 40.231363] nix-grpc-daemon[883]: time=2026-09-20T07:56:50.019Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4344worker2 # [ 40.232930] nix-grpc-daemon[883]: time=2026-09-20T07:56:50.021Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4345lb # [ 40.256123] niks3-server[1066]: 2026/09/20 07:56:50 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4346lb # [ 40.264603] niks3-server[1066]: 2026/09/20 07:56:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4347lb # [ 40.270885] niks3-server[1066]: 2026/09/20 07:56:50 INFO Signed narinfos id=5 count=14348worker2 # [ 40.272546] nix-grpc-daemon[883]: time=2026-09-20T07:56:50.060Z level=INFO msg="Uploading 1 narinfos"4349lb # [ 40.279903] niks3-server[1066]: 2026/09/20 07:56:50 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4350lb # [ 40.290326] niks3-server[1066]: 2026/09/20 07:56:50 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4351lb # [ 40.295450] niks3-server[1066]: 2026/09/20 07:56:50 INFO Completed upload id=54352worker2 # [ 40.296371] nix-grpc-daemon[883]: time=2026-09-20T07:56:50.084Z level=INFO msg="Upload complete. (414ms)"4353lb # [ 40.299955] niks3-server[1066]: 2026/09/20 07:56:50 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4354worker2 # [ 40.299629] nix-grpc-daemon[850]: ts=2026-09-20T07:56:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=0 paths=1 nar_bytes_in=7524355worker2 # [ 40.303913] nix-grpc-daemon[850]: ts=2026-09-20T07:56:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482284356worker2 # [ 40.310799] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4357worker2 # [ 40.318875] nix-daemon[873]: reaped child process 963, status = succeeded4358client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4359client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4360worker2 # [ 40.327144] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4361client # farm-top> LOG-farm-top-t14362worker2 # [ 41.546107] nix-daemon[873]: reaped child process 978, status = succeeded4363worker2 # [ 41.703098] nix-daemon[873]: accepted connection from pid 993, user nix-grpc-daemon (trusted)4364worker2 # [ 41.717587] nix-daemon[873]: reaped child process 996, status = succeeded4365lb # [ 41.730446] niks3-server[1066]: 2026/09/20 07:56:51 INFO Received uploads request method=POST path=/api/pending_closures4366worker2 # [ 41.739639] nix-grpc-daemon[883]: time=2026-09-20T07:56:51.527Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4367worker2 # [ 41.742355] nix-grpc-daemon[883]: time=2026-09-20T07:56:51.529Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4368lb # [ 41.771125] niks3-server[1066]: 2026/09/20 07:56:51 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4369lb # [ 41.773551] niks3-server[1066]: 2026/09/20 07:56:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4370lb # [ 41.777299] niks3-server[1066]: 2026/09/20 07:56:51 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4371lb # [ 41.779205] niks3-server[1066]: 2026/09/20 07:56:51 INFO Signed narinfos id=6 count=14372worker2 # [ 41.780034] nix-grpc-daemon[883]: time=2026-09-20T07:56:51.568Z level=INFO msg="Uploading 1 narinfos"4373lb # [ 41.782350] niks3-server[1066]: 2026/09/20 07:56:51 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4374lb # [ 41.788858] niks3-server[1066]: 2026/09/20 07:56:51 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4375lb # [ 41.791946] niks3-server[1066]: 2026/09/20 07:56:51 INFO Completed upload id=64376worker2 # [ 41.790592] nix-grpc-daemon[883]: time=2026-09-20T07:56:51.579Z level=INFO msg="Upload complete. (254ms)"4377lb # [ 41.794241] niks3-server[1066]: 2026/09/20 07:56:51 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4378worker2 # [ 41.793598] nix-grpc-daemon[850]: ts=2026-09-20T07:56:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14379worker2 # [ 41.801186] nix-daemon[873]: reaped child process 976, status = succeeded4380client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 6.33 seconds)4381client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4382client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.20 seconds)4383client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4384client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4385client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4386client # copying 3 paths...4387client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4388client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4389client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4390client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.24 seconds)4391(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.86 seconds)4392subtest: repeat is answered Cached by the scheduler without building4393worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4394worker1 # finding garbage collector roots...4395worker1 # deleting specified paths...4396worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4397worker1 # deleting unused links...4398worker1 # note: hard linking is currently saving 0.0 KiB4399worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.31 seconds)4400worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4401worker2 # finding garbage collector roots...4402worker2 # deleting specified paths...4403worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4404worker2 # deleting unused links...4405worker2 # note: hard linking is currently saving 0.0 KiB4406worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.22 seconds)4407client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24408worker2 # [ 43.085269] nix-grpc-daemon[850]: ts=2026-09-20T07:56:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:482284409client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4410client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4411worker1 # [ 43.119715] nix-grpc-daemon[846]: ts=2026-09-20T07:56:53Z level=debug event=want client=2 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=14412worker1 # [ 43.131866] nix-grpc-daemon[846]: ts=2026-09-20T07:56:53Z level=debug event=want client=2 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=14413worker1 # [ 43.144826] nix-grpc-daemon[846]: ts=2026-09-20T07:56:53Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14414client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 0.28 seconds)4415client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4416client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.18 seconds)4417worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -q 'nix_grpc_events_total{kind="cached"}'4418worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -q 'nix_grpc_events_total{kind="cached"}', in 0.05 seconds)4419(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.10 seconds)4420subtest: two clients wanting the same drv build it once4421client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4422client # [ 43.504628] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4423client # Running as unit: dedup1.service; invocation ID: 13aa15b4be7f4c259fd839a4aadb9f264424client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.05 seconds)4425client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4426worker2 # [ 43.712151] nix-grpc-daemon[850]: ts=2026-09-20T07:56:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:482284427client # [ 43.726189] nix[864]: don't know how to build these paths:4428client # [ 43.727536] nix[864]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4429worker1 # [ 43.731851] nix-grpc-daemon[846]: ts=2026-09-20T07:56:53Z level=debug event=want client=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04430worker1 # [ 43.740278] nix-grpc-daemon[846]: ts=2026-09-20T07:56:53Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=14431worker1 # [ 43.745508] nix-grpc-daemon[846]: ts=2026-09-20T07:56:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581844432worker1 # [ 43.765265] nix-grpc-daemon[846]: ts=2026-09-20T07:56:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:581844433client # [ 43.782153] nix[864]: copying 1 paths to 'lb:50051'...4434client # [ 43.783261] nix[864]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4435worker1 # [ 43.779849] nix-grpc-daemon[846]: ts=2026-09-20T07:56:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:581844436worker1 # [ 43.793585] nix-daemon[907]: accepted connection from pid 846, user nix-grpc-daemon (trusted)4437worker1 # [ 43.823311] nix-grpc-daemon[846]: ts=2026-09-20T07:56:53Z level=info event=niks3_push_started pid=9514438worker1 # [ 44.356156] nix-daemon[907]: accepted connection from pid 963, user nix-grpc-daemon (trusted)4439worker1 # [ 44.374766] nix-daemon[907]: reaped child process 966, status = succeeded4440worker1 # [ 44.522516] nix-daemon[907]: accepted connection from pid 968, user nix-grpc-daemon (trusted)4441worker1 # [ 44.539075] nix-daemon[907]: reaped child process 971, status = succeeded4442lb # [ 44.545589] niks3-server[1066]: 2026/09/20 07:56:54 INFO Received uploads request method=POST path=/api/pending_closures4443worker1 # [ 44.559157] nix-grpc-daemon[951]: time=2026-09-20T07:56:54.495Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4444worker1 # [ 44.563572] nix-grpc-daemon[951]: time=2026-09-20T07:56:54.500Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4445client # [ 44.576653] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4446client # Running as unit: dedup2.service; invocation ID: 88f387d0442644debb2ac49ddac305884447client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds)4448lb # [ 44.583567] niks3-server[1066]: 2026/09/20 07:56:54 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4449lb # [ 44.590690] niks3-server[1066]: 2026/09/20 07:56:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4450lb # [ 44.593226] niks3-server[1066]: 2026/09/20 07:56:54 INFO Signed narinfos id=7 count=14451worker1 # [ 44.599799] nix-grpc-daemon[951]: time=2026-09-20T07:56:54.538Z level=INFO msg="Uploading 1 narinfos"4452lb # [ 44.606154] niks3-server[1066]: 2026/09/20 07:56:54 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4453lb # [ 44.614403] niks3-server[1066]: 2026/09/20 07:56:54 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4454lb # [ 44.622654] niks3-server[1066]: 2026/09/20 07:56:54 INFO Completed upload id=74455worker1 # [ 44.627556] nix-grpc-daemon[951]: time=2026-09-20T07:56:54.565Z level=INFO msg="Upload complete. (452ms)"4456lb # [ 44.628160] niks3-server[1066]: 2026/09/20 07:56:54 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4457worker1 # [ 44.633089] nix-grpc-daemon[846]: ts=2026-09-20T07:56:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58184 duration_s=0 paths=1 nar_bytes_in=4324458worker1 # [ 44.638836] nix-grpc-daemon[846]: ts=2026-09-20T07:56:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581844459worker1 # [ 44.651087] nix-daemon[907]: accepted connection from pid 846, user nix-grpc-daemon (trusted)4460worker1 # [ 44.657887] nix-daemon[907]: reaped child process 949, status = succeeded4461client # [ 44.671820] nix[864]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4462worker1 # [ 44.667897] nix-daemon[907]: accepted connection from pid 846, user nix-grpc-daemon (trusted)4463worker2 # [ 44.816629] nix-grpc-daemon[850]: ts=2026-09-20T07:56:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:482284464client # [ 44.827283] nix[879]: don't know how to build these paths:4465client # [ 44.828776] nix[879]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4466worker1 # [ 44.832815] nix-grpc-daemon[846]: ts=2026-09-20T07:56:54Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04467worker1 # [ 44.842415] nix-grpc-daemon[846]: ts=2026-09-20T07:56:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581844468client # [ 44.850436] nix[879]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4469client: must succeed: sleep 24470lb # [ 47.932288] envoy[916]: conn peer=[2001:db8:1::1]:35714 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9355 tx=3781 ms=61554471lb # [ 47.934865] envoy[916]: conn peer=[2001:db8:1::1]:56862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1158 tx=481 ms=734472client: (finished: must succeed: sleep 2, in 2.04 seconds)4473??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4474 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394475client: waiting for success: ! systemctl is-active dedup1 dedup24476??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4477 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394478worker1 # [ 48.100537] nix-daemon[907]: reaped child process 979, status = succeeded4479worker1 # [ 48.298146] nix-daemon[907]: accepted connection from pid 1007, user nix-grpc-daemon (trusted)4480worker1 # [ 48.318729] nix-daemon[907]: reaped child process 1010, status = succeeded4481lb # [ 48.327679] niks3-server[1066]: 2026/09/20 07:56:58 INFO Received uploads request method=POST path=/api/pending_closures4482worker1 # [ 48.340226] nix-grpc-daemon[951]: time=2026-09-20T07:56:58.278Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4483worker1 # [ 48.342819] nix-grpc-daemon[951]: time=2026-09-20T07:56:58.280Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4484lb # [ 48.381685] niks3-server[1066]: 2026/09/20 07:56:58 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4485lb # [ 48.386486] niks3-server[1066]: 2026/09/20 07:56:58 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4486lb # [ 48.396290] niks3-server[1066]: 2026/09/20 07:56:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4487lb # [ 48.401906] niks3-server[1066]: 2026/09/20 07:56:58 INFO Signed narinfos id=8 count=14488worker1 # [ 48.407187] nix-grpc-daemon[951]: time=2026-09-20T07:56:58.344Z level=INFO msg="Uploading 1 narinfos"4489lb # [ 48.408667] niks3-server[1066]: 2026/09/20 07:56:58 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4490lb # [ 48.423161] niks3-server[1066]: 2026/09/20 07:56:58 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4491worker1 # [ 48.433906] nix-grpc-daemon[951]: time=2026-09-20T07:56:58.372Z level=INFO msg="Upload complete. (343ms)"4492lb # [ 48.430073] niks3-server[1066]: 2026/09/20 07:56:58 INFO Completed upload id=84493lb # [ 48.433790] niks3-server[1066]: 2026/09/20 07:56:58 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4494worker1 # [ 48.439233] nix-grpc-daemon[846]: ts=2026-09-20T07:56:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58184 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14495worker1 # [ 48.444273] nix-grpc-daemon[846]: ts=2026-09-20T07:56:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58184 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14496worker1 # [ 48.453212] nix-daemon[907]: reaped child process 977, status = succeeded4497client # [ 48.481493] systemd[1]: dedup1.service: Deactivated successfully.4498client # [ 48.484603] systemd[1]: dedup1.service: Consumed 123ms CPU time over 4.979s wall clock time, 39.3M memory peak, 8.6K incoming IP traffic, 9.1K outgoing IP traffic.4499client # [ 48.526383] systemd[1]: dedup2.service: Deactivated successfully.4500client # [ 48.529074] systemd[1]: dedup2.service: Consumed 149ms CPU time over 3.951s wall clock time, 33.2M memory peak, 7.4K incoming IP traffic, 6.3K outgoing IP traffic.4501client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.09 seconds)4502client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4503client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4504worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4505worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.04 seconds)4506worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4507worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4508worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4509worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.06 seconds)4510worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4511worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.08 seconds)4512(finished: subtest: two clients wanting the same drv build it once, in 5.96 seconds)4513subtest: build hook: nix-daemon with builders = grpc://lb4514client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log4515client # [ 49.616766] systemd[1]: Started Nix Daemon.4516client # [ 49.815935] nix-daemon[920]: accepted connection from pid 917, user root (trusted)4517worker1 # [ 50.021563] nix-grpc-daemon[846]: ts=2026-09-20T07:56:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:581844518worker1 # [ 50.029700] nix-grpc-daemon[846]: ts=2026-09-20T07:56:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:581844519worker1 # [ 50.047135] nix-grpc-daemon[846]: ts=2026-09-20T07:56:59Z level=debug event=want client=5 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04520worker1 # [ 50.049713] nix-grpc-daemon[846]: ts=2026-09-20T07:56:59Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=14521worker2 # [ 50.089336] nix-grpc-daemon[850]: ts=2026-09-20T07:56:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482284522worker2 # [ 50.103860] nix-grpc-daemon[850]: ts=2026-09-20T07:56:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482284523worker2 # [ 50.117126] nix-grpc-daemon[850]: ts=2026-09-20T07:56:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:482284524worker2 # [ 50.126223] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4525worker2 # [ 50.335627] nix-daemon[873]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)4526worker2 # [ 50.355708] nix-daemon[873]: reaped child process 1040, status = succeeded4527worker2 # [ 50.557131] nix-daemon[873]: accepted connection from pid 1042, user nix-grpc-daemon (trusted)4528worker2 # [ 50.574358] nix-daemon[873]: reaped child process 1045, status = succeeded4529lb # [ 50.589741] niks3-server[1066]: 2026/09/20 07:57:00 INFO Received uploads request method=POST path=/api/pending_closures4530worker2 # [ 50.597874] nix-grpc-daemon[883]: time=2026-09-20T07:57:00.385Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4531worker2 # [ 50.600428] nix-grpc-daemon[883]: time=2026-09-20T07:57:00.388Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4532lb # [ 50.619064] niks3-server[1066]: 2026/09/20 07:57:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4533lb # [ 50.623634] niks3-server[1066]: 2026/09/20 07:57:00 INFO Signed narinfos id=9 count=14534worker2 # [ 50.626045] nix-grpc-daemon[883]: time=2026-09-20T07:57:00.414Z level=INFO msg="Uploading 1 narinfos"4535lb # [ 50.632248] niks3-server[1066]: 2026/09/20 07:57:00 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4536lb # [ 50.641630] niks3-server[1066]: 2026/09/20 07:57:00 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4537lb # [ 50.643768] niks3-server[1066]: 2026/09/20 07:57:00 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4538lb # [ 50.649866] niks3-server[1066]: 2026/09/20 07:57:00 INFO Completed upload id=94539worker2 # [ 50.648917] nix-grpc-daemon[883]: time=2026-09-20T07:57:00.437Z level=INFO msg="Upload complete. (513ms)"4540lb # [ 50.655282] niks3-server[1066]: 2026/09/20 07:57:00 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4541worker2 # [ 50.653161] nix-grpc-daemon[850]: ts=2026-09-20T07:57:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=0 paths=1 nar_bytes_in=5124542worker2 # [ 50.658238] nix-grpc-daemon[850]: ts=2026-09-20T07:57:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482284543worker2 # [ 50.670283] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4544worker2 # [ 50.676346] nix-daemon[873]: reaped child process 1035, status = succeeded4545worker2 # [ 50.687352] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4546worker2 # [ 52.321980] nix-daemon[873]: reaped child process 1049, status = succeeded4547worker2 # [ 52.521344] nix-daemon[873]: accepted connection from pid 1064, user nix-grpc-daemon (trusted)4548worker2 # [ 52.545594] nix-daemon[873]: reaped child process 1067, status = succeeded4549lb # [ 52.557269] niks3-server[1066]: 2026/09/20 07:57:02 INFO Received uploads request method=POST path=/api/pending_closures4550worker2 # [ 52.562731] nix-grpc-daemon[883]: time=2026-09-20T07:57:02.350Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4551worker2 # [ 52.570724] nix-grpc-daemon[883]: time=2026-09-20T07:57:02.353Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4552lb # [ 52.584878] niks3-server[1066]: 2026/09/20 07:57:02 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4553lb # [ 52.591031] niks3-server[1066]: 2026/09/20 07:57:02 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4554lb # [ 52.596078] niks3-server[1066]: 2026/09/20 07:57:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4555lb # [ 52.600245] niks3-server[1066]: 2026/09/20 07:57:02 INFO Signed narinfos id=10 count=14556worker2 # [ 52.598993] nix-grpc-daemon[883]: time=2026-09-20T07:57:02.387Z level=INFO msg="Uploading 1 narinfos"4557lb # [ 52.605472] niks3-server[1066]: 2026/09/20 07:57:02 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4558lb # [ 52.610070] niks3-server[1066]: 2026/09/20 07:57:02 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4559lb # [ 52.615783] niks3-server[1066]: 2026/09/20 07:57:02 INFO Completed upload id=104560worker2 # [ 52.616060] nix-grpc-daemon[883]: time=2026-09-20T07:57:02.404Z level=INFO msg="Upload complete. (314ms)"4561lb # [ 52.617678] niks3-server[1066]: 2026/09/20 07:57:02 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4562worker2 # [ 52.620553] nix-grpc-daemon[850]: ts=2026-09-20T07:57:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=5 outputs=14563worker2 # [ 52.625291] nix-grpc-daemon[850]: ts=2026-09-20T07:57:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:482284564worker2 # [ 52.633401] nix-daemon[873]: reaped child process 1047, status = succeeded4565worker1 # [ 52.641578] nix-grpc-daemon[846]: ts=2026-09-20T07:57:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:581844566worker1 # [ 52.655291] nix-grpc-daemon[846]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4567worker1 # [ 52.669808] nix-grpc-daemon[846]: ts=2026-09-20T07:57:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58184 duration_s=0 paths=1 nar_bytes_out=1284568worker1 # [ 52.923637] nix-grpc-daemon[846]: ts=2026-09-20T07:57:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:581844569worker2 # [ 52.921780] nix-grpc-daemon[850]: ts=2026-09-20T07:57:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482284570worker2 # [ 52.927740] nix-grpc-daemon[883]: time=2026-09-20T07:57:02.716Z level=INFO msg="All 1 paths already cached"4571worker1 # [ 52.945520] nix-grpc-daemon[846]: ts=2026-09-20T07:57:02Z level=debug event=want client=6 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04572worker1 # [ 52.948552] nix-grpc-daemon[846]: ts=2026-09-20T07:57:02Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=14573worker2 # [ 52.943183] nix-grpc-daemon[850]: ts=2026-09-20T07:57:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482284574worker2 # [ 52.955341] nix-grpc-daemon[850]: ts=2026-09-20T07:57:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482284575worker2 # [ 52.968442] nix-grpc-daemon[883]: time=2026-09-20T07:57:02.756Z level=INFO msg="All 1 paths already cached"4576worker2 # [ 52.974670] nix-grpc-daemon[850]: ts=2026-09-20T07:57:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:482284577worker2 # [ 52.980206] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4578worker2 # [ 53.154323] nix-daemon[873]: accepted connection from pid 1071, user nix-grpc-daemon (trusted)4579worker2 # [ 53.175253] nix-daemon[873]: reaped child process 1074, status = succeeded4580worker2 # [ 53.348325] nix-daemon[873]: accepted connection from pid 1076, user nix-grpc-daemon (trusted)4581worker2 # [ 53.372888] nix-daemon[873]: reaped child process 1079, status = succeeded4582lb # [ 53.385159] niks3-server[1066]: 2026/09/20 07:57:03 INFO Received uploads request method=POST path=/api/pending_closures4583worker2 # [ 53.389166] nix-grpc-daemon[883]: time=2026-09-20T07:57:03.176Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4584worker2 # [ 53.391290] nix-grpc-daemon[883]: time=2026-09-20T07:57:03.177Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4585lb # [ 53.400430] niks3-server[1066]: 2026/09/20 07:57:03 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4586lb # [ 53.404863] niks3-server[1066]: 2026/09/20 07:57:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4587lb # [ 53.408111] niks3-server[1066]: 2026/09/20 07:57:03 INFO Signed narinfos id=11 count=14588worker2 # [ 53.407361] nix-grpc-daemon[883]: time=2026-09-20T07:57:03.195Z level=INFO msg="Uploading 1 narinfos"4589lb # [ 53.412188] niks3-server[1066]: 2026/09/20 07:57:03 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4590lb # [ 53.418271] niks3-server[1066]: 2026/09/20 07:57:03 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4591lb # [ 53.425622] niks3-server[1066]: 2026/09/20 07:57:03 INFO Completed upload id=114592worker2 # [ 53.424819] nix-grpc-daemon[883]: time=2026-09-20T07:57:03.213Z level=INFO msg="Upload complete. (433ms)"4593lb # [ 53.428293] niks3-server[1066]: 2026/09/20 07:57:03 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4594worker2 # [ 53.429204] nix-grpc-daemon[850]: ts=2026-09-20T07:57:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=0 paths=1 nar_bytes_in=6244595worker2 # [ 53.432525] nix-grpc-daemon[850]: ts=2026-09-20T07:57:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482284596worker2 # [ 53.442296] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4597worker2 # [ 53.450552] nix-daemon[873]: reaped child process 1069, status = succeeded4598worker2 # [ 53.459969] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4599worker2 # [ 54.483435] nix-daemon[873]: reaped child process 1083, status = succeeded4600worker2 # [ 54.645623] nix-daemon[873]: accepted connection from pid 1098, user nix-grpc-daemon (trusted)4601worker2 # [ 54.667316] nix-daemon[873]: reaped child process 1101, status = succeeded4602lb # [ 54.680793] niks3-server[1066]: 2026/09/20 07:57:04 INFO Received uploads request method=POST path=/api/pending_closures4603worker2 # [ 54.687380] nix-grpc-daemon[883]: time=2026-09-20T07:57:04.475Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4604worker2 # [ 54.690230] nix-grpc-daemon[883]: time=2026-09-20T07:57:04.477Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4605lb # [ 54.720169] niks3-server[1066]: 2026/09/20 07:57:04 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4606lb # [ 54.724447] niks3-server[1066]: 2026/09/20 07:57:04 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4607lb # [ 54.728897] niks3-server[1066]: 2026/09/20 07:57:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4608lb # [ 54.731944] niks3-server[1066]: 2026/09/20 07:57:04 INFO Signed narinfos id=12 count=14609worker2 # [ 54.731627] nix-grpc-daemon[883]: time=2026-09-20T07:57:04.519Z level=INFO msg="Uploading 1 narinfos"4610lb # [ 54.744678] niks3-server[1066]: 2026/09/20 07:57:04 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4611lb # [ 54.746871] niks3-server[1066]: 2026/09/20 07:57:04 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4612lb # [ 54.759439] niks3-server[1066]: 2026/09/20 07:57:04 INFO Completed upload id=124613worker2 # [ 54.758309] nix-grpc-daemon[883]: time=2026-09-20T07:57:04.546Z level=INFO msg="Upload complete. (285ms)"4614worker2 # [ 54.762817] nix-grpc-daemon[850]: ts=2026-09-20T07:57:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=6 outputs=14615lb # [ 54.766662] niks3-server[1066]: 2026/09/20 07:57:04 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4616worker2 # [ 54.769827] nix-grpc-daemon[850]: ts=2026-09-20T07:57:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:482284617worker2 # [ 54.778171] nix-daemon[873]: reaped child process 1081, status = succeeded4618worker2 # [ 54.781231] nix-grpc-daemon[850]: ts=2026-09-20T07:57:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:482284619worker2 # [ 54.785630] nix-grpc-daemon[850]: ts=2026-09-20T07:57:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=0 paths=1 nar_bytes_out=1764620worker2 # [ 55.037116] nix-grpc-daemon[850]: ts=2026-09-20T07:57:04Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:482284621worker2 # [ 55.040620] nix-grpc-daemon[850]: ts=2026-09-20T07:57:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482284622worker2 # [ 55.048054] nix-grpc-daemon[883]: time=2026-09-20T07:57:04.836Z level=INFO msg="All 2 paths already cached"4623worker1 # [ 55.068729] nix-grpc-daemon[846]: ts=2026-09-20T07:57:05Z level=debug event=want client=7 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04624worker1 # [ 55.071431] nix-grpc-daemon[846]: ts=2026-09-20T07:57:05Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=14625worker2 # [ 55.108615] nix-grpc-daemon[850]: ts=2026-09-20T07:57:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482284626worker2 # [ 55.120190] nix-grpc-daemon[850]: ts=2026-09-20T07:57:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482284627worker2 # [ 55.131808] nix-grpc-daemon[883]: time=2026-09-20T07:57:04.920Z level=INFO msg="All 2 paths already cached"4628worker2 # [ 55.138245] nix-grpc-daemon[850]: ts=2026-09-20T07:57:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:482284629worker2 # [ 55.145339] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4630worker2 # [ 55.331296] nix-daemon[873]: accepted connection from pid 1105, user nix-grpc-daemon (trusted)4631worker2 # [ 55.356147] nix-daemon[873]: reaped child process 1108, status = succeeded4632worker2 # [ 55.523070] nix-daemon[873]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)4633worker2 # [ 55.539377] nix-daemon[873]: reaped child process 1113, status = succeeded4634lb # [ 55.552940] niks3-server[1066]: 2026/09/20 07:57:05 INFO Received uploads request method=POST path=/api/pending_closures4635worker2 # [ 55.557264] nix-grpc-daemon[883]: time=2026-09-20T07:57:05.345Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4636worker2 # [ 55.559642] nix-grpc-daemon[883]: time=2026-09-20T07:57:05.347Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4637lb # [ 55.573864] niks3-server[1066]: 2026/09/20 07:57:05 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4638lb # [ 55.582598] niks3-server[1066]: 2026/09/20 07:57:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4639lb # [ 55.585845] niks3-server[1066]: 2026/09/20 07:57:05 INFO Signed narinfos id=13 count=14640worker2 # [ 55.584855] nix-grpc-daemon[883]: time=2026-09-20T07:57:05.372Z level=INFO msg="Uploading 1 narinfos"4641lb # [ 55.591512] niks3-server[1066]: 2026/09/20 07:57:05 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4642lb # [ 55.597191] niks3-server[1066]: 2026/09/20 07:57:05 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4643lb # [ 55.603515] niks3-server[1066]: 2026/09/20 07:57:05 INFO Completed upload id=134644worker2 # [ 55.601929] nix-grpc-daemon[883]: time=2026-09-20T07:57:05.390Z level=INFO msg="Upload complete. (446ms)"4645worker2 # [ 55.604649] nix-grpc-daemon[850]: ts=2026-09-20T07:57:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=0 paths=1 nar_bytes_in=7524646lb # [ 55.607191] niks3-server[1066]: 2026/09/20 07:57:05 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4647worker2 # [ 55.609261] nix-grpc-daemon[850]: ts=2026-09-20T07:57:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482284648worker2 # [ 55.618690] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4649worker2 # [ 55.621630] nix-daemon[873]: reaped child process 1103, status = succeeded4650worker2 # [ 55.629186] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4651worker2 # [ 57.053417] nix-daemon[873]: reaped child process 1117, status = succeeded4652worker2 # [ 57.204263] nix-daemon[873]: accepted connection from pid 1132, user nix-grpc-daemon (trusted)4653worker2 # [ 57.222301] nix-daemon[873]: reaped child process 1135, status = succeeded4654lb # [ 57.236324] niks3-server[1066]: 2026/09/20 07:57:07 INFO Received uploads request method=POST path=/api/pending_closures4655worker2 # [ 57.243523] nix-grpc-daemon[883]: time=2026-09-20T07:57:07.030Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4656worker2 # [ 57.245277] nix-grpc-daemon[883]: time=2026-09-20T07:57:07.030Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4657lb # [ 57.269126] niks3-server[1066]: 2026/09/20 07:57:07 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4658lb # [ 57.272970] niks3-server[1066]: 2026/09/20 07:57:07 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4659lb # [ 57.280113] niks3-server[1066]: 2026/09/20 07:57:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4660lb # [ 57.283845] niks3-server[1066]: 2026/09/20 07:57:07 INFO Signed narinfos id=14 count=14661worker2 # [ 57.285162] nix-grpc-daemon[883]: time=2026-09-20T07:57:07.073Z level=INFO msg="Uploading 1 narinfos"4662lb # [ 57.292229] niks3-server[1066]: 2026/09/20 07:57:07 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4663lb # [ 57.299075] niks3-server[1066]: 2026/09/20 07:57:07 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4664lb # [ 57.303390] niks3-server[1066]: 2026/09/20 07:57:07 INFO Completed upload id=144665worker2 # [ 57.302472] nix-grpc-daemon[883]: time=2026-09-20T07:57:07.090Z level=INFO msg="Upload complete. (262ms)"4666lb # [ 57.307451] niks3-server[1066]: 2026/09/20 07:57:07 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4667worker2 # [ 57.307577] nix-grpc-daemon[850]: ts=2026-09-20T07:57:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=7 outputs=14668worker2 # [ 57.317338] nix-daemon[873]: reaped child process 1115, status = succeeded4669worker1 # [ 57.359050] nix-grpc-daemon[846]: ts=2026-09-20T07:57:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:581844670worker1 # [ 57.374285] nix-grpc-daemon[846]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4671worker1 # [ 57.383901] nix-grpc-daemon[846]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4672worker2 # [ 57.402131] nix-grpc-daemon[850]: ts=2026-09-20T07:57:07Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:482284673worker2 # [ 57.404620] nix-grpc-daemon[850]: ts=2026-09-20T07:57:07Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=0 paths=1 nar_bytes_out=2324674client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.05 seconds)4675client # [ 57.480941] nix-daemon[920]: reaped child process 922, status = succeeded4676client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4677client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)4678client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4679client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4680client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4681client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4682(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.14 seconds)4683subtest: an input only one worker has still reaches the builder4684client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4685client # this derivation will be built:4686client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4687lb # [ 57.933286] envoy[916]: conn peer=[2001:db8:1::1]:56866 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2985 tx=1371 ms=47404688lb # [ 57.935841] envoy[916]: conn peer=[2001:db8:1::1]:56874 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1085 ms=36804689lb # [ 57.938149] envoy[916]: conn peer=[2001:db8:1::1]:56876 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3412 tx=1638 ms=27034690lb # [ 57.939797] envoy[916]: conn peer=[2001:db8:1::1]:56888 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=334 ms=794691lb # [ 57.941472] envoy[916]: conn peer=[2001:db8:1::1]:60294 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=554692lb # [ 57.943249] envoy[916]: conn peer=[2001:db8:1::1]:60286 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3850 tx=1860 ms=19214693lb # [ 57.945667] envoy[916]: conn peer=[2001:db8:1::1]:60312 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=124694lb # [ 57.947226] envoy[916]: conn peer=[2001:db8:1::1]:60298 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4328 tx=2199 ms=23794695client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4696client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.53 seconds)4697client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4698client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.21 seconds)4699worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4700worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.18 seconds)4701worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4702worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds)4703client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24704client # [ 58.724310] nix-daemon[920]: accepted connection from pid 1000, user root (trusted)4705client # this derivation will be built:4706client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4707worker2 # [ 58.892591] nix-grpc-daemon[850]: ts=2026-09-20T07:57:08Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:482284708worker2 # [ 58.895452] nix-grpc-daemon[850]: ts=2026-09-20T07:57:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482284709client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4710client # copying 1 paths...4711client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'...4712worker1 # [ 58.911641] nix-grpc-daemon[846]: ts=2026-09-20T07:57:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:581844713worker1 # [ 58.920225] nix-daemon[907]: accepted connection from pid 846, user nix-grpc-daemon (trusted)4714worker1 # [ 59.089492] nix-daemon[907]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)4715worker1 # [ 59.106892] nix-daemon[907]: reaped child process 1042, status = succeeded4716lb # [ 59.115734] niks3-server[1066]: 2026/09/20 07:57:09 INFO Received uploads request method=POST path=/api/pending_closures4717worker1 # [ 59.127737] nix-grpc-daemon[951]: time=2026-09-20T07:57:09.065Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4718worker1 # [ 59.129439] nix-grpc-daemon[951]: time=2026-09-20T07:57:09.065Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4719lb # [ 59.143752] niks3-server[1066]: 2026/09/20 07:57:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4720lb # [ 59.150586] niks3-server[1066]: 2026/09/20 07:57:09 INFO Signed narinfos id=15 count=14721worker1 # [ 59.157734] nix-grpc-daemon[951]: time=2026-09-20T07:57:09.095Z level=INFO msg="Uploading 1 narinfos"4722lb # [ 59.160617] niks3-server[1066]: 2026/09/20 07:57:09 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4723lb # [ 59.445244] niks3-server[1066]: 2026/09/20 07:57:09 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4724lb # [ 59.452816] niks3-server[1066]: 2026/09/20 07:57:09 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4725lb # [ 59.459802] niks3-server[1066]: 2026/09/20 07:57:09 INFO Completed upload id=154726worker1 # [ 59.464354] nix-grpc-daemon[951]: time=2026-09-20T07:57:09.402Z level=INFO msg="Upload complete. (537ms)"4727lb # [ 59.464095] niks3-server[1066]: 2026/09/20 07:57:09 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4728worker1 # [ 59.468428] nix-grpc-daemon[846]: ts=2026-09-20T07:57:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58184 duration_s=0 paths=1 nar_bytes_in=1204729worker1 # [ 59.478204] nix-grpc-daemon[846]: ts=2026-09-20T07:57:09Z level=debug event=want client=8 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04730worker1 # [ 59.481240] nix-grpc-daemon[846]: ts=2026-09-20T07:57:09Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14731worker1 # [ 59.488455] nix-daemon[907]: reaped child process 1037, status = succeeded4732worker1 # [ 59.526914] nix-grpc-daemon[846]: ts=2026-09-20T07:57:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581844733worker1 # [ 59.538499] nix-grpc-daemon[846]: ts=2026-09-20T07:57:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:581844734client # copying 2 paths to 'lb:50051'...4735worker1 # [ 59.552326] nix-grpc-daemon[846]: ts=2026-09-20T07:57:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:581844736client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4737client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4738worker1 # [ 59.562145] nix-daemon[907]: accepted connection from pid 846, user nix-grpc-daemon (trusted)4739worker1 # [ 59.730626] nix-daemon[907]: accepted connection from pid 1048, user nix-grpc-daemon (trusted)4740worker1 # [ 59.747280] nix-daemon[907]: reaped child process 1051, status = succeeded4741worker1 # [ 59.912657] nix-daemon[907]: accepted connection from pid 1053, user nix-grpc-daemon (trusted)4742worker1 # [ 59.926837] nix-daemon[907]: reaped child process 1056, status = succeeded4743lb # [ 59.931560] niks3-server[1066]: 2026/09/20 07:57:10 INFO Received uploads request method=POST path=/api/pending_closures4744lb # [ 59.938720] niks3-server[1066]: 2026/09/20 07:57:10 INFO Received uploads request method=POST path=/api/pending_closures4745worker1 # [ 59.948837] nix-grpc-daemon[951]: time=2026-09-20T07:57:09.887Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4746worker1 # [ 59.952361] nix-grpc-daemon[951]: time=2026-09-20T07:57:09.889Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4747worker1 # [ 59.954430] nix-grpc-daemon[951]: time=2026-09-20T07:57:09.889Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4748lb # [ 59.972825] niks3-server[1066]: 2026/09/20 07:57:10 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4749lb # [ 59.984323] niks3-server[1066]: 2026/09/20 07:57:10 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4750lb # [ 59.988800] niks3-server[1066]: 2026/09/20 07:57:10 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4751lb # [ 59.994088] niks3-server[1066]: 2026/09/20 07:57:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4752lb # [ 59.998384] niks3-server[1066]: 2026/09/20 07:57:10 INFO Signed narinfos id=16 count=14753lb # [ 60.000258] niks3-server[1066]: 2026/09/20 07:57:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4754lb # [ 60.004028] niks3-server[1066]: 2026/09/20 07:57:10 INFO Signed narinfos id=17 count=24755lb # [ 60.006333] niks3-server[1066]: 2026/09/20 07:57:10 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4756worker1 # [ 60.011556] nix-grpc-daemon[951]: time=2026-09-20T07:57:09.949Z level=INFO msg="Uploading 3 narinfos"4757lb # [ 60.026131] niks3-server[1066]: 2026/09/20 07:57:10 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4758lb # [ 60.029682] niks3-server[1066]: 2026/09/20 07:57:10 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4759lb # [ 60.034166] niks3-server[1066]: 2026/09/20 07:57:10 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4760lb # [ 60.036732] niks3-server[1066]: 2026/09/20 07:57:10 INFO Completed upload id=164761lb # [ 60.038174] niks3-server[1066]: 2026/09/20 07:57:10 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4762lb # [ 60.042450] niks3-server[1066]: 2026/09/20 07:57:10 INFO Completed upload id=174763worker1 # [ 60.046495] nix-grpc-daemon[951]: time=2026-09-20T07:57:09.984Z level=INFO msg="Upload complete. (470ms)"4764lb # [ 60.044170] niks3-server[1066]: 2026/09/20 07:57:10 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4765worker1 # [ 60.050437] nix-grpc-daemon[846]: ts=2026-09-20T07:57:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58184 duration_s=0 paths=2 nar_bytes_in=9764766worker1 # [ 60.053712] nix-grpc-daemon[846]: ts=2026-09-20T07:57:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581844767worker1 # [ 60.061121] nix-daemon[907]: accepted connection from pid 846, user nix-grpc-daemon (trusted)4768worker1 # [ 60.068560] nix-daemon[907]: reaped child process 1046, status = succeeded4769client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...4770worker1 # [ 60.074689] nix-daemon[907]: accepted connection from pid 846, user nix-grpc-daemon (trusted)4771client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4772worker1 # [ 61.091167] nix-daemon[907]: reaped child process 1060, status = succeeded4773worker1 # [ 61.255741] nix-daemon[907]: accepted connection from pid 1075, user nix-grpc-daemon (trusted)4774worker1 # [ 61.270329] nix-daemon[907]: reaped child process 1078, status = succeeded4775lb # [ 61.278096] niks3-server[1066]: 2026/09/20 07:57:11 INFO Received uploads request method=POST path=/api/pending_closures4776worker1 # [ 61.290840] nix-grpc-daemon[951]: time=2026-09-20T07:57:11.228Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4777lb # [ 61.298197] niks3-server[1066]: 2026/09/20 07:57:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4778worker1 # [ 61.306882] nix-grpc-daemon[951]: time=2026-09-20T07:57:11.245Z level=INFO msg="Uploading 1 narinfos"4779lb # [ 61.304348] niks3-server[1066]: 2026/09/20 07:57:11 INFO Signed narinfos id=18 count=14780lb # [ 61.306873] niks3-server[1066]: 2026/09/20 07:57:11 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4781lb # [ 61.312683] niks3-server[1066]: 2026/09/20 07:57:11 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls4782lb # [ 61.319095] niks3-server[1066]: 2026/09/20 07:57:11 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4783lb # [ 61.324884] niks3-server[1066]: 2026/09/20 07:57:11 INFO Completed upload id=184784worker1 # [ 61.329862] nix-grpc-daemon[951]: time=2026-09-20T07:57:11.267Z level=INFO msg="Upload complete. (244ms)"4785lb # [ 61.328715] niks3-server[1066]: 2026/09/20 07:57:11 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo4786worker1 # [ 61.333457] nix-grpc-daemon[846]: ts=2026-09-20T07:57:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58184 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=8 outputs=14787worker1 # [ 61.343760] nix-daemon[907]: reaped child process 1058, status = succeeded4788client # copying 1 paths...4789worker2 # [ 61.373852] nix-grpc-daemon[850]: ts=2026-09-20T07:57:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:482284790worker2 # [ 61.383486] nix-grpc-daemon[850]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...4791client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...4792worker2 # [ 61.407856] nix-grpc-daemon[850]: ts=2026-09-20T07:57:11Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:482284793worker2 # [ 61.411051] nix-grpc-daemon[850]: ts=2026-09-20T07:57:11Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=0 paths=1 nar_bytes_out=1204794client # [ 61.515620] nix-daemon[920]: reaped child process 1003, status = succeeded4795client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.01 seconds)4796client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&24797client # [ 61.680089] nix-daemon[920]: accepted connection from pid 1021, user root (trusted)4798client # this derivation will be built:4799client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4800worker1 # [ 61.928034] nix-grpc-daemon[846]: ts=2026-09-20T07:57:11Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:581844801client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4802worker2 # [ 61.926276] nix-grpc-daemon[850]: ts=2026-09-20T07:57:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482284803worker1 # [ 61.946193] nix-grpc-daemon[846]: ts=2026-09-20T07:57:11Z level=debug event=want client=9 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=04804worker2 # [ 61.942560] nix-grpc-daemon[850]: ts=2026-09-20T07:57:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482284805worker1 # [ 61.948305] nix-grpc-daemon[846]: ts=2026-09-20T07:57:11Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14806worker2 # [ 61.951535] nix-grpc-daemon[850]: ts=2026-09-20T07:57:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:482284807client # copying 1 paths to 'lb:50051'...4808client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...4809worker2 # [ 61.966085] nix-grpc-daemon[850]: ts=2026-09-20T07:57:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:482284810worker2 # [ 61.977916] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4811worker2 # [ 61.995224] nix-grpc-daemon[850]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 1/5)4812worker2 # [ 62.073729] nix-grpc-daemon[850]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 105 ms (attempt 2/5)4813worker2 # [ 62.182197] nix-grpc-daemon[850]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 235 ms (attempt 3/5)4814worker2 # [ 62.421056] nix-grpc-daemon[850]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 330 ms (attempt 4/5)4815worker2 # [ 62.751340] nix-grpc-daemon[850]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4816worker2 # [ 62.754166] nix-grpc-daemon[850]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...4817worker2 # [ 62.909387] nix-daemon[873]: accepted connection from pid 1147, user nix-grpc-daemon (trusted)4818worker2 # [ 62.927315] nix-daemon[873]: reaped child process 1150, status = succeeded4819worker2 # [ 63.063888] nix-daemon[873]: accepted connection from pid 1152, user nix-grpc-daemon (trusted)4820worker2 # [ 63.080230] nix-daemon[873]: reaped child process 1155, status = succeeded4821lb # [ 63.092661] niks3-server[1066]: 2026/09/20 07:57:13 INFO Received uploads request method=POST path=/api/pending_closures4822worker2 # [ 63.096448] nix-grpc-daemon[883]: time=2026-09-20T07:57:12.884Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4823worker2 # [ 63.098202] nix-grpc-daemon[883]: time=2026-09-20T07:57:12.884Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"4824lb # [ 63.108803] niks3-server[1066]: 2026/09/20 07:57:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4825lb # [ 63.112331] niks3-server[1066]: 2026/09/20 07:57:13 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst4826lb # [ 63.116788] niks3-server[1066]: 2026/09/20 07:57:13 INFO Signed narinfos id=19 count=14827worker2 # [ 63.115844] nix-grpc-daemon[883]: time=2026-09-20T07:57:12.904Z level=INFO msg="Uploading 1 narinfos"4828lb # [ 63.120712] niks3-server[1066]: 2026/09/20 07:57:13 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls4829lb # [ 63.125080] niks3-server[1066]: 2026/09/20 07:57:13 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4830lb # [ 63.129085] niks3-server[1066]: 2026/09/20 07:57:13 INFO Completed upload id=194831worker2 # [ 63.128956] nix-grpc-daemon[883]: time=2026-09-20T07:57:12.917Z level=INFO msg="Upload complete. (363ms)"4832lb # [ 63.131359] niks3-server[1066]: 2026/09/20 07:57:13 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo4833worker2 # [ 63.131233] nix-grpc-daemon[850]: ts=2026-09-20T07:57:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=1 paths=1 nar_bytes_in=5604834worker2 # [ 63.134595] nix-grpc-daemon[850]: ts=2026-09-20T07:57:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:482284835worker2 # [ 63.141090] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4836worker2 # [ 63.151131] nix-daemon[873]: reaped child process 1141, status = succeeded4837worker2 # [ 63.152420] nix-grpc-daemon[850]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...4838client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...4839worker2 # [ 63.161353] nix-daemon[873]: accepted connection from pid 850, user nix-grpc-daemon (trusted)4840client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4841worker2 # [ 64.586265] nix-daemon[873]: reaped child process 1160, status = succeeded4842worker2 # [ 64.718235] nix-daemon[873]: accepted connection from pid 1175, user nix-grpc-daemon (trusted)4843worker2 # [ 64.733416] nix-daemon[873]: reaped child process 1178, status = succeeded4844lb # [ 64.747123] niks3-server[1066]: 2026/09/20 07:57:14 INFO Received uploads request method=POST path=/api/pending_closures4845worker2 # [ 64.752380] nix-grpc-daemon[883]: time=2026-09-20T07:57:14.540Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4846lb # [ 64.769211] niks3-server[1066]: 2026/09/20 07:57:14 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls4847lb # [ 64.774168] niks3-server[1066]: 2026/09/20 07:57:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4848lb # [ 64.776922] niks3-server[1066]: 2026/09/20 07:57:14 INFO Signed narinfos id=20 count=14849worker2 # [ 64.777742] nix-grpc-daemon[883]: time=2026-09-20T07:57:14.565Z level=INFO msg="Uploading 1 narinfos"4850lb # [ 64.782696] niks3-server[1066]: 2026/09/20 07:57:14 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4851lb # [ 64.788266] niks3-server[1066]: 2026/09/20 07:57:14 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4852lb # [ 64.793723] niks3-server[1066]: 2026/09/20 07:57:14 INFO Completed upload id=204853worker2 # [ 64.792409] nix-grpc-daemon[883]: time=2026-09-20T07:57:14.580Z level=INFO msg="Upload complete. (220ms)"4854lb # [ 64.795776] niks3-server[1066]: 2026/09/20 07:57:14 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo4855client # copying 1 paths...4856worker2 # [ 64.796674] nix-grpc-daemon[850]: ts=2026-09-20T07:57:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=9 outputs=14857worker2 # [ 64.801361] nix-grpc-daemon[850]: ts=2026-09-20T07:57:14Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:482284858client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...4859worker2 # [ 64.809797] nix-daemon[873]: reaped child process 1157, status = succeeded4860worker2 # [ 64.813075] nix-grpc-daemon[850]: ts=2026-09-20T07:57:14Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:482284861worker2 # [ 64.815322] nix-grpc-daemon[850]: ts=2026-09-20T07:57:14Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48228 duration_s=0 paths=1 nar_bytes_out=1204862client # [ 64.917736] nix-daemon[920]: reaped child process 1024, status = succeeded4863client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.40 seconds)4864client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&24865client # [ 65.126764] nix-daemon[920]: accepted connection from pid 1042, user root (trusted)4866client # this derivation will be built:4867client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4868worker2 # [ 65.280820] nix-grpc-daemon[850]: ts=2026-09-20T07:57:15Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:482284869client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4870worker1 # [ 65.290523] nix-grpc-daemon[846]: ts=2026-09-20T07:57:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:581844871worker1 # [ 65.301853] nix-grpc-daemon[951]: time=2026-09-20T07:57:15.239Z level=INFO msg="All 1 paths already cached"4872worker1 # [ 65.318902] nix-grpc-daemon[846]: ts=2026-09-20T07:57:15Z level=debug event=want client=10 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=04873worker1 # [ 65.325492] nix-grpc-daemon[846]: ts=2026-09-20T07:57:15Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14874worker1 # [ 65.332809] nix-grpc-daemon[846]: ts=2026-09-20T07:57:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581844875worker1 # [ 65.346375] nix-grpc-daemon[846]: ts=2026-09-20T07:57:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:581844876worker1 # [ 65.356813] nix-grpc-daemon[951]: time=2026-09-20T07:57:15.295Z level=INFO msg="All 1 paths already cached"4877client # copying 1 paths to 'lb:50051'...4878client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...4879worker1 # [ 65.361840] nix-grpc-daemon[846]: ts=2026-09-20T07:57:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:581844880worker1 # [ 65.367740] nix-daemon[907]: accepted connection from pid 846, user nix-grpc-daemon (trusted)4881worker1 # [ 65.509767] nix-daemon[907]: accepted connection from pid 1086, user nix-grpc-daemon (trusted)4882worker1 # [ 65.525688] nix-daemon[907]: reaped child process 1089, status = succeeded4883worker1 # [ 65.698727] nix-daemon[907]: accepted connection from pid 1091, user nix-grpc-daemon (trusted)4884worker1 # [ 65.713932] nix-daemon[907]: reaped child process 1094, status = succeeded4885lb # [ 65.721472] niks3-server[1066]: 2026/09/20 07:57:15 INFO Received uploads request method=POST path=/api/pending_closures4886worker1 # [ 65.731797] nix-grpc-daemon[951]: time=2026-09-20T07:57:15.670Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4887worker1 # [ 65.733958] nix-grpc-daemon[951]: time=2026-09-20T07:57:15.671Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"4888lb # [ 65.747847] niks3-server[1066]: 2026/09/20 07:57:15 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst4889lb # [ 65.751828] niks3-server[1066]: 2026/09/20 07:57:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4890lb # [ 65.754653] niks3-server[1066]: 2026/09/20 07:57:15 INFO Signed narinfos id=21 count=14891worker1 # [ 65.759129] nix-grpc-daemon[951]: time=2026-09-20T07:57:15.697Z level=INFO msg="Uploading 1 narinfos"4892lb # [ 65.762216] niks3-server[1066]: 2026/09/20 07:57:15 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4893lb # [ 65.776803] niks3-server[1066]: 2026/09/20 07:57:15 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls4894lb # [ 65.779955] niks3-server[1066]: 2026/09/20 07:57:15 INFO Completed upload id=214895worker1 # [ 65.784271] nix-grpc-daemon[951]: time=2026-09-20T07:57:15.722Z level=INFO msg="Upload complete. (410ms)"4896lb # [ 65.783536] niks3-server[1066]: 2026/09/20 07:57:15 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo4897worker1 # [ 65.786925] nix-grpc-daemon[846]: ts=2026-09-20T07:57:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58184 duration_s=0 paths=1 nar_bytes_in=5604898worker1 # [ 65.791494] nix-grpc-daemon[846]: ts=2026-09-20T07:57:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581844899worker1 # [ 65.800075] nix-daemon[907]: accepted connection from pid 846, user nix-grpc-daemon (trusted)4900worker1 # [ 65.803298] nix-daemon[907]: reaped child process 1084, status = succeeded4901worker1 # [ 65.810174] nix-daemon[907]: accepted connection from pid 846, user nix-grpc-daemon (trusted)4902client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...4903client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4904worker1 # [ 66.629594] nix-daemon[907]: reaped child process 1098, status = succeeded4905worker1 # [ 66.766407] nix-daemon[907]: accepted connection from pid 1113, user nix-grpc-daemon (trusted)4906worker1 # [ 66.781855] nix-daemon[907]: reaped child process 1116, status = succeeded4907lb # [ 66.788754] niks3-server[1066]: 2026/09/20 07:57:16 INFO Received uploads request method=POST path=/api/pending_closures4908worker1 # [ 66.800315] nix-grpc-daemon[951]: time=2026-09-20T07:57:16.738Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4909lb # [ 66.812930] niks3-server[1066]: 2026/09/20 07:57:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4910lb # [ 66.817215] niks3-server[1066]: 2026/09/20 07:57:16 INFO Signed narinfos id=22 count=14911worker1 # [ 66.823809] nix-grpc-daemon[951]: time=2026-09-20T07:57:16.761Z level=INFO msg="Uploading 1 narinfos"4912lb # [ 66.824987] niks3-server[1066]: 2026/09/20 07:57:17 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4913lb # [ 66.834438] niks3-server[1066]: 2026/09/20 07:57:17 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls4914lb # [ 66.836713] niks3-server[1066]: 2026/09/20 07:57:17 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4915lb # [ 66.842826] niks3-server[1066]: 2026/09/20 07:57:17 INFO Completed upload id=224916worker1 # [ 66.847240] nix-grpc-daemon[951]: time=2026-09-20T07:57:16.785Z level=INFO msg="Upload complete. (227ms)"4917lb # [ 66.847099] niks3-server[1066]: 2026/09/20 07:57:17 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo4918worker1 # [ 66.851637] nix-grpc-daemon[846]: ts=2026-09-20T07:57:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58184 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=10 outputs=14919worker1 # [ 66.862936] nix-daemon[907]: reaped child process 1096, status = succeeded4920client # copying 1 paths...4921worker1 # [ 66.896284] nix-grpc-daemon[846]: ts=2026-09-20T07:57:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:581844922client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...4923worker1 # [ 66.912052] nix-grpc-daemon[846]: ts=2026-09-20T07:57:16Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:581844924worker1 # [ 66.914567] nix-grpc-daemon[846]: ts=2026-09-20T07:57:16Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58184 duration_s=0 paths=1 nar_bytes_out=1204925client # [ 67.020932] nix-daemon[920]: reaped child process 1045, status = succeeded4926client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.09 seconds)4927(finished: subtest: an input only one worker has still reaches the builder, in 9.45 seconds)4928subtest: upload whose reference the worker lacks is completed from the cache4929client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache4930client # this derivation will be built:4931client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv4932client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...4933client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.39 seconds)4934client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache4935client # this derivation will be built:4936client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv4937client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...4938client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.43 seconds)4939client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure4940lb # [ 67.933604] envoy[916]: conn peer=[2001:db8:1::1]:60322 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4194 tx=1887 ms=25694941lb # [ 67.935713] envoy[916]: conn peer=[2001:db8:1::1]:60330 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=524942lb # [ 67.937545] envoy[916]: conn peer=[2001:db8:1::1]:60336 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3700 tx=1802 ms=29434943lb # [ 67.939429] envoy[916]: conn peer=[2001:db8:1::1]:49392 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=524944lb # [ 67.941268] envoy[916]: conn peer=[2001:db8:1::1]:49408 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=504945lb # [ 67.943313] envoy[916]: conn peer=[2001:db8:1::1]:49404 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3714 tx=1777 ms=16784946client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.27 seconds)4947worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4948worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.21 seconds)4949worker2 # [ 68.376523] systemd[1]: Stopping Nix worker-protocol over gRPC...4950worker2 # [ 69.184539] nix-grpc-daemon[850]: ts=2026-09-20T07:57:18Z level=info event=signal_exit4951worker1 # [ 69.201666] nix-grpc-daemon[846]: ts=2026-09-20T07:57:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:529384952worker1 # [ 69.203819] nix-grpc-daemon[846]: ts=2026-09-20T07:57:19Z level=info event=worker_gone addr=192.168.1.4:500514953worker2 # [ 69.201534] nix-grpc-daemon[850]: ts=2026-09-20T07:57:18Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4954worker2 # [ 69.220143] nix-daemon[873]: reaped child process 875, status = succeeded4955worker2 # [ 69.296912] nix-grpc-daemon[850]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4956worker2 # [ 69.299248] nix-grpc-daemon[850]: E0000 00:00:1789891039.084732 861 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true4957worker2 # [ 69.455887] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4958worker2 # [ 69.460442] systemd[1]: Stopped Nix worker-protocol over gRPC.4959worker2 # [ 69.461796] systemd[1]: nix-grpc-daemon.service: Consumed 2.609s CPU time over 51.529s wall clock time, 48.7M memory peak, 65.6K incoming IP traffic, 116.6K outgoing IP traffic.4960worker2 # [ 69.471802] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4961worker2 # [ 69.474766] systemd[1]: Closed Nix worker-protocol over gRPC.4962worker2 # [ 69.477489] systemd[1]: nix-grpc-daemon.socket: Consumed 436us CPU time over 59.481s wall clock time, 256K memory peak, 52.4K incoming IP traffic, 42.3K outgoing IP traffic.4963lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy4964lb: must succeed: curl -sf localhost:9901/clusters4965lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4966lb: must succeed: curl -sf localhost:9901/clusters4967lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4968lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 1.13 seconds)4969client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&24970worker1 # [ 70.866373] nix-grpc-daemon[846]: ts=2026-09-20T07:57:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:581844971worker1 # [ 70.871384] nix-grpc-daemon[846]: ts=2026-09-20T07:57:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:581844972client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache4973client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.28 seconds)4974worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache4975worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)4976worker2 # [ 70.972682] systemd[1]: Listening on Nix worker-protocol over gRPC.4977worker1 # [ 71.034672] systemd[1]: Stopping Nix worker-protocol over gRPC...4978worker1 # [ 71.223140] nix-grpc-daemon[846]: ts=2026-09-20T07:57:21Z level=info event=signal_exit4979worker1 # [ 71.227672] nix-grpc-daemon[846]: ts=2026-09-20T07:57:21Z level=info event=scheduler_restarting4980worker1 # [ 71.232386] nix-grpc-daemon[846]: ts=2026-09-20T07:57:21Z level=info event=scheduler_restarting addr=lb:500514981worker1 # [ 71.234727] nix-grpc-daemon[846]: ts=2026-09-20T07:57:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:529384982worker1 # [ 71.236881] nix-grpc-daemon[846]: ts=2026-09-20T07:57:21Z level=info event=worker_gone addr=192.168.1.3:500514983worker1 # [ 71.254625] nix-daemon[907]: reaped child process 909, status = succeeded4984worker1 # [ 71.353513] nix-grpc-daemon[846]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4985worker1 # [ 71.355583] nix-grpc-daemon[846]: E0000 00:00:1789891041.290887 889 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 14, started true, shutdown true4986worker1 # [ 71.358220] nix-grpc-daemon[846]: E0000 00:00:1789891041.291896 889 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4987worker1 # [ 71.437962] nix-grpc-daemon[846]: ts=2026-09-20T07:57:21Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4988worker2 # [ 71.449468] systemd[1]: Starting Nix worker-protocol over gRPC...4989worker2 # [ 71.653376] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:21Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4990worker2 # [ 71.655591] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:21Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14991worker2 # [ 71.663112] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:21Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4992worker2 # [ 71.668627] systemd[1]: Started Nix worker-protocol over gRPC.4993worker2 # [ 71.680734] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:21Z level=info event=scheduler_connected addr=lb:500514994worker1 # [ 71.687618] nix-grpc-daemon[846]: E0000 00:00:1789891041.625888 889 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true4995worker2 # [ 73.373644] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4996worker1 # [ 73.387480] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4997worker1 # [ 73.389739] systemd[1]: Stopped Nix worker-protocol over gRPC.4998worker1 # [ 73.392606] systemd[1]: nix-grpc-daemon.service: Consumed 1.561s CPU time over 55.460s wall clock time, 49.5M memory peak, 48.5K incoming IP traffic, 83.3K outgoing IP traffic.4999worker1 # [ 73.400828] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5000worker1 # [ 73.403553] systemd[1]: Closed Nix worker-protocol over gRPC.5001worker1 # [ 73.405927] systemd[1]: nix-grpc-daemon.socket: Consumed 349us CPU time over 1min 3.517s wall clock time, 256K memory peak, 72.4K incoming IP traffic, 60.8K outgoing IP traffic.5002lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5003lb: must succeed: curl -sf localhost:9901/clusters5004lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5005worker2 # [ 73.574418] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:23Z level=info event=scheduler_connected addr=lb:500515006worker2 # [ 73.577323] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5007worker2 # [ 73.778358] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:23Z level=info event=scheduler_connected addr=lb:500515008worker2 # [ 73.781306] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5009worker2 # [ 73.982129] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:23Z level=info event=scheduler_connected addr=lb:500515010worker2 # [ 73.985416] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5011worker2 # [ 74.186352] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:23Z level=info event=scheduler_connected addr=lb:500515012worker2 # [ 74.188885] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5013worker2 # [ 74.390878] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:24Z level=info event=scheduler_connected addr=lb:500515014worker2 # [ 74.393394] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5015lb: must succeed: curl -sf localhost:9901/clusters5016lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5017lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 1.12 seconds)5018client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25019worker2 # [ 74.594298] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:24Z level=info event=scheduler_connected addr=lb:500515020worker2 # [ 74.669372] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5021worker2 # [ 74.858171] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:573585022worker2 # [ 74.866355] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5023worker2 # [ 74.869947] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:24Z level=info event=scheduler_connected addr=lb:500515024worker2 # [ 74.872372] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5025worker2 # [ 74.884420] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 1/5)5026worker2 # [ 74.980134] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 146 ms (attempt 2/5)5027worker2 # [ 75.073460] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:24Z level=info event=scheduler_connected addr=lb:500515028worker2 # [ 75.076896] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5029worker2 # [ 75.129483] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 222 ms (attempt 3/5)5030worker2 # [ 75.277957] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:25Z level=info event=scheduler_connected addr=lb:500515031worker2 # [ 75.280676] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5032worker2 # [ 75.355280] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 513 ms (attempt 4/5)5033worker2 # [ 75.482576] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:25Z level=info event=scheduler_connected addr=lb:500515034worker2 # [ 75.485084] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5035worker2 # [ 75.686218] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:25Z level=info event=scheduler_connected addr=lb:500515036worker2 # [ 75.689116] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5037worker2 # [ 75.868859] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5038client # copying 2 paths...5039client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5040client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5041worker2 # [ 75.887247] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:573585042worker2 # [ 75.890358] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:25Z level=info event=scheduler_connected addr=lb:500515043worker2 # [ 75.893742] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5044worker2 # [ 75.901731] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5045worker2 # [ 75.959568] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:25Z level=info event=niks3_push_started pid=12205046worker2 # [ 76.094466] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:25Z level=info event=scheduler_connected addr=lb:500515047worker2 # [ 76.097880] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5048worker2 # [ 76.298412] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:26Z level=info event=scheduler_connected addr=lb:500515049worker2 # [ 76.304325] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5050worker2 # [ 76.333813] nix-daemon[873]: accepted connection from pid 1233, user nix-grpc-daemon (trusted)5051worker2 # [ 76.348969] nix-daemon[873]: reaped child process 1236, status = succeeded5052lb # [ 76.361261] niks3-server[1066]: 2026/09/20 07:57:26 INFO Received uploads request method=POST path=/api/pending_closures5053lb # [ 76.368456] niks3-server[1066]: 2026/09/20 07:57:26 INFO Received uploads request method=POST path=/api/pending_closures5054worker2 # [ 76.371789] nix-grpc-daemon[1220]: time=2026-09-20T07:57:26.159Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5055worker2 # [ 76.374223] nix-grpc-daemon[1220]: time=2026-09-20T07:57:26.161Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5056worker2 # [ 76.378926] nix-grpc-daemon[1220]: time=2026-09-20T07:57:26.162Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5057lb # [ 76.399258] niks3-server[1066]: 2026/09/20 07:57:26 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5058lb # [ 76.416507] niks3-server[1066]: 2026/09/20 07:57:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5059lb # [ 76.418659] niks3-server[1066]: 2026/09/20 07:57:26 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5060lb # [ 76.421881] niks3-server[1066]: 2026/09/20 07:57:26 INFO Signed narinfos id=23 count=15061lb # [ 76.424025] niks3-server[1066]: 2026/09/20 07:57:26 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5062lb # [ 76.426882] niks3-server[1066]: 2026/09/20 07:57:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5063lb # [ 76.431138] niks3-server[1066]: 2026/09/20 07:57:26 INFO Signed narinfos id=24 count=25064worker2 # [ 76.431176] nix-grpc-daemon[1220]: time=2026-09-20T07:57:26.218Z level=INFO msg="Uploading 3 narinfos"5065lb # [ 76.436419] niks3-server[1066]: 2026/09/20 07:57:26 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5066lb # [ 76.455602] niks3-server[1066]: 2026/09/20 07:57:26 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5067lb # [ 76.459939] niks3-server[1066]: 2026/09/20 07:57:26 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5068lb # [ 76.462152] niks3-server[1066]: 2026/09/20 07:57:26 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5069lb # [ 76.465028] niks3-server[1066]: 2026/09/20 07:57:26 INFO Completed upload id=235070lb # [ 76.466630] niks3-server[1066]: 2026/09/20 07:57:26 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5071lb # [ 76.470169] niks3-server[1066]: 2026/09/20 07:57:26 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5072lb # [ 76.472861] niks3-server[1066]: 2026/09/20 07:57:26 INFO Completed upload id=245073worker2 # [ 76.472254] nix-grpc-daemon[1220]: time=2026-09-20T07:57:26.260Z level=INFO msg="Upload complete. (301ms)"5074worker2 # [ 76.475589] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57358 duration_s=0 paths=2 nar_bytes_in=3125075worker2 # [ 76.486314] nix-daemon[873]: reaped child process 1218, status = succeeded5076client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.97 seconds)5077worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5078worker2 # [ 76.504659] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:26Z level=info event=scheduler_connected addr=lb:500515079worker2 # [ 76.507036] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5080worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.03 seconds)5081worker1 # [ 76.577471] systemd[1]: Listening on Nix worker-protocol over gRPC.5082worker1 # [ 76.582398] systemd[1]: Starting Nix worker-protocol over gRPC...5083worker2 # [ 76.705418] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:26Z level=info event=scheduler_connected addr=lb:500515084worker1 # [ 76.752753] nix-grpc-daemon[1139]: ts=2026-09-20T07:57:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5085worker1 # [ 76.756799] nix-grpc-daemon[1139]: ts=2026-09-20T07:57:26Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15086worker1 # [ 76.766232] nix-grpc-daemon[1139]: ts=2026-09-20T07:57:26Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5087worker1 # [ 76.770317] systemd[1]: Started Nix worker-protocol over gRPC.5088worker1 # [ 76.777449] nix-grpc-daemon[1139]: ts=2026-09-20T07:57:26Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05089worker1 # [ 76.785215] nix-grpc-daemon[1139]: ts=2026-09-20T07:57:26Z level=info event=scheduler_connected addr=lb:500515090lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5091lb: must succeed: curl -sf localhost:9901/clusters5092worker1 # [ 76.787481] nix-grpc-daemon[1139]: ts=2026-09-20T07:57:26Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05093lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5094lb: must succeed: curl -sf localhost:9901/clusters5095lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5096lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.11 seconds)5097(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.87 seconds)5098subtest: scheduler down: builds wait, then resume when it is back5099lb # [ 77.934057] envoy[916]: conn peer=192.168.1.4:33304 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1769 tx=732 ms=499645100lb # [ 77.936491] envoy[916]: conn peer=[2001:db8:1::1]:49422 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=185101worker1 # [ 77.941405] systemd[1]: Stopping Nix worker-protocol over gRPC...5102lb # [ 77.938752] envoy[916]: conn peer=192.168.1.3:53058 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1223 tx=468 ms=521695103lb # [ 77.940926] envoy[916]: conn peer=[2001:db8:1::1]:43730 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1007 tx=305 ms=17165104worker1 # [ 78.770594] nix-grpc-daemon[1139]: ts=2026-09-20T07:57:28Z level=info event=signal_exit5105worker2 # [ 78.766661] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:28Z level=info event=scheduler_restarting addr=lb:500515106worker1 # [ 78.773305] nix-grpc-daemon[1139]: ts=2026-09-20T07:57:28Z level=info event=scheduler_restarting5107worker1 # [ 78.774898] nix-grpc-daemon[1139]: ts=2026-09-20T07:57:28Z level=info event=scheduler_restarting addr=lb:500515108worker1 # [ 78.776624] nix-grpc-daemon[1139]: ts=2026-09-20T07:57:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:369805109worker1 # [ 78.778505] nix-grpc-daemon[1139]: ts=2026-09-20T07:57:28Z level=info event=worker_gone addr=192.168.1.3:500515110worker1 # [ 78.780224] nix-grpc-daemon[1139]: ts=2026-09-20T07:57:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:369805111worker1 # [ 78.782057] nix-grpc-daemon[1139]: ts=2026-09-20T07:57:28Z level=info event=worker_gone addr=192.168.1.4:500515112worker2 # [ 78.967291] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:28Z level=info event=scheduler_connected addr=lb:500515113worker1 # [ 78.974410] nix-grpc-daemon[1139]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5114worker1 # [ 78.977286] nix-grpc-daemon[1139]: E0000 00:00:1789891048.912718 1182 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 13, started true, shutdown true5115worker1 # [ 79.367855] nix-grpc-daemon[1139]: E0000 00:00:1789891049.306033 1182 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5116worker1 # [ 79.372828] nix-grpc-daemon[1139]: E0000 00:00:1789891049.310877 1182 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5117worker2 # [ 80.768761] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:30Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5118worker1 # [ 80.788386] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5119worker1 # [ 80.789797] systemd[1]: Stopped Nix worker-protocol over gRPC.5120worker1 # [ 80.792127] systemd[1]: nix-grpc-daemon.service: Consumed 126ms CPU time over 4.204s wall clock time, 9.8M memory peak, 6K incoming IP traffic, 5K outgoing IP traffic.5121worker1 # [ 80.798106] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5122worker1 # [ 80.800669] systemd[1]: Closed Nix worker-protocol over gRPC.5123worker1 # [ 80.802917] systemd[1]: nix-grpc-daemon.socket: Consumed 459us CPU time over 4.229s wall clock time, 256K memory peak, 13.9K incoming IP traffic, 10.2K outgoing IP traffic.5124lb: waiting until exactly ['worker1'] endpoints of sched are unhealthy5125lb: must succeed: curl -sf localhost:9901/clusters5126lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5127worker2 # [ 80.969050] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:30Z level=info event=scheduler_connected addr=lb:500515128worker2 # [ 80.971881] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:30Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5129worker2 # [ 81.172603] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:30Z level=info event=scheduler_connected addr=lb:500515130worker2 # [ 81.174912] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:30Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5131worker2 # [ 81.376294] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:31Z level=info event=scheduler_connected addr=lb:500515132worker2 # [ 81.379850] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:31Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5133worker2 # [ 81.580670] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:31Z level=info event=scheduler_connected addr=lb:500515134worker2 # [ 81.583182] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:31Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5135worker2 # [ 81.784661] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:31Z level=info event=scheduler_connected addr=lb:500515136worker2 # [ 81.786759] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:31Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5137lb: must succeed: curl -sf localhost:9901/clusters5138lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5139lb: (finished: waiting until exactly ['worker1'] endpoints of sched are unhealthy, in 1.09 seconds)5140client: must succeed: systemd-run --unit waits nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag schedback5141client # [ 81.938102] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag schedback.5142client # Running as unit: waits.service; invocation ID: 1eedeaee0640444496348b89043b42855143client: (finished: must succeed: systemd-run --unit waits nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag schedback, in 0.05 seconds)5144??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5145 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735146client: must succeed: sleep 3.05147worker2 # [ 81.987706] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:31Z level=info event=scheduler_connected addr=lb:500515148worker2 # [ 81.990213] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:31Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5149worker2 # [ 82.188732] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:573585150worker2 # [ 82.191970] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:31Z level=info event=scheduler_connected addr=lb:500515151client # [ 82.203431] nix[1121]: don't know how to build these paths:5152worker2 # [ 82.193732] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:31Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5153client # [ 82.204662] nix[1121]: /nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv5154client # [ 82.208635] nix[1121]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5155worker2 # [ 82.394530] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:32Z level=info event=scheduler_connected addr=lb:500515156worker2 # [ 82.396811] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:32Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5157worker2 # [ 82.597568] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:32Z level=info event=scheduler_connected addr=lb:500515158worker2 # [ 82.600213] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:32Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5159client # [ 82.712149] nix[1121]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5160worker2 # [ 82.801612] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:32Z level=info event=scheduler_connected addr=lb:500515161worker2 # [ 82.803700] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:32Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5162worker2 # [ 83.004768] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:32Z level=info event=scheduler_connected addr=lb:500515163worker2 # [ 83.007426] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:32Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5164worker2 # [ 83.208412] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:32Z level=info event=scheduler_connected addr=lb:500515165worker2 # [ 83.211412] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:32Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5166worker2 # [ 83.412860] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:33Z level=info event=scheduler_connected addr=lb:500515167worker2 # [ 83.417332] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5168worker2 # [ 83.617897] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:33Z level=info event=scheduler_connected addr=lb:500515169worker2 # [ 83.620710] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5170client # [ 83.716758] nix[1121]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5171worker2 # [ 83.822474] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:33Z level=info event=scheduler_connected addr=lb:500515172worker2 # [ 83.825083] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5173worker2 # [ 84.026063] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:33Z level=info event=scheduler_connected addr=lb:500515174worker2 # [ 84.028592] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5175worker2 # [ 84.229624] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:34Z level=info event=scheduler_connected addr=lb:500515176worker2 # [ 84.232486] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5177worker2 # [ 84.433858] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:34Z level=info event=scheduler_connected addr=lb:500515178worker2 # [ 84.437776] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5179worker2 # [ 84.638425] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:34Z level=info event=scheduler_connected addr=lb:500515180worker2 # [ 84.641331] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5181worker2 # [ 84.843490] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:34Z level=info event=scheduler_connected addr=lb:500515182worker2 # [ 84.847607] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5183client: (finished: must succeed: sleep 3.0, in 3.04 seconds)5184client: must succeed: systemctl is-active waits5185client: (finished: must succeed: systemctl is-active waits, in 0.02 seconds)5186worker2 # [ 85.048342] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:34Z level=info event=scheduler_connected addr=lb:500515187worker2 # [ 85.051060] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5188worker1 # [ 85.067714] systemd[1]: Listening on Nix worker-protocol over gRPC.5189worker1 # [ 85.073125] systemd[1]: Starting Nix worker-protocol over gRPC...5190worker1 # [ 85.236150] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5191worker1 # [ 85.237923] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15192worker1 # [ 85.244406] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5193worker1 # [ 85.246649] systemd[1]: Started Nix worker-protocol over gRPC.5194lb: waiting until exactly no endpoints of sched are unhealthy5195lb: must succeed: curl -sf localhost:9901/clusters5196worker2 # [ 85.252123] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:35Z level=info event=scheduler_connected addr=lb:500515197worker1 # [ 85.266950] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:35Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05198worker1 # [ 85.271058] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:35Z level=info event=scheduler_connected addr=lb:500515199worker1 # [ 85.272894] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05200lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5201worker1 # [ 85.720423] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:35Z level=debug event=want client=1 drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv cached=05202worker1 # [ 85.722331] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:35Z level=debug event=assigned drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv worker=192.168.1.4:50051 clients=15203worker2 # [ 85.760449] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:573585204worker2 # [ 85.775894] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:573585205client # [ 85.796525] nix[1121]: copying 1 paths to 'lb:50051'...5206client # [ 85.798079] nix[1121]: copying path '/nix/store/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv' to 'lb:50051'...5207worker2 # [ 85.788487] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:573585208worker2 # [ 85.800273] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5209worker2 # [ 85.987914] nix-daemon[873]: accepted connection from pid 1243, user nix-grpc-daemon (trusted)5210worker2 # [ 86.003027] nix-daemon[873]: reaped child process 1246, status = succeeded5211worker2 # [ 86.156906] nix-daemon[873]: accepted connection from pid 1248, user nix-grpc-daemon (trusted)5212worker2 # [ 86.173294] nix-daemon[873]: reaped child process 1251, status = succeeded5213lb # [ 86.185321] niks3-server[1066]: 2026/09/20 07:57:36 INFO Received uploads request method=POST path=/api/pending_closures5214worker2 # [ 86.189573] nix-grpc-daemon[1220]: time=2026-09-20T07:57:35.977Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5215worker2 # [ 86.191752] nix-grpc-daemon[1220]: time=2026-09-20T07:57:35.979Z level=INFO msg="Uploading 78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv (520B)"5216lb # [ 86.210562] niks3-server[1066]: 2026/09/20 07:57:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5217lb # [ 86.215120] niks3-server[1066]: 2026/09/20 07:57:36 INFO Signed narinfos id=25 count=15218worker2 # [ 86.214133] nix-grpc-daemon[1220]: time=2026-09-20T07:57:36.002Z level=INFO msg="Uploading 1 narinfos"5219lb # [ 86.219103] niks3-server[1066]: 2026/09/20 07:57:36 INFO Registered completed upload object_key=nar/06bjks304hxld0mwhch6kvcfiix46iimcpysvzrdsfv41vfc14ny.nar.zst5220lb # [ 86.227428] niks3-server[1066]: 2026/09/20 07:57:36 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5221lb # [ 86.241193] niks3-server[1066]: 2026/09/20 07:57:36 INFO Registered completed upload object_key=78ilcmmhxh1nxads92k8m9r0j1mgl1vw.ls5222lb # [ 86.253704] niks3-server[1066]: 2026/09/20 07:57:36 INFO Completed upload id=255223worker2 # [ 86.252587] nix-grpc-daemon[1220]: time=2026-09-20T07:57:36.040Z level=INFO msg="Upload complete. (439ms)"5224worker2 # [ 86.256432] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57358 duration_s=0 paths=1 nar_bytes_in=5205225worker2 # [ 86.259131] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:573585226lb # [ 86.264160] niks3-server[1066]: 2026/09/20 07:57:36 INFO Registered completed upload object_key=78ilcmmhxh1nxads92k8m9r0j1mgl1vw.narinfo5227worker2 # [ 86.266403] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5228worker2 # [ 86.270713] nix-daemon[873]: reaped child process 1241, status = succeeded5229worker2 # [ 86.277855] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5230client # [ 86.285896] nix[1121]: building '/nix/store/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv' on lb:50051...5231lb: must succeed: curl -sf localhost:9901/clusters5232lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5233lb: (finished: waiting until exactly no endpoints of sched are unhealthy, in 1.12 seconds)5234client: waiting for success: ! systemctl is-active waits5235worker2 # [ 87.097762] nix-daemon[873]: reaped child process 1255, status = succeeded5236worker2 # [ 87.259534] nix-daemon[873]: accepted connection from pid 1270, user nix-grpc-daemon (trusted)5237worker2 # [ 87.279603] nix-daemon[873]: reaped child process 1273, status = succeeded5238lb # [ 87.294667] niks3-server[1066]: 2026/09/20 07:57:37 INFO Received uploads request method=POST path=/api/pending_closures5239worker2 # [ 87.300905] nix-grpc-daemon[1220]: time=2026-09-20T07:57:37.089Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5240worker2 # [ 87.304604] nix-grpc-daemon[1220]: time=2026-09-20T07:57:37.090Z level=INFO msg="Uploading wxl98jgbbzfq9nz6nhndwvzybqml1mdg-farm-a (136B)"5241lb # [ 87.330807] niks3-server[1066]: 2026/09/20 07:57:37 INFO Registered completed upload object_key=log/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv5242lb # [ 87.345465] niks3-server[1066]: 2026/09/20 07:57:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5243lb # [ 87.353125] niks3-server[1066]: 2026/09/20 07:57:37 INFO Signed narinfos id=26 count=15244worker2 # [ 87.355216] nix-grpc-daemon[1220]: time=2026-09-20T07:57:37.143Z level=INFO msg="Uploading 1 narinfos"5245lb # [ 87.356654] niks3-server[1066]: 2026/09/20 07:57:37 INFO Registered completed upload object_key=nar/0857pwr5xvcgvis5zd1wyn7l7dm0a00lpfjkz94axr76vhy2l88g.nar.zst5246lb # [ 87.369392] niks3-server[1066]: 2026/09/20 07:57:37 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5247lb # [ 87.375441] niks3-server[1066]: 2026/09/20 07:57:37 INFO Completed upload id=265248worker2 # [ 87.374453] nix-grpc-daemon[1220]: time=2026-09-20T07:57:37.162Z level=INFO msg="Upload complete. (288ms)"5249lb # [ 87.376960] niks3-server[1066]: 2026/09/20 07:57:37 INFO Registered completed upload object_key=wxl98jgbbzfq9nz6nhndwvzybqml1mdg.ls5250lb # [ 87.380185] niks3-server[1066]: 2026/09/20 07:57:37 INFO Registered completed upload object_key=wxl98jgbbzfq9nz6nhndwvzybqml1mdg.narinfo5251worker2 # [ 87.377963] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57358 duration_s=1 drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv assign_id=1 outputs=15252worker2 # [ 87.388610] nix-daemon[873]: reaped child process 1253, status = succeeded5253worker1 # [ 87.394095] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:37Z level=debug event=want client=1 drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv cached=05254worker1 # [ 87.398289] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:37Z level=debug event=assigned drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv worker=192.168.1.4:50051 clients=15255worker2 # [ 87.434351] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:573585256worker2 # [ 87.444133] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:573585257worker2 # [ 87.453638] nix-grpc-daemon[1220]: time=2026-09-20T07:57:37.242Z level=INFO msg="All 1 paths already cached"5258client # [ 87.468459] nix[1121]: copying 1 paths to 'lb:50051'...5259worker2 # [ 87.462907] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:573585260client # [ 87.473212] nix[1121]: copying path '/nix/store/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv' to 'lb:50051'...5261worker2 # [ 87.472636] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5262worker2 # [ 87.637969] nix-daemon[873]: accepted connection from pid 1277, user nix-grpc-daemon (trusted)5263worker2 # [ 87.657912] nix-daemon[873]: reaped child process 1280, status = succeeded5264worker2 # [ 87.801625] nix-daemon[873]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)5265worker2 # [ 87.815700] nix-daemon[873]: reaped child process 1285, status = succeeded5266lb # [ 87.828089] niks3-server[1066]: 2026/09/20 07:57:38 INFO Received uploads request method=POST path=/api/pending_closures5267worker2 # [ 87.831093] nix-grpc-daemon[1220]: time=2026-09-20T07:57:37.619Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5268worker2 # [ 87.832582] nix-grpc-daemon[1220]: time=2026-09-20T07:57:37.619Z level=INFO msg="Uploading jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv (632B)"5269lb # [ 87.844763] niks3-server[1066]: 2026/09/20 07:57:38 INFO Registered completed upload object_key=nar/06r703613wasx30c56zihv19sk7v1y1xsivlzw3jax3csnwjf02v.nar.zst5270lb # [ 87.850787] niks3-server[1066]: 2026/09/20 07:57:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5271lb # [ 87.853236] niks3-server[1066]: 2026/09/20 07:57:38 INFO Signed narinfos id=27 count=15272worker2 # [ 87.851999] nix-grpc-daemon[1220]: time=2026-09-20T07:57:37.640Z level=INFO msg="Uploading 1 narinfos"5273lb # [ 87.856493] niks3-server[1066]: 2026/09/20 07:57:38 INFO Registered completed upload object_key=jv6y5kiw0k6gp891vxyi80vs9q23zzaj.ls5274lb # [ 87.861161] niks3-server[1066]: 2026/09/20 07:57:38 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5275lb # [ 87.864801] niks3-server[1066]: 2026/09/20 07:57:38 INFO Completed upload id=275276worker2 # [ 87.863506] nix-grpc-daemon[1220]: time=2026-09-20T07:57:37.651Z level=INFO msg="Upload complete. (385ms)"5277worker2 # [ 87.865819] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57358 duration_s=0 paths=1 nar_bytes_in=6325278lb # [ 87.867818] niks3-server[1066]: 2026/09/20 07:57:38 INFO Registered completed upload object_key=jv6y5kiw0k6gp891vxyi80vs9q23zzaj.narinfo5279worker2 # [ 87.868994] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:573585280worker2 # [ 87.876492] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5281worker2 # [ 87.880926] nix-daemon[873]: reaped child process 1275, status = succeeded5282client # [ 87.894957] nix[1121]: building '/nix/store/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv' on lb:50051...5283worker2 # [ 87.886410] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5284lb # [ 87.934443] envoy[916]: conn peer=[2001:db8:1::3]:40584 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=552 tx=177 ms=21915285worker2 # [ 89.117729] nix-daemon[873]: reaped child process 1289, status = succeeded5286worker2 # [ 89.283788] nix-daemon[873]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5287worker2 # [ 89.298911] nix-daemon[873]: reaped child process 1307, status = succeeded5288lb # [ 89.316178] niks3-server[1066]: 2026/09/20 07:57:39 INFO Received uploads request method=POST path=/api/pending_closures5289worker2 # [ 89.323889] nix-grpc-daemon[1220]: time=2026-09-20T07:57:39.111Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5290worker2 # [ 89.325880] nix-grpc-daemon[1220]: time=2026-09-20T07:57:39.113Z level=INFO msg="Uploading ahy8cs7r52ad4fklig5k1khmrwzp7bkc-farm-b (184B)"5291lb # [ 89.353785] niks3-server[1066]: 2026/09/20 07:57:39 INFO Registered completed upload object_key=log/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv5292lb # [ 89.364808] niks3-server[1066]: 2026/09/20 07:57:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5293lb # [ 89.370714] niks3-server[1066]: 2026/09/20 07:57:39 INFO Registered completed upload object_key=nar/1bxjgkmwyii071c3ahwryw7md5gl9qidg8bm2rb2v2idzf8bvmpb.nar.zst5294lb # [ 89.375755] niks3-server[1066]: 2026/09/20 07:57:39 INFO Signed narinfos id=28 count=15295worker2 # [ 89.377950] nix-grpc-daemon[1220]: time=2026-09-20T07:57:39.166Z level=INFO msg="Uploading 1 narinfos"5296lb # [ 89.385589] niks3-server[1066]: 2026/09/20 07:57:39 INFO Registered completed upload object_key=ahy8cs7r52ad4fklig5k1khmrwzp7bkc.ls5297lb # [ 89.393953] niks3-server[1066]: 2026/09/20 07:57:39 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5298lb # [ 89.399343] niks3-server[1066]: 2026/09/20 07:57:39 INFO Completed upload id=285299worker2 # [ 89.398382] nix-grpc-daemon[1220]: time=2026-09-20T07:57:39.186Z level=INFO msg="Upload complete. (302ms)"5300lb # [ 89.401967] niks3-server[1066]: 2026/09/20 07:57:39 INFO Registered completed upload object_key=ahy8cs7r52ad4fklig5k1khmrwzp7bkc.narinfo5301worker2 # [ 89.404654] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57358 duration_s=1 drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv assign_id=2 outputs=15302worker1 # [ 89.414289] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:39Z level=debug event=want client=1 drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv cached=05303worker1 # [ 89.416200] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:39Z level=debug event=assigned drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv worker=192.168.1.4:50051 clients=15304worker2 # [ 89.417820] nix-daemon[873]: reaped child process 1287, status = succeeded5305worker2 # [ 89.452169] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:573585306worker2 # [ 89.459435] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:573585307worker2 # [ 89.465431] nix-grpc-daemon[1220]: time=2026-09-20T07:57:39.253Z level=INFO msg="All 2 paths already cached"5308worker2 # [ 89.469573] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:573585309client # [ 89.478841] nix[1121]: copying 1 paths to 'lb:50051'...5310client # [ 89.481498] nix[1121]: copying path '/nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv' to 'lb:50051'...5311worker2 # [ 89.479448] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5312worker2 # [ 89.636061] nix-daemon[873]: accepted connection from pid 1311, user nix-grpc-daemon (trusted)5313worker2 # [ 89.652229] nix-daemon[873]: reaped child process 1314, status = succeeded5314worker2 # [ 89.817449] nix-daemon[873]: accepted connection from pid 1316, user nix-grpc-daemon (trusted)5315worker2 # [ 89.833291] nix-daemon[873]: reaped child process 1319, status = succeeded5316lb # [ 89.849772] niks3-server[1066]: 2026/09/20 07:57:40 INFO Received uploads request method=POST path=/api/pending_closures5317worker2 # [ 89.852665] nix-grpc-daemon[1220]: time=2026-09-20T07:57:39.640Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5318worker2 # [ 89.854242] nix-grpc-daemon[1220]: time=2026-09-20T07:57:39.640Z level=INFO msg="Uploading 4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv (760B)"5319lb # [ 89.861054] niks3-server[1066]: 2026/09/20 07:57:40 INFO Registered completed upload object_key=nar/1dx1l3qanf0yqmk397nzvl6w8vm5z1klsskxak9mqzzqlm7rj9id.nar.zst5320lb # [ 89.866196] niks3-server[1066]: 2026/09/20 07:57:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5321lb # [ 89.868742] niks3-server[1066]: 2026/09/20 07:57:40 INFO Signed narinfos id=29 count=15322worker2 # [ 89.867741] nix-grpc-daemon[1220]: time=2026-09-20T07:57:39.656Z level=INFO msg="Uploading 1 narinfos"5323lb # [ 89.870534] niks3-server[1066]: 2026/09/20 07:57:40 INFO Registered completed upload object_key=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym.ls5324lb # [ 89.875892] niks3-server[1066]: 2026/09/20 07:57:40 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5325lb # [ 89.879326] niks3-server[1066]: 2026/09/20 07:57:40 INFO Completed upload id=295326worker2 # [ 89.879233] nix-grpc-daemon[1220]: time=2026-09-20T07:57:39.667Z level=INFO msg="Upload complete. (388ms)"5327lb # [ 89.880917] niks3-server[1066]: 2026/09/20 07:57:40 INFO Registered completed upload object_key=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym.narinfo5328worker2 # [ 89.881425] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57358 duration_s=0 paths=1 nar_bytes_in=7605329worker2 # [ 89.884244] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:573585330worker2 # [ 89.892960] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5331worker2 # [ 89.896855] nix-daemon[873]: reaped child process 1309, status = succeeded5332client # [ 89.911424] nix[1121]: building '/nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv' on lb:50051...5333worker2 # [ 89.902994] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5334worker2 # [ 91.127802] nix-daemon[873]: reaped child process 1323, status = succeeded5335worker2 # [ 91.258199] nix-daemon[873]: accepted connection from pid 1338, user nix-grpc-daemon (trusted)5336worker2 # [ 91.275288] nix-daemon[873]: reaped child process 1341, status = succeeded5337lb # [ 91.287710] niks3-server[1066]: 2026/09/20 07:57:41 INFO Received uploads request method=POST path=/api/pending_closures5338worker2 # [ 91.293246] nix-grpc-daemon[1220]: time=2026-09-20T07:57:41.081Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5339worker2 # [ 91.295195] nix-grpc-daemon[1220]: time=2026-09-20T07:57:41.083Z level=INFO msg="Uploading 2kzynzc2x7d9fjl737krjzzjbsp5p77k-farm-top (240B)"5340lb # [ 91.312646] niks3-server[1066]: 2026/09/20 07:57:41 INFO Registered completed upload object_key=log/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv5341lb # [ 91.315372] niks3-server[1066]: 2026/09/20 07:57:41 INFO Registered completed upload object_key=nar/1x5xsygwz4a6bpv0g402i3p0nk63j2j9qkxs1rdnp6s20644kc3j.nar.zst5342lb # [ 91.320724] niks3-server[1066]: 2026/09/20 07:57:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5343worker2 # [ 91.321792] nix-grpc-daemon[1220]: time=2026-09-20T07:57:41.110Z level=INFO msg="Uploading 1 narinfos"5344lb # [ 91.323529] niks3-server[1066]: 2026/09/20 07:57:41 INFO Signed narinfos id=30 count=15345lb # [ 91.325799] niks3-server[1066]: 2026/09/20 07:57:41 INFO Registered completed upload object_key=2kzynzc2x7d9fjl737krjzzjbsp5p77k.ls5346lb # [ 91.331581] niks3-server[1066]: 2026/09/20 07:57:41 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5347lb # [ 91.335392] niks3-server[1066]: 2026/09/20 07:57:41 INFO Completed upload id=305348worker2 # [ 91.334120] nix-grpc-daemon[1220]: time=2026-09-20T07:57:41.122Z level=INFO msg="Upload complete. (221ms)"5349lb # [ 91.337460] niks3-server[1066]: 2026/09/20 07:57:41 INFO Registered completed upload object_key=2kzynzc2x7d9fjl737krjzzjbsp5p77k.narinfo5350worker2 # [ 91.338175] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57358 duration_s=1 drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv assign_id=3 outputs=15351worker2 # [ 91.344929] nix-daemon[873]: reaped child process 1321, status = succeeded5352client # [ 91.386339] systemd[1]: waits.service: Deactivated successfully.5353client # [ 91.389324] systemd[1]: waits.service: Consumed 207ms CPU time over 9.447s wall clock time, 43.5M memory peak, 13.9K incoming IP traffic, 19.4K outgoing IP traffic.5354client: (finished: waiting for success: ! systemctl is-active waits, in 5.27 seconds)5355client: must succeed: systemctl show -p Result --value waits | grep -qx success || { journalctl -u waits >&2; false; }5356client: (finished: must succeed: systemctl show -p Result --value waits | grep -qx success || { journalctl -u waits >&2; false; }, in 0.03 seconds)5357worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5358worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5359(finished: subtest: scheduler down: builds wait, then resume when it is back, in 13.84 seconds)5360subtest: clean scheduler restart: peers are told, reconnect without error or backoff5361client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5362client # [ 91.772377] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5363client # Running as unit: rs.service; invocation ID: d3eb469574ed453b9c6cc6b6af53315c5364client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.04 seconds)5365worker2 # [ 91.943289] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:573585366client # [ 91.958969] nix[1181]: don't know how to build these paths:5367client # [ 91.960080] nix[1181]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5368worker1 # [ 91.965538] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:41Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05369worker1 # [ 91.969852] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:41Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15370worker1 # [ 92.010129] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:382305371worker1 # [ 92.018569] nix-daemon[907]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)5372worker1 # [ 92.030193] nix-grpc-daemon[1200]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 1/5)5373worker1 # [ 92.072674] nix-grpc-daemon[1200]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 19 ms (attempt 2/5)5374worker1 # [ 92.095381] nix-grpc-daemon[1200]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 144 ms (attempt 3/5)5375worker1 # [ 92.243170] nix-grpc-daemon[1200]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 195 ms (attempt 4/5)5376worker1 # [ 92.442242] nix-grpc-daemon[1200]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5377worker1 # [ 92.457188] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:382305378client # [ 92.475577] nix[1181]: copying 1 paths to 'lb:50051'...5379worker1 # [ 92.477336] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:382305380client # [ 92.479767] nix[1181]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5381worker1 # [ 92.485131] nix-daemon[907]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)5382worker1 # [ 92.501063] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:42Z level=info event=niks3_push_started pid=12705383worker1 # [ 92.805259] nix-daemon[907]: accepted connection from pid 1283, user nix-grpc-daemon (trusted)5384worker1 # [ 92.820958] nix-daemon[907]: reaped child process 1286, status = succeeded5385worker1 # [ 92.990715] nix-daemon[907]: accepted connection from pid 1288, user nix-grpc-daemon (trusted)5386worker1 # [ 93.009917] nix-daemon[907]: reaped child process 1295, status = succeeded5387lb # [ 93.016839] niks3-server[1066]: 2026/09/20 07:57:43 INFO Received uploads request method=POST path=/api/pending_closures5388worker1 # [ 93.026473] nix-grpc-daemon[1270]: time=2026-09-20T07:57:42.963Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5389worker1 # [ 93.027916] nix-grpc-daemon[1270]: time=2026-09-20T07:57:42.963Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5390lb # [ 93.041114] niks3-server[1066]: 2026/09/20 07:57:43 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5391lb # [ 93.046221] niks3-server[1066]: 2026/09/20 07:57:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5392lb # [ 93.048792] niks3-server[1066]: 2026/09/20 07:57:43 INFO Signed narinfos id=31 count=15393worker1 # [ 93.053111] nix-grpc-daemon[1270]: time=2026-09-20T07:57:42.991Z level=INFO msg="Uploading 1 narinfos"5394lb # [ 93.055244] niks3-server[1066]: 2026/09/20 07:57:43 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5395lb # [ 93.059635] niks3-server[1066]: 2026/09/20 07:57:43 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5396lb # [ 93.062312] niks3-server[1066]: 2026/09/20 07:57:43 INFO Completed upload id=315397worker1 # [ 93.066787] nix-grpc-daemon[1270]: time=2026-09-20T07:57:43.005Z level=INFO msg="Upload complete. (410ms)"5398lb # [ 93.064868] niks3-server[1066]: 2026/09/20 07:57:43 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5399worker1 # [ 93.070574] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38230 duration_s=0 paths=1 nar_bytes_in=4165400worker1 # [ 93.075227] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:382305401worker1 # [ 93.082766] nix-daemon[907]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)5402worker1 # [ 93.092677] nix-daemon[907]: reaped child process 1268, status = succeeded5403client # [ 93.102589] nix[1181]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5404worker1 # [ 93.099747] nix-daemon[907]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)5405worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5406worker2 # [ 95.369426] systemd-journald[286]: Received client request to rotate journal, rotating.5407worker2 # [ 95.380391] systemd-journald[286]: Vacuuming done, freed 0B of archived journals from /var/log/journal/8d99ae4c06954718b93fa0205b3a046e.5408worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.05 seconds)5409worker1: must succeed: systemctl restart nix-grpc-daemon.service5410worker1 # [ 95.349941] systemd[1]: Stopping Nix worker-protocol over gRPC...5411worker1 # [ 95.521838] nix-daemon[907]: reaped child process 1299, status = succeeded5412worker1 # [ 95.660550] nix-daemon[907]: accepted connection from pid 1331, user nix-grpc-daemon (trusted)5413worker1 # [ 95.676447] nix-daemon[907]: reaped child process 1334, status = succeeded5414lb # [ 95.684896] niks3-server[1066]: 2026/09/20 07:57:45 INFO Received uploads request method=POST path=/api/pending_closures5415worker1 # [ 95.694308] nix-grpc-daemon[1270]: time=2026-09-20T07:57:45.632Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5416worker1 # [ 95.697197] nix-grpc-daemon[1270]: time=2026-09-20T07:57:45.634Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5417lb # [ 95.706101] niks3-server[1066]: 2026/09/20 07:57:45 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5418lb # [ 95.711552] niks3-server[1066]: 2026/09/20 07:57:45 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5419lb # [ 95.714873] niks3-server[1066]: 2026/09/20 07:57:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5420lb # [ 95.716463] niks3-server[1066]: 2026/09/20 07:57:45 INFO Signed narinfos id=32 count=15421worker1 # [ 95.722925] nix-grpc-daemon[1270]: time=2026-09-20T07:57:45.660Z level=INFO msg="Uploading 1 narinfos"5422lb # [ 95.720175] niks3-server[1066]: 2026/09/20 07:57:45 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5423lb # [ 95.725173] niks3-server[1066]: 2026/09/20 07:57:45 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5424lb # [ 95.728688] niks3-server[1066]: 2026/09/20 07:57:45 INFO Completed upload id=325425worker1 # [ 95.732921] nix-grpc-daemon[1270]: time=2026-09-20T07:57:45.671Z level=INFO msg="Upload complete. (222ms)"5426lb # [ 95.730433] niks3-server[1066]: 2026/09/20 07:57:45 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5427worker1 # [ 95.736063] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38230 duration_s=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15428worker1 # [ 95.745540] nix-daemon[907]: reaped child process 1297, status = succeeded5429client # [ 95.770259] systemd[1]: rs.service: Deactivated successfully.5430client # [ 95.772442] systemd[1]: rs.service: Consumed 108ms CPU time over 3.999s wall clock time, 39.1M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic.5431worker1 # [ 96.250699] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:46Z level=info event=signal_exit5432worker2 # [ 96.248558] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:46Z level=info event=scheduler_restarting addr=lb:500515433worker1 # [ 96.254697] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:46Z level=info event=scheduler_restarting5434worker1 # [ 96.258057] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:46Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:382085435worker1 # [ 96.260172] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:46Z level=info event=worker_gone addr=192.168.1.4:500515436worker1 # [ 96.261549] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:46Z level=info event=scheduler_restarting addr=lb:500515437worker1 # [ 96.262910] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:46Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:382085438worker1 # [ 96.264347] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:46Z level=info event=worker_gone addr=192.168.1.3:500515439worker1 # [ 96.296486] nix-daemon[907]: reaped child process 1263, status = succeeded5440worker2 # [ 96.448949] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:46Z level=info event=scheduler_connected addr=lb:500515441worker1 # [ 96.456347] nix-grpc-daemon[1200]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5442worker1 # [ 96.464301] nix-grpc-daemon[1200]: E0000 00:00:1789891066.394591 1243 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 14, started true, shutdown true5443worker1 # [ 96.468743] nix-grpc-daemon[1200]: ts=2026-09-20T07:57:46Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5444worker1 # [ 96.804789] nix-grpc-daemon[1200]: E0000 00:00:1789891066.741755 1243 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5445worker1 # [ 96.809812] nix-grpc-daemon[1200]: E0000 00:00:1789891066.743103 1243 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5446worker2 # [ 97.743674] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:47Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5447worker1 # [ 97.762922] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5448worker1 # [ 97.766656] systemd[1]: Stopped Nix worker-protocol over gRPC.5449worker1 # [ 97.768699] systemd[1]: nix-grpc-daemon.service: Consumed 561ms CPU time over 12.689s wall clock time, 31.2M memory peak, 17.5K incoming IP traffic, 23.6K outgoing IP traffic.5450worker1 # [ 97.785444] systemd[1]: Starting Nix worker-protocol over gRPC...5451worker1 # [ 97.925231] nix-grpc-daemon[1341]: ts=2026-09-20T07:57:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5452worker1 # [ 97.926961] nix-grpc-daemon[1341]: ts=2026-09-20T07:57:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15453worker1 # [ 97.932408] nix-grpc-daemon[1341]: ts=2026-09-20T07:57:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5454worker1 # [ 97.934663] systemd[1]: Started Nix worker-protocol over gRPC.5455worker1: (finished: must succeed: systemctl restart nix-grpc-daemon.service, in 2.62 seconds)5456lb # [ 97.935723] envoy[916]: conn peer=[2001:db8:1::1]:43746 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9947 tx=3966 ms=91675457worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_restarting5458lb # [ 97.937607] envoy[916]: conn peer=[2001:db8:1::1]:36026 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2947 tx=1374 ms=38005459lb # [ 97.938959] envoy[916]: conn peer=[2001:db8:1::3]:33162 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=787 tx=341 ms=111995460worker1 # [ 97.949170] nix-grpc-daemon[1341]: ts=2026-09-20T07:57:47Z level=info event=scheduler_connected addr=lb:500515461worker2 # [ 97.943622] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:47Z level=info event=scheduler_connected addr=lb:500515462worker1 # [ 97.956328] nix-grpc-daemon[1341]: ts=2026-09-20T07:57:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05463worker1 # [ 97.958743] nix-grpc-daemon[1341]: ts=2026-09-20T07:57:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05464worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_restarting, in 0.05 seconds)5465worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5466worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5467client: waiting for success: ! systemctl is-active rs5468client: (finished: waiting for success: ! systemctl is-active rs, in 0.03 seconds)5469client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5470client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)5471client: must fail: journalctl -u rs | grep -q 'reconnecting'5472client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds)5473(finished: subtest: clean scheduler restart: peers are told, reconnect without error or backoff, in 6.45 seconds)5474subtest: scheduler restart mid-build: build finishes, no double build5475client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5476client # [ 98.216293] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5477client # Running as unit: mid.service; invocation ID: 2fe1443492f44d20b74107cab88c44395478client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.03 seconds)5479worker1 # [ 98.370464] nix-grpc-daemon[1341]: ts=2026-09-20T07:57:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:574705480worker1 # [ 98.374543] nix-daemon[907]: accepted connection from pid 1341, user nix-grpc-daemon (trusted)5481client # [ 98.385549] nix[1213]: don't know how to build these paths:5482client # [ 98.386972] nix[1213]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5483worker1 # [ 98.388664] nix-grpc-daemon[1341]: ts=2026-09-20T07:57:48Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05484worker1 # [ 98.390490] nix-grpc-daemon[1341]: ts=2026-09-20T07:57:48Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15485worker2 # [ 98.430894] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:573585486worker2 # [ 98.437477] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:573585487client # [ 98.452091] nix[1213]: copying 1 paths to 'lb:50051'...5488worker2 # [ 98.443116] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:573585489client # [ 98.452896] nix[1213]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5490worker2 # [ 98.448917] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5491worker2 # [ 98.590175] nix-daemon[873]: accepted connection from pid 1380, user nix-grpc-daemon (trusted)5492worker2 # [ 98.606895] nix-daemon[873]: reaped child process 1383, status = succeeded5493worker2 # [ 98.777234] nix-daemon[873]: accepted connection from pid 1385, user nix-grpc-daemon (trusted)5494worker2 # [ 98.792735] nix-daemon[873]: reaped child process 1388, status = succeeded5495lb # [ 98.804218] niks3-server[1066]: 2026/09/20 07:57:48 INFO Received uploads request method=POST path=/api/pending_closures5496worker2 # [ 98.809660] nix-grpc-daemon[1220]: time=2026-09-20T07:57:48.597Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5497worker2 # [ 98.811215] nix-grpc-daemon[1220]: time=2026-09-20T07:57:48.599Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5498lb # [ 98.825198] niks3-server[1066]: 2026/09/20 07:57:49 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5499lb # [ 98.829640] niks3-server[1066]: 2026/09/20 07:57:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5500lb # [ 98.831619] niks3-server[1066]: 2026/09/20 07:57:49 INFO Signed narinfos id=33 count=15501worker2 # [ 98.832037] nix-grpc-daemon[1220]: time=2026-09-20T07:57:48.620Z level=INFO msg="Uploading 1 narinfos"5502lb # [ 98.838901] niks3-server[1066]: 2026/09/20 07:57:49 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5503lb # [ 98.840850] niks3-server[1066]: 2026/09/20 07:57:49 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5504lb # [ 98.844837] niks3-server[1066]: 2026/09/20 07:57:49 INFO Completed upload id=335505worker2 # [ 98.843519] nix-grpc-daemon[1220]: time=2026-09-20T07:57:48.631Z level=INFO msg="Upload complete. (389ms)"5506lb # [ 98.847895] niks3-server[1066]: 2026/09/20 07:57:49 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5507worker2 # [ 98.847173] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57358 duration_s=0 paths=1 nar_bytes_in=4245508worker2 # [ 98.850116] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:573585509worker2 # [ 98.856359] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5510worker2 # [ 98.863834] nix-daemon[873]: reaped child process 1378, status = succeeded5511client # [ 98.878520] nix[1213]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5512worker2 # [ 98.870110] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5513worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5514worker1 # [ 100.683530] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1341 (nix-grpc-daemon) on client request.5515worker1 # [ 100.689932] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5516worker2 # [ 100.687145] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5517client # [ 100.697540] nix[1213]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5518worker1 # [ 100.702459] nix-daemon[907]: reaped child process 1400, status = succeeded5519worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.05 seconds)5520client: must succeed: sleep 5.05521worker1 # [ 100.713255] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5522worker1 # [ 100.714991] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5523worker1 # [ 100.716884] systemd[1]: nix-grpc-daemon.service: Consumed 100ms CPU time over 2.927s wall clock time, 10.3M memory peak, 6.6K incoming IP traffic, 7.1K outgoing IP traffic.5524worker2 # [ 100.887476] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:50Z level=info event=scheduler_connected addr=lb:500515525worker1 # [ 100.950395] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5526worker1 # [ 100.959337] systemd[1]: Starting Nix worker-protocol over gRPC...5527worker1 # [ 101.110876] nix-grpc-daemon[1424]: ts=2026-09-20T07:57:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5528worker1 # [ 101.113446] nix-grpc-daemon[1424]: ts=2026-09-20T07:57:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15529worker1 # [ 101.119058] nix-grpc-daemon[1424]: ts=2026-09-20T07:57:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5530worker1 # [ 101.123137] systemd[1]: Started Nix worker-protocol over gRPC.5531worker1 # [ 101.128061] nix-grpc-daemon[1424]: ts=2026-09-20T07:57:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=15532worker1 # [ 101.140354] nix-grpc-daemon[1424]: ts=2026-09-20T07:57:51Z level=info event=scheduler_connected addr=lb:500515533worker1 # [ 101.141975] nix-grpc-daemon[1424]: ts=2026-09-20T07:57:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05534client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5535client: waiting for success: ! systemctl is-active mid5536worker2 # [ 106.107277] nix-daemon[873]: reaped child process 1392, status = succeeded5537worker2 # [ 106.278116] nix-daemon[873]: accepted connection from pid 1428, user nix-grpc-daemon (trusted)5538worker2 # [ 106.292638] nix-daemon[873]: reaped child process 1431, status = succeeded5539lb # [ 106.309825] niks3-server[1066]: 2026/09/20 07:57:56 INFO Received uploads request method=POST path=/api/pending_closures5540worker2 # [ 106.314492] nix-grpc-daemon[1220]: time=2026-09-20T07:57:56.102Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5541worker2 # [ 106.318336] nix-grpc-daemon[1220]: time=2026-09-20T07:57:56.104Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5542lb # [ 106.338050] niks3-server[1066]: 2026/09/20 07:57:56 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5543lb # [ 106.344304] niks3-server[1066]: 2026/09/20 07:57:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5544lb # [ 106.346884] niks3-server[1066]: 2026/09/20 07:57:56 INFO Signed narinfos id=34 count=15545worker2 # [ 106.345531] nix-grpc-daemon[1220]: time=2026-09-20T07:57:56.133Z level=INFO msg="Uploading 1 narinfos"5546lb # [ 106.349882] niks3-server[1066]: 2026/09/20 07:57:56 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5547lb # [ 106.356174] niks3-server[1066]: 2026/09/20 07:57:56 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5548lb # [ 106.357698] niks3-server[1066]: 2026/09/20 07:57:56 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5549lb # [ 106.360447] niks3-server[1066]: 2026/09/20 07:57:56 INFO Completed upload id=345550worker2 # [ 106.359236] nix-grpc-daemon[1220]: time=2026-09-20T07:57:56.147Z level=INFO msg="Upload complete. (273ms)"5551lb # [ 106.362028] niks3-server[1066]: 2026/09/20 07:57:56 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5552worker2 # [ 106.361979] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57358 duration_s=7 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15553worker2 # [ 106.369376] nix-daemon[873]: reaped child process 1390, status = succeeded5554client # [ 106.412732] systemd[1]: mid.service: Deactivated successfully.5555client # [ 106.416815] systemd[1]: mid.service: Consumed 105ms CPU time over 8.199s wall clock time, 39.1M memory peak, 8.8K incoming IP traffic, 9.2K outgoing IP traffic.5556client: (finished: waiting for success: ! systemctl is-active mid, in 1.06 seconds)5557client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5558client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)5559(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 8.85 seconds)5560subtest: interrupting the client stops the build on the worker5561client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5562client # [ 107.071192] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5563client # Running as unit: intr.service; invocation ID: 139f1408db2648bf9d6a6f3fff7b2e175564client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.03 seconds)5565client # [ 107.259032] nix[1248]: don't know how to build these paths:5566client # [ 107.259856] nix[1248]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5567worker2 # [ 107.249353] nix-grpc-daemon[1199]: ts=2026-09-20T07:57:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:573585568worker1 # [ 107.264049] nix-grpc-daemon[1424]: ts=2026-09-20T07:57:57Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05569worker1 # [ 107.265804] nix-grpc-daemon[1424]: ts=2026-09-20T07:57:57Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15570worker1 # [ 107.308570] nix-grpc-daemon[1424]: ts=2026-09-20T07:57:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351725571worker1 # [ 107.314736] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5572worker1 # [ 107.324100] nix-grpc-daemon[1424]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 1/5)5573worker1 # [ 107.334511] nix-grpc-daemon[1424]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 2/5)5574worker1 # [ 107.391264] nix-grpc-daemon[1424]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 221 ms (attempt 3/5)5575worker1 # [ 107.618128] nix-grpc-daemon[1424]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 270 ms (attempt 4/5)5576worker1 # [ 107.891528] nix-grpc-daemon[1424]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5577worker1 # [ 107.906857] nix-grpc-daemon[1424]: ts=2026-09-20T07:57:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:351725578client # [ 107.920306] nix[1248]: copying 1 paths to 'lb:50051'...5579worker1 # [ 107.917146] nix-grpc-daemon[1424]: ts=2026-09-20T07:57:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:351725580client # [ 107.922937] nix[1248]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5581worker1 # [ 107.929161] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5582lb # [ 107.936634] envoy[916]: conn peer=[2001:db8:1::3]:49372 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=496 tx=55 ms=27465583lb # [ 107.940647] envoy[916]: conn peer=[2001:db8:1::1]:38252 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3014 tx=1356 ms=80145584worker1 # [ 107.951426] nix-grpc-daemon[1424]: ts=2026-09-20T07:57:57Z level=info event=niks3_push_started pid=14915585worker1 # [ 108.271551] nix-daemon[907]: accepted connection from pid 1504, user nix-grpc-daemon (trusted)5586worker1 # [ 108.283160] nix-daemon[907]: reaped child process 1511, status = succeeded5587worker1 # [ 108.408342] nix-daemon[907]: accepted connection from pid 1513, user nix-grpc-daemon (trusted)5588worker1 # [ 108.420767] nix-daemon[907]: reaped child process 1516, status = succeeded5589lb # [ 108.433204] niks3-server[1066]: 2026/09/20 07:57:58 INFO Received uploads request method=POST path=/api/pending_closures5590worker1 # [ 108.446336] nix-grpc-daemon[1491]: time=2026-09-20T07:57:58.383Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5591worker1 # [ 108.447723] nix-grpc-daemon[1491]: time=2026-09-20T07:57:58.383Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5592lb # [ 108.463134] niks3-server[1066]: 2026/09/20 07:57:58 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5593lb # [ 108.473280] niks3-server[1066]: 2026/09/20 07:57:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5594lb # [ 108.478254] niks3-server[1066]: 2026/09/20 07:57:58 INFO Signed narinfos id=35 count=15595worker1 # [ 108.485547] nix-grpc-daemon[1491]: time=2026-09-20T07:57:58.423Z level=INFO msg="Uploading 1 narinfos"5596lb # [ 108.489835] niks3-server[1066]: 2026/09/20 07:57:58 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5597lb # [ 108.497472] niks3-server[1066]: 2026/09/20 07:57:58 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5598lb # [ 108.502565] niks3-server[1066]: 2026/09/20 07:57:58 INFO Completed upload id=355599worker1 # [ 108.506938] nix-grpc-daemon[1491]: time=2026-09-20T07:57:58.445Z level=INFO msg="Upload complete. (370ms)"5600worker1 # [ 108.510341] nix-grpc-daemon[1424]: ts=2026-09-20T07:57:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=0 paths=1 nar_bytes_in=4245601lb # [ 108.506950] niks3-server[1066]: 2026/09/20 07:57:58 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5602worker1 # [ 108.515379] nix-grpc-daemon[1424]: ts=2026-09-20T07:57:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351725603worker1 # [ 108.521202] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5604worker1 # [ 108.523614] nix-daemon[907]: reaped child process 1489, status = succeeded5605worker1 # [ 108.528919] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5606client # [ 108.533209] nix[1248]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5607client: must succeed: systemctl kill -s INT intr5608client # [ 110.488947] systemd[1]: intr.service: Sent signal SIGINT to main process 1248 (nix) on client request.5609client: (finished: must succeed: systemctl kill -s INT intr, in 0.03 seconds)5610client # [ 110.494301] nix[1248]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5611client # [ 110.497754] nix[1248]: error: interrupted by the user5612client # [ 110.528821] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5613client # [ 110.530737] systemd[1]: intr.service: Failed with result 'exit-code'.5614client # [ 110.533347] systemd[1]: intr.service: Consumed 107ms CPU time over 3.457s wall clock time, 39.1M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5615worker1 # [ 110.555537] nix-daemon[907]: reaped child process 1518, status = succeeded5616worker1 # [ 110.560236] nix-daemon[1520]: unexpected Nix daemon error: error: interrupted by the user5617worker1 # [ 110.564707] nix-daemon[907]: reaped child process 1520, status = failed with exit code 15618(finished: subtest: interrupting the client stops the build on the worker, in 3.56 seconds)5619subtest: a deploy mid-build drains: the build finishes, the new generation takes over5620client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5621client # [ 110.652423] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5622client # Running as unit: sw.service; invocation ID: e4bfc2e35ad547b496b9647d1be50e6d5623client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.06 seconds)5624worker1 # [ 110.846571] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:351725625client # [ 110.857197] nix[1268]: don't know how to build these paths:5626client # [ 110.858271] nix[1268]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5627worker1 # [ 110.860659] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:00Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05628worker1 # [ 110.865100] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:00Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15629worker2 # [ 110.899770] nix-grpc-daemon[1199]: ts=2026-09-20T07:58:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:573585630worker2 # [ 110.906679] nix-grpc-daemon[1199]: ts=2026-09-20T07:58:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:573585631client # [ 110.920368] nix[1268]: copying 1 paths to 'lb:50051'...5632worker2 # [ 110.914627] nix-grpc-daemon[1199]: ts=2026-09-20T07:58:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:573585633client # [ 110.924142] nix[1268]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5634worker2 # [ 110.921435] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5635worker2 # [ 111.081116] nix-daemon[873]: accepted connection from pid 1459, user nix-grpc-daemon (trusted)5636worker2 # [ 111.096185] nix-daemon[873]: reaped child process 1462, status = succeeded5637worker2 # [ 111.251878] nix-daemon[873]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)5638worker2 # [ 111.264821] nix-daemon[873]: reaped child process 1467, status = succeeded5639lb # [ 111.283854] niks3-server[1066]: 2026/09/20 07:58:01 INFO Received uploads request method=POST path=/api/pending_closures5640worker2 # [ 111.291244] nix-grpc-daemon[1220]: time=2026-09-20T07:58:01.079Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5641worker2 # [ 111.292641] nix-grpc-daemon[1220]: time=2026-09-20T07:58:01.079Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5642lb # [ 111.310721] niks3-server[1066]: 2026/09/20 07:58:01 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5643lb # [ 111.320542] niks3-server[1066]: 2026/09/20 07:58:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5644worker2 # [ 111.326739] nix-grpc-daemon[1220]: time=2026-09-20T07:58:01.114Z level=INFO msg="Uploading 1 narinfos"5645lb # [ 111.327688] niks3-server[1066]: 2026/09/20 07:58:01 INFO Signed narinfos id=36 count=15646lb # [ 111.333398] niks3-server[1066]: 2026/09/20 07:58:01 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5647lb # [ 111.343800] niks3-server[1066]: 2026/09/20 07:58:01 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5648lb # [ 111.348982] niks3-server[1066]: 2026/09/20 07:58:01 INFO Completed upload id=365649worker2 # [ 111.347821] nix-grpc-daemon[1220]: time=2026-09-20T07:58:01.136Z level=INFO msg="Upload complete. (419ms)"5650lb # [ 111.351248] niks3-server[1066]: 2026/09/20 07:58:01 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5651worker2 # [ 111.350243] nix-grpc-daemon[1199]: ts=2026-09-20T07:58:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57358 duration_s=0 paths=1 nar_bytes_in=4165652worker2 # [ 111.354604] nix-grpc-daemon[1199]: ts=2026-09-20T07:58:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:573585653worker2 # [ 111.361251] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5654worker2 # [ 111.363745] nix-daemon[873]: reaped child process 1457, status = succeeded5655worker2 # [ 111.369059] nix-daemon[873]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5656client # [ 111.378080] nix[1268]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5657worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25658worker2 # Checking switch inhibitors... done5659worker2 # [ 113.763839] nixos[1502]: switching to system configuration /nix/store/bznf9929lxh8v7x0vc51aqmj89268niq-nixos-system-worker2-test5660worker2 # activating the configuration...5661worker2 # [ 113.768127] systemd[1]: Stopped target Remote File Systems.5662worker2 # [ 113.769130] systemd[1]: Stopped target Local File Systems.5663worker2 # setting up /etc...5664worker2 # [ 114.366420] systemd[1]: Reload requested from client PID 1502 ('.switch-to-conf') (unit backdoor.service)...5665worker2 # [ 114.368145] systemd[1]: Reloading...5666worker2 # [ 115.022061] systemd[1]: Reloading finished in 649 ms.5667worker2 # restarting sysinit-reactivation.target5668worker2 # [ 115.078827] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5669worker2 # [ 115.201559] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5670worker2 # [ 115.202724] systemd[1]: Reached target Reactivate sysinit units.5671worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5672worker2 # [ 115.208661] dbus-broker-launch[579]: Caught SIGHUP, trigger reload.5673worker2 # [ 115.209665] systemd[1]: Reloading D-Bus System Message Bus...5674worker2 # [ 115.217448] systemd[1]: Reloading Nix worker-protocol over gRPC...5675worker2 # [ 115.231273] dbus-broker-launch[579]: Looking up NSS user entry for 'systemd-timesync'...5676worker2 # [ 115.235443] dbus-broker-launch[579]: NSS returned no entry for 'systemd-timesync'5677worker2 # [ 115.237971] dbus-broker-launch[579]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5678worker2 # [ 115.255264] systemd[1]: Reloaded Nix worker-protocol over gRPC.5679worker2 # [ 115.268509] systemd[1]: Reloaded D-Bus System Message Bus.5680worker2 # [ 115.271548] systemd[1]: Reached target Local File Systems.5681worker2 # [ 115.279139] systemd[1]: Reached target Remote File Systems.5682worker2 # [ 115.281429] systemd[1]: Starting linger-users.service...5683worker2 # [ 115.284182] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5684worker2 # [ 115.285410] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5685worker2 # [ 115.290949] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5686worker2 # [ 115.294206] systemd[1]: Starting Create SUID/SGID Wrappers...5687worker2 # [ 115.295801] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5688worker2 # [ 115.297655] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675689worker2 # [ 115.299596] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5690worker2 # [ 115.301024] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5691worker2 # [ 115.304963] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5692worker2 # [ 115.352074] systemd[1]: linger-users.service: Deactivated successfully.5693worker2 # [ 115.354375] systemd[1]: Finished linger-users.service.5694worker2 # [ 115.682850] nix-grpc-daemon[1199]: ts=2026-09-20T07:58:05Z level=info event=draining5695worker2 # [ 115.719702] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5696worker2 # [ 115.726086] systemd[1]: Finished Create SUID/SGID Wrappers.5697worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5698worker2 # [ 115.979329] nixos[1502]: finished switching to system configuration /nix/store/bznf9929lxh8v7x0vc51aqmj89268niq-nixos-system-worker2-test5699worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 2.90 seconds)5700worker2: must succeed: pgrep -f 'read -t [9]0 x'5701worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)5702client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&25703client # don't know how to build these paths:5704worker1 # [ 116.248234] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:351725705client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5706worker1 # [ 116.257963] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:06Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05707worker1 # [ 116.259965] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:06Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=15708worker1 # [ 116.304295] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351725709worker1 # [ 116.314637] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:351725710client # copying 1 paths to 'lb:50051'...5711worker1 # [ 116.323371] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:351725712client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5713worker1 # [ 116.339798] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5714worker1 # [ 116.479156] nix-daemon[907]: accepted connection from pid 1570, user nix-grpc-daemon (trusted)5715worker1 # [ 116.491538] nix-daemon[907]: reaped child process 1573, status = succeeded5716worker1 # [ 116.648353] nix-daemon[907]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5717worker1 # [ 116.660338] nix-daemon[907]: reaped child process 1578, status = succeeded5718lb # [ 116.672440] niks3-server[1066]: 2026/09/20 07:58:06 INFO Received uploads request method=POST path=/api/pending_closures5719worker1 # [ 116.686604] nix-grpc-daemon[1491]: time=2026-09-20T07:58:06.624Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5720worker1 # [ 116.688067] nix-grpc-daemon[1491]: time=2026-09-20T07:58:06.624Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"5721lb # [ 116.701469] niks3-server[1066]: 2026/09/20 07:58:06 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst5722lb # [ 116.717266] niks3-server[1066]: 2026/09/20 07:58:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5723lb # [ 116.723238] niks3-server[1066]: 2026/09/20 07:58:06 INFO Signed narinfos id=37 count=15724worker1 # [ 116.731787] nix-grpc-daemon[1491]: time=2026-09-20T07:58:06.670Z level=INFO msg="Uploading 1 narinfos"5725lb # [ 116.729987] niks3-server[1066]: 2026/09/20 07:58:06 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls5726lb # [ 116.740089] niks3-server[1066]: 2026/09/20 07:58:06 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5727lb # [ 116.747139] niks3-server[1066]: 2026/09/20 07:58:06 INFO Completed upload id=375728worker1 # [ 116.751236] nix-grpc-daemon[1491]: time=2026-09-20T07:58:06.689Z level=INFO msg="Upload complete. (406ms)"5729lb # [ 116.749502] niks3-server[1066]: 2026/09/20 07:58:06 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo5730worker1 # [ 116.755124] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=0 paths=1 nar_bytes_in=5285731worker1 # [ 116.759930] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351725732worker1 # [ 116.770610] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5733worker1 # [ 116.774243] nix-daemon[907]: reaped child process 1568, status = succeeded5734worker1 # [ 116.779218] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5735client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...5736client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5737lb # [ 117.937562] envoy[916]: conn peer=[2001:db8:1::1]:35696 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=730 ms=32505738client # farm-a> LOG-farm-a-during-drain5739worker1 # [ 118.410167] nix-daemon[907]: reaped child process 1582, status = succeeded5740worker1 # [ 118.570096] nix-daemon[907]: accepted connection from pid 1597, user nix-grpc-daemon (trusted)5741worker1 # [ 118.581241] nix-daemon[907]: reaped child process 1600, status = succeeded5742lb # [ 118.594860] niks3-server[1066]: 2026/09/20 07:58:08 INFO Received uploads request method=POST path=/api/pending_closures5743worker1 # [ 118.605309] nix-grpc-daemon[1491]: time=2026-09-20T07:58:08.542Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5744worker1 # [ 118.609363] nix-grpc-daemon[1491]: time=2026-09-20T07:58:08.542Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"5745lb # [ 118.622100] niks3-server[1066]: 2026/09/20 07:58:08 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5746lb # [ 118.627358] niks3-server[1066]: 2026/09/20 07:58:08 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5747lb # [ 118.632451] niks3-server[1066]: 2026/09/20 07:58:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5748lb # [ 118.634370] niks3-server[1066]: 2026/09/20 07:58:08 INFO Signed narinfos id=38 count=15749worker1 # [ 118.640514] nix-grpc-daemon[1491]: time=2026-09-20T07:58:08.578Z level=INFO msg="Uploading 1 narinfos"5750lb # [ 118.641223] niks3-server[1066]: 2026/09/20 07:58:08 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls5751lb # [ 118.648367] niks3-server[1066]: 2026/09/20 07:58:08 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5752lb # [ 118.651513] niks3-server[1066]: 2026/09/20 07:58:08 INFO Completed upload id=385753worker1 # [ 118.657125] nix-grpc-daemon[1491]: time=2026-09-20T07:58:08.595Z level=INFO msg="Upload complete. (269ms)"5754lb # [ 118.653741] niks3-server[1066]: 2026/09/20 07:58:08 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo5755worker1 # [ 118.659642] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=3 outputs=15756worker1 # [ 118.666918] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:08Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=05757worker1 # [ 118.668887] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:08Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=15758worker1 # [ 118.673344] nix-daemon[907]: reaped child process 1580, status = succeeded5759worker1 # [ 118.710123] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351725760worker1 # [ 118.716871] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:351725761worker1 # [ 118.723626] nix-grpc-daemon[1491]: time=2026-09-20T07:58:08.662Z level=INFO msg="All 1 paths already cached"5762client # copying 1 paths to 'lb:50051'...5763worker1 # [ 118.727923] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:351725764client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...5765worker1 # [ 118.736347] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5766worker1 # [ 118.889087] nix-daemon[907]: accepted connection from pid 1606, user nix-grpc-daemon (trusted)5767worker1 # [ 118.901571] nix-daemon[907]: reaped child process 1609, status = succeeded5768worker1 # [ 119.060281] nix-daemon[907]: accepted connection from pid 1611, user nix-grpc-daemon (trusted)5769worker1 # [ 119.072861] nix-daemon[907]: reaped child process 1614, status = succeeded5770lb # [ 119.084593] niks3-server[1066]: 2026/09/20 07:58:09 INFO Received uploads request method=POST path=/api/pending_closures5771worker1 # [ 119.095214] nix-grpc-daemon[1491]: time=2026-09-20T07:58:09.033Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5772worker1 # [ 119.096718] nix-grpc-daemon[1491]: time=2026-09-20T07:58:09.033Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"5773lb # [ 119.104774] niks3-server[1066]: 2026/09/20 07:58:09 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst5774lb # [ 119.109707] niks3-server[1066]: 2026/09/20 07:58:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5775lb # [ 119.111959] niks3-server[1066]: 2026/09/20 07:58:09 INFO Signed narinfos id=39 count=15776worker1 # [ 119.117735] nix-grpc-daemon[1491]: time=2026-09-20T07:58:09.056Z level=INFO msg="Uploading 1 narinfos"5777lb # [ 119.119302] niks3-server[1066]: 2026/09/20 07:58:09 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls5778lb # [ 119.123622] niks3-server[1066]: 2026/09/20 07:58:09 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5779lb # [ 119.128239] niks3-server[1066]: 2026/09/20 07:58:09 INFO Completed upload id=395780worker1 # [ 119.132243] nix-grpc-daemon[1491]: time=2026-09-20T07:58:09.070Z level=INFO msg="Upload complete. (389ms)"5781lb # [ 119.130143] niks3-server[1066]: 2026/09/20 07:58:09 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo5782worker1 # [ 119.135074] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=0 paths=1 nar_bytes_in=6405783worker1 # [ 119.140463] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351725784worker1 # [ 119.144799] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5785worker1 # [ 119.147230] nix-daemon[907]: reaped child process 1604, status = succeeded5786worker1 # [ 119.152315] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5787client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...5788client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5789client # farm-b> LOG-farm-b-during-drain5790worker1 # [ 120.368683] nix-daemon[907]: reaped child process 1618, status = succeeded5791worker1 # [ 120.495493] nix-daemon[907]: accepted connection from pid 1633, user nix-grpc-daemon (trusted)5792worker1 # [ 120.507920] nix-daemon[907]: reaped child process 1636, status = succeeded5793lb # [ 120.521874] niks3-server[1066]: 2026/09/20 07:58:10 INFO Received uploads request method=POST path=/api/pending_closures5794worker1 # [ 120.533191] nix-grpc-daemon[1491]: time=2026-09-20T07:58:10.471Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5795worker1 # [ 120.534964] nix-grpc-daemon[1491]: time=2026-09-20T07:58:10.473Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"5796lb # [ 120.552588] niks3-server[1066]: 2026/09/20 07:58:10 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst5797lb # [ 120.560984] niks3-server[1066]: 2026/09/20 07:58:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5798lb # [ 120.563641] niks3-server[1066]: 2026/09/20 07:58:10 INFO Signed narinfos id=40 count=15799worker1 # [ 120.567915] nix-grpc-daemon[1491]: time=2026-09-20T07:58:10.506Z level=INFO msg="Uploading 1 narinfos"5800lb # [ 120.567681] niks3-server[1066]: 2026/09/20 07:58:10 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5801lb # [ 120.571797] niks3-server[1066]: 2026/09/20 07:58:10 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls5802lb # [ 120.575850] niks3-server[1066]: 2026/09/20 07:58:10 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5803lb # [ 120.578471] niks3-server[1066]: 2026/09/20 07:58:10 INFO Completed upload id=405804worker1 # [ 120.582666] nix-grpc-daemon[1491]: time=2026-09-20T07:58:10.521Z level=INFO msg="Upload complete. (223ms)"5805lb # [ 120.581254] niks3-server[1066]: 2026/09/20 07:58:10 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo5806worker1 # [ 120.585698] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=4 outputs=15807worker1 # [ 120.592387] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:10Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=05808worker1 # [ 120.594355] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:10Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=15809worker1 # [ 120.598597] nix-daemon[907]: reaped child process 1616, status = succeeded5810worker1 # [ 120.637423] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351725811worker1 # [ 120.649951] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:351725812worker1 # [ 120.661810] nix-grpc-daemon[1491]: time=2026-09-20T07:58:10.600Z level=INFO msg="All 2 paths already cached"5813client # copying 1 paths to 'lb:50051'...5814worker1 # [ 120.670477] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:351725815client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...5816worker1 # [ 120.690476] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5817worker1 # [ 120.840412] nix-daemon[907]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)5818worker1 # [ 120.852887] nix-daemon[907]: reaped child process 1645, status = succeeded5819worker1 # [ 121.002100] nix-daemon[907]: accepted connection from pid 1647, user nix-grpc-daemon (trusted)5820worker1 # [ 121.013928] nix-daemon[907]: reaped child process 1650, status = succeeded5821lb # [ 121.018274] niks3-server[1066]: 2026/09/20 07:58:11 INFO Received uploads request method=POST path=/api/pending_closures5822worker1 # [ 121.030947] nix-grpc-daemon[1491]: time=2026-09-20T07:58:10.969Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5823worker1 # [ 121.032507] nix-grpc-daemon[1491]: time=2026-09-20T07:58:10.970Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"5824lb # [ 121.053855] niks3-server[1066]: 2026/09/20 07:58:11 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst5825lb # [ 121.061419] niks3-server[1066]: 2026/09/20 07:58:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5826lb # [ 121.066608] niks3-server[1066]: 2026/09/20 07:58:11 INFO Signed narinfos id=41 count=15827worker1 # [ 121.074022] nix-grpc-daemon[1491]: time=2026-09-20T07:58:11.012Z level=INFO msg="Uploading 1 narinfos"5828lb # [ 121.077153] niks3-server[1066]: 2026/09/20 07:58:11 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls5829lb # [ 121.087219] niks3-server[1066]: 2026/09/20 07:58:11 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5830worker1 # [ 121.098269] nix-grpc-daemon[1491]: time=2026-09-20T07:58:11.036Z level=INFO msg="Upload complete. (398ms)"5831lb # [ 121.094213] niks3-server[1066]: 2026/09/20 07:58:11 INFO Completed upload id=415832worker1 # [ 121.100240] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=0 paths=1 nar_bytes_in=7685833lb # [ 121.097604] niks3-server[1066]: 2026/09/20 07:58:11 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo5834worker1 # [ 121.105349] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351725835worker1 # [ 121.110372] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5836worker1 # [ 121.112725] nix-daemon[907]: reaped child process 1640, status = succeeded5837worker1 # [ 121.118142] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5838client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...5839client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5840client # farm-top> LOG-farm-top-during-drain5841worker1 # [ 122.748309] nix-daemon[907]: reaped child process 1654, status = succeeded5842worker1 # [ 122.892354] nix-daemon[907]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)5843worker1 # [ 122.904740] nix-daemon[907]: reaped child process 1672, status = succeeded5844lb # [ 122.918129] niks3-server[1066]: 2026/09/20 07:58:13 INFO Received uploads request method=POST path=/api/pending_closures5845worker1 # [ 122.934354] nix-grpc-daemon[1491]: time=2026-09-20T07:58:12.872Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5846worker1 # [ 122.937802] nix-grpc-daemon[1491]: time=2026-09-20T07:58:12.874Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"5847lb # [ 122.956410] niks3-server[1066]: 2026/09/20 07:58:13 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5848lb # [ 122.970767] niks3-server[1066]: 2026/09/20 07:58:13 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst5849lb # [ 122.984611] niks3-server[1066]: 2026/09/20 07:58:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5850lb # [ 122.988572] niks3-server[1066]: 2026/09/20 07:58:13 INFO Signed narinfos id=42 count=15851worker1 # [ 122.995370] nix-grpc-daemon[1491]: time=2026-09-20T07:58:12.933Z level=INFO msg="Uploading 1 narinfos"5852lb # [ 122.995089] niks3-server[1066]: 2026/09/20 07:58:13 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls5853lb # [ 123.001347] niks3-server[1066]: 2026/09/20 07:58:13 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5854lb # [ 123.005270] niks3-server[1066]: 2026/09/20 07:58:13 INFO Completed upload id=425855lb # [ 123.007066] niks3-server[1066]: 2026/09/20 07:58:13 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo5856worker1 # [ 123.009797] nix-grpc-daemon[1491]: time=2026-09-20T07:58:12.948Z level=INFO msg="Upload complete. (282ms)"5857worker1 # [ 123.016757] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=5 outputs=15858worker1 # [ 123.030493] nix-daemon[907]: reaped child process 1652, status = succeeded5859client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&2, in 7.03 seconds)5860client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath5861client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath, in 0.23 seconds)5862worker2: must succeed: pkill -f 'read -t [9]0 x'5863worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)5864client: waiting for success: ! systemctl is-active sw5865worker2 # [ 123.400792] nix-daemon[873]: reaped child process 1471, status = succeeded5866worker2 # [ 123.525091] nix-daemon[873]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)5867worker2 # [ 123.539615] nix-daemon[873]: reaped child process 1645, status = succeeded5868lb # [ 123.549659] niks3-server[1066]: 2026/09/20 07:58:13 INFO Received uploads request method=POST path=/api/pending_closures5869worker2 # [ 123.557098] nix-grpc-daemon[1220]: time=2026-09-20T07:58:13.345Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5870worker2 # [ 123.560062] nix-grpc-daemon[1220]: time=2026-09-20T07:58:13.347Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"5871lb # [ 123.592787] niks3-server[1066]: 2026/09/20 07:58:13 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5872lb # [ 123.598524] niks3-server[1066]: 2026/09/20 07:58:13 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5873lb # [ 123.609486] niks3-server[1066]: 2026/09/20 07:58:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5874worker2 # [ 123.612696] nix-grpc-daemon[1220]: time=2026-09-20T07:58:13.400Z level=INFO msg="Uploading 1 narinfos"5875lb # [ 123.613486] niks3-server[1066]: 2026/09/20 07:58:13 INFO Signed narinfos id=43 count=15876lb # [ 123.618491] niks3-server[1066]: 2026/09/20 07:58:13 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls5877lb # [ 123.623143] niks3-server[1066]: 2026/09/20 07:58:13 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5878lb # [ 123.625734] niks3-server[1066]: 2026/09/20 07:58:13 INFO Completed upload id=435879worker2 # [ 123.625926] nix-grpc-daemon[1220]: time=2026-09-20T07:58:13.414Z level=INFO msg="Upload complete. (236ms)"5880lb # [ 123.628459] niks3-server[1066]: 2026/09/20 07:58:13 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo5881worker2 # [ 123.630473] nix-grpc-daemon[1199]: ts=2026-09-20T07:58:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57358 duration_s=12 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=2 outputs=15882worker2 # [ 123.636745] nix-daemon[873]: reaped child process 1469, status = succeeded5883client # [ 123.679577] systemd[1]: sw.service: Deactivated successfully.5884client # [ 123.684922] systemd[1]: sw.service: Consumed 137ms CPU time over 13.030s wall clock time, 39.1M memory peak, 8.3K incoming IP traffic, 8.9K outgoing IP traffic.5885worker2 # [ 123.684606] nix-grpc-daemon[1199]: ts=2026-09-20T07:58:13Z level=info event=signal_exit5886worker1 # [ 123.694418] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:575265887worker1 # [ 123.696104] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:13Z level=info event=worker_gone addr=192.168.1.4:500515888worker2 # [ 123.692698] nix-grpc-daemon[1199]: ts=2026-09-20T07:58:13Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5889worker2 # [ 123.702461] nix-daemon[873]: reaped child process 1213, status = succeeded5890worker2 # [ 123.733301] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5891worker2 # [ 123.735201] systemd[1]: nix-grpc-daemon.service: Consumed 1.913s CPU time over 52.283s wall clock time, 32.5M memory peak, 65.6K incoming IP traffic, 107.9K outgoing IP traffic.5892worker2 # [ 123.937213] systemd[1]: Starting Nix worker-protocol over gRPC...5893worker2 # [ 124.095249] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5894worker2 # [ 124.097191] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:13Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15895worker2 # [ 124.103056] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5896worker2 # [ 124.106610] systemd[1]: Started Nix worker-protocol over gRPC.5897worker2 # [ 124.121040] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:13Z level=info event=scheduler_connected addr=lb:500515898worker1 # [ 124.129593] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:14Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05899client: (finished: waiting for success: ! systemctl is-active sw, in 1.09 seconds)5900client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5901client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)5902worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5903worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.05 seconds)5904lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5905lb: must succeed: curl -sf localhost:9901/clusters5906lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5907lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.05 seconds)5908worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5909worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5910(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.07 seconds)5911subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5912client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15913worker1 # [ 124.913500] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:351725914worker1 # [ 124.925952] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:14Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=05915worker1 # [ 124.930960] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:14Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=15916worker1 # [ 124.935785] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:14Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=05917worker1 # [ 124.939696] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:14Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=05918worker1 # [ 124.970925] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351725919worker1 # [ 124.981517] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:351725920worker1 # [ 124.990071] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:351725921worker1 # [ 124.995804] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5922worker1 # [ 125.153078] nix-daemon[907]: accepted connection from pid 1683, user nix-grpc-daemon (trusted)5923worker1 # [ 125.165884] nix-daemon[907]: reaped child process 1686, status = succeeded5924worker1 # [ 125.326689] nix-daemon[907]: accepted connection from pid 1688, user nix-grpc-daemon (trusted)5925worker1 # [ 125.339166] nix-daemon[907]: reaped child process 1691, status = succeeded5926lb # [ 125.352284] niks3-server[1066]: 2026/09/20 07:58:15 INFO Received uploads request method=POST path=/api/pending_closures5927worker1 # [ 125.366679] nix-grpc-daemon[1491]: time=2026-09-20T07:58:15.304Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5928worker1 # [ 125.368449] nix-grpc-daemon[1491]: time=2026-09-20T07:58:15.304Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"5929lb # [ 125.384366] niks3-server[1066]: 2026/09/20 07:58:15 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst5930lb # [ 125.400816] niks3-server[1066]: 2026/09/20 07:58:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5931worker1 # [ 125.409154] nix-grpc-daemon[1491]: time=2026-09-20T07:58:15.347Z level=INFO msg="Uploading 1 narinfos"5932lb # [ 125.404793] niks3-server[1066]: 2026/09/20 07:58:15 INFO Signed narinfos id=44 count=15933lb # [ 125.410948] niks3-server[1066]: 2026/09/20 07:58:15 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls5934lb # [ 125.420155] niks3-server[1066]: 2026/09/20 07:58:15 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5935lb # [ 125.424080] niks3-server[1066]: 2026/09/20 07:58:15 INFO Completed upload id=445936worker1 # [ 125.429719] nix-grpc-daemon[1491]: time=2026-09-20T07:58:15.368Z level=INFO msg="Upload complete. (428ms)"5937lb # [ 125.426731] niks3-server[1066]: 2026/09/20 07:58:15 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo5938worker1 # [ 125.433258] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=0 paths=1 nar_bytes_in=5045939worker1 # [ 125.435694] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351725940worker1 # [ 125.440276] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5941worker1 # [ 125.444924] nix-daemon[907]: reaped child process 1681, status = succeeded5942worker1 # [ 125.450940] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5943worker1 # [ 126.464405] nix-daemon[907]: reaped child process 1695, status = succeeded5944worker1 # [ 126.589101] nix-daemon[907]: accepted connection from pid 1710, user nix-grpc-daemon (trusted)5945worker1 # [ 126.601767] nix-daemon[907]: reaped child process 1713, status = succeeded5946lb # [ 126.609579] niks3-server[1066]: 2026/09/20 07:58:16 INFO Received uploads request method=POST path=/api/pending_closures5947worker1 # [ 126.623434] nix-grpc-daemon[1491]: time=2026-09-20T07:58:16.561Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5948worker1 # [ 126.624969] nix-grpc-daemon[1491]: time=2026-09-20T07:58:16.563Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"5949lb # [ 126.650619] niks3-server[1066]: 2026/09/20 07:58:16 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv5950lb # [ 126.655817] niks3-server[1066]: 2026/09/20 07:58:16 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5951lb # [ 126.667379] niks3-server[1066]: 2026/09/20 07:58:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5952lb # [ 126.671661] niks3-server[1066]: 2026/09/20 07:58:16 INFO Signed narinfos id=45 count=15953worker1 # [ 126.679022] nix-grpc-daemon[1491]: time=2026-09-20T07:58:16.617Z level=INFO msg="Uploading 1 narinfos"5954lb # [ 126.680768] niks3-server[1066]: 2026/09/20 07:58:16 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls5955lb # [ 126.692567] niks3-server[1066]: 2026/09/20 07:58:16 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5956lb # [ 126.696348] niks3-server[1066]: 2026/09/20 07:58:16 INFO Completed upload id=455957worker1 # [ 126.701731] nix-grpc-daemon[1491]: time=2026-09-20T07:58:16.640Z level=INFO msg="Upload complete. (245ms)"5958lb # [ 126.699576] niks3-server[1066]: 2026/09/20 07:58:16 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo5959worker1 # [ 126.704274] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=6 outputs=15960worker1 # [ 126.709056] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:16Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=15961worker1 # [ 126.712315] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351725962worker1 # [ 126.715321] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:16Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=05963worker1 # [ 126.721657] nix-daemon[907]: reaped child process 1693, status = succeeded5964worker1 # [ 126.723171] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:351725965worker1 # [ 126.728591] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:351725966worker1 # [ 126.732615] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5967worker1 # [ 126.879099] nix-daemon[907]: accepted connection from pid 1719, user nix-grpc-daemon (trusted)5968worker1 # [ 126.892544] nix-daemon[907]: reaped child process 1722, status = succeeded5969worker1 # [ 127.048308] nix-daemon[907]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)5970worker1 # [ 127.061476] nix-daemon[907]: reaped child process 1727, status = succeeded5971lb # [ 127.066680] niks3-server[1066]: 2026/09/20 07:58:17 INFO Received uploads request method=POST path=/api/pending_closures5972worker1 # [ 127.077346] nix-grpc-daemon[1491]: time=2026-09-20T07:58:17.015Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5973worker1 # [ 127.078931] nix-grpc-daemon[1491]: time=2026-09-20T07:58:17.015Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"5974lb # [ 127.086209] niks3-server[1066]: 2026/09/20 07:58:17 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst5975lb # [ 127.097551] niks3-server[1066]: 2026/09/20 07:58:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5976lb # [ 127.102063] niks3-server[1066]: 2026/09/20 07:58:17 INFO Signed narinfos id=46 count=15977worker1 # [ 127.109324] nix-grpc-daemon[1491]: time=2026-09-20T07:58:17.047Z level=INFO msg="Uploading 1 narinfos"5978lb # [ 127.112715] niks3-server[1066]: 2026/09/20 07:58:17 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls5979lb # [ 127.123250] niks3-server[1066]: 2026/09/20 07:58:17 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5980lb # [ 127.128562] niks3-server[1066]: 2026/09/20 07:58:17 INFO Completed upload id=465981worker1 # [ 127.134520] nix-grpc-daemon[1491]: time=2026-09-20T07:58:17.072Z level=INFO msg="Upload complete. (396ms)"5982lb # [ 127.130518] niks3-server[1066]: 2026/09/20 07:58:17 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo5983worker1 # [ 127.136609] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=0 paths=1 nar_bytes_in=5045984worker1 # [ 127.140029] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351725985worker1 # [ 127.147176] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5986worker1 # [ 127.149441] nix-daemon[907]: reaped child process 1717, status = succeeded5987worker1 # [ 127.154745] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)5988worker1 # [ 127.767413] nix-daemon[907]: reaped child process 1731, status = succeeded5989worker1 # [ 127.910204] nix-daemon[907]: accepted connection from pid 1746, user nix-grpc-daemon (trusted)5990worker1 # [ 127.923370] nix-daemon[907]: reaped child process 1749, status = succeeded5991lb # [ 127.930133] niks3-server[1066]: 2026/09/20 07:58:18 INFO Received uploads request method=POST path=/api/pending_closures5992worker1 # [ 127.944304] nix-grpc-daemon[1491]: time=2026-09-20T07:58:17.881Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5993worker1 # [ 127.945618] nix-grpc-daemon[1491]: time=2026-09-20T07:58:17.881Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"5994lb # [ 127.939866] envoy[916]: conn peer=[2001:db8:1::1]:43936 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9459 tx=3805 ms=67935995lb # [ 127.943944] envoy[916]: conn peer=[2001:db8:1::1]:35710 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2932 tx=1333 ms=128065996lb # [ 127.949629] envoy[916]: conn peer=[2001:db8:1::4]:40236 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9707 tx=2164 ms=520155997lb # [ 127.979400] niks3-server[1066]: 2026/09/20 07:58:18 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5998lb # [ 127.988856] niks3-server[1066]: 2026/09/20 07:58:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5999lb # [ 127.993383] niks3-server[1066]: 2026/09/20 07:58:18 INFO Signed narinfos id=47 count=16000worker1 # [ 128.000159] nix-grpc-daemon[1491]: time=2026-09-20T07:58:17.938Z level=INFO msg="Uploading 1 narinfos"6001lb # [ 128.002154] niks3-server[1066]: 2026/09/20 07:58:18 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6002lb # [ 128.006075] niks3-server[1066]: 2026/09/20 07:58:18 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6003lb # [ 128.009241] niks3-server[1066]: 2026/09/20 07:58:18 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6004lb # [ 128.012422] niks3-server[1066]: 2026/09/20 07:58:18 INFO Completed upload id=476005worker1 # [ 128.016797] nix-grpc-daemon[1491]: time=2026-09-20T07:58:17.955Z level=INFO msg="Upload complete. (256ms)"6006lb # [ 128.014569] niks3-server[1066]: 2026/09/20 07:58:18 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6007worker1 # [ 128.025458] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=0 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=7 outputs=16008worker1 # [ 128.032170] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:17Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16009worker1 # [ 128.034738] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351726010worker1 # [ 128.036502] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:17Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06011worker1 # [ 128.042278] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:351726012worker1 # [ 128.045802] nix-daemon[907]: reaped child process 1729, status = succeeded6013worker1 # [ 128.048961] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:351726014worker1 # [ 128.052610] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6015worker1 # [ 128.192716] nix-daemon[907]: accepted connection from pid 1755, user nix-grpc-daemon (trusted)6016worker1 # [ 128.206312] nix-daemon[907]: reaped child process 1758, status = succeeded6017worker1 # [ 128.381220] nix-daemon[907]: accepted connection from pid 1760, user nix-grpc-daemon (trusted)6018worker1 # [ 128.394892] nix-daemon[907]: reaped child process 1763, status = succeeded6019lb # [ 128.405161] niks3-server[1066]: 2026/09/20 07:58:18 INFO Received uploads request method=POST path=/api/pending_closures6020worker1 # [ 128.413229] nix-grpc-daemon[1491]: time=2026-09-20T07:58:18.351Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6021worker1 # [ 128.415096] nix-grpc-daemon[1491]: time=2026-09-20T07:58:18.353Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6022lb # [ 128.419155] niks3-server[1066]: 2026/09/20 07:58:18 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6023lb # [ 128.423620] niks3-server[1066]: 2026/09/20 07:58:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6024lb # [ 128.425427] niks3-server[1066]: 2026/09/20 07:58:18 INFO Signed narinfos id=48 count=16025worker1 # [ 128.431233] nix-grpc-daemon[1491]: time=2026-09-20T07:58:18.369Z level=INFO msg="Uploading 1 narinfos"6026lb # [ 128.429026] niks3-server[1066]: 2026/09/20 07:58:18 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6027lb # [ 128.433058] niks3-server[1066]: 2026/09/20 07:58:18 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6028lb # [ 128.436435] niks3-server[1066]: 2026/09/20 07:58:18 INFO Completed upload id=486029worker1 # [ 128.440586] nix-grpc-daemon[1491]: time=2026-09-20T07:58:18.379Z level=INFO msg="Upload complete. (382ms)"6030lb # [ 128.439072] niks3-server[1066]: 2026/09/20 07:58:18 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6031worker1 # [ 128.442631] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=0 paths=1 nar_bytes_in=5046032worker1 # [ 128.445725] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351726033worker1 # [ 128.451957] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6034worker1 # [ 128.457509] nix-daemon[907]: reaped child process 1753, status = succeeded6035worker1 # [ 128.460490] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6036worker1 # [ 129.073930] nix-daemon[907]: reaped child process 1767, status = succeeded6037worker1 # [ 129.212318] nix-daemon[907]: accepted connection from pid 1782, user nix-grpc-daemon (trusted)6038worker1 # [ 129.223388] nix-daemon[907]: reaped child process 1785, status = succeeded6039lb # [ 129.234606] niks3-server[1066]: 2026/09/20 07:58:19 INFO Received uploads request method=POST path=/api/pending_closures6040worker1 # [ 129.248370] nix-grpc-daemon[1491]: time=2026-09-20T07:58:19.186Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6041worker1 # [ 129.249911] nix-grpc-daemon[1491]: time=2026-09-20T07:58:19.188Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6042lb # [ 129.272726] niks3-server[1066]: 2026/09/20 07:58:19 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6043lb # [ 129.281961] niks3-server[1066]: 2026/09/20 07:58:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6044worker1 # [ 129.291050] nix-grpc-daemon[1491]: time=2026-09-20T07:58:19.229Z level=INFO msg="Uploading 1 narinfos"6045lb # [ 129.287357] niks3-server[1066]: 2026/09/20 07:58:19 INFO Signed narinfos id=49 count=16046lb # [ 129.296274] niks3-server[1066]: 2026/09/20 07:58:19 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6047lb # [ 129.301915] niks3-server[1066]: 2026/09/20 07:58:19 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6048lb # [ 129.312727] niks3-server[1066]: 2026/09/20 07:58:19 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6049lb # [ 129.318960] niks3-server[1066]: 2026/09/20 07:58:19 INFO Completed upload id=496050worker1 # [ 129.322993] nix-grpc-daemon[1491]: time=2026-09-20T07:58:19.261Z level=INFO msg="Upload complete. (257ms)"6051lb # [ 129.321087] niks3-server[1066]: 2026/09/20 07:58:19 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6052worker1 # [ 129.327112] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=0 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=8 outputs=16053worker1 # [ 129.330759] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:19Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16054worker1 # [ 129.335084] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:19Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06055worker1 # [ 129.339487] nix-daemon[907]: reaped child process 1765, status = succeeded6056worker1 # [ 129.373696] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351726057worker1 # [ 129.379314] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:351726058worker1 # [ 129.388839] nix-grpc-daemon[1491]: time=2026-09-20T07:58:19.327Z level=INFO msg="All 1 paths already cached"6059worker1 # [ 129.392387] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:351726060worker1 # [ 129.397660] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6061worker1 # [ 129.553191] nix-daemon[907]: accepted connection from pid 1791, user nix-grpc-daemon (trusted)6062worker1 # [ 129.566845] nix-daemon[907]: reaped child process 1794, status = succeeded6063worker1 # [ 129.729365] nix-daemon[907]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)6064worker1 # [ 129.741609] nix-daemon[907]: reaped child process 1799, status = succeeded6065lb # [ 129.747089] niks3-server[1066]: 2026/09/20 07:58:19 INFO Received uploads request method=POST path=/api/pending_closures6066worker1 # [ 129.755261] nix-grpc-daemon[1491]: time=2026-09-20T07:58:19.693Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6067worker1 # [ 129.756851] nix-grpc-daemon[1491]: time=2026-09-20T07:58:19.695Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6068lb # [ 129.764778] niks3-server[1066]: 2026/09/20 07:58:19 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6069lb # [ 129.768558] niks3-server[1066]: 2026/09/20 07:58:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6070worker1 # [ 129.775193] nix-grpc-daemon[1491]: time=2026-09-20T07:58:19.713Z level=INFO msg="Uploading 1 narinfos"6071lb # [ 129.771322] niks3-server[1066]: 2026/09/20 07:58:19 INFO Signed narinfos id=50 count=16072lb # [ 129.773469] niks3-server[1066]: 2026/09/20 07:58:19 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6073lb # [ 129.779167] niks3-server[1066]: 2026/09/20 07:58:19 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6074lb # [ 129.782057] niks3-server[1066]: 2026/09/20 07:58:19 INFO Completed upload id=506075worker1 # [ 129.786232] nix-grpc-daemon[1491]: time=2026-09-20T07:58:19.724Z level=INFO msg="Upload complete. (383ms)"6076worker1 # [ 129.788138] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=0 paths=1 nar_bytes_in=6246077lb # [ 129.784966] niks3-server[1066]: 2026/09/20 07:58:19 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6078worker1 # [ 129.791491] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351726079worker1 # [ 129.797818] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6080worker1 # [ 129.800108] nix-daemon[907]: reaped child process 1789, status = succeeded6081worker1 # [ 129.804960] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6082worker1 # [ 130.819537] nix-daemon[907]: reaped child process 1803, status = succeeded6083worker1 # [ 130.943234] nix-daemon[907]: accepted connection from pid 1818, user nix-grpc-daemon (trusted)6084worker1 # [ 130.956951] nix-daemon[907]: reaped child process 1821, status = succeeded6085lb # [ 130.963502] niks3-server[1066]: 2026/09/20 07:58:21 INFO Received uploads request method=POST path=/api/pending_closures6086worker1 # [ 130.972061] nix-grpc-daemon[1491]: time=2026-09-20T07:58:20.910Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6087worker1 # [ 130.975061] nix-grpc-daemon[1491]: time=2026-09-20T07:58:20.912Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6088lb # [ 130.987895] niks3-server[1066]: 2026/09/20 07:58:21 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6089lb # [ 130.990222] niks3-server[1066]: 2026/09/20 07:58:21 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6090lb # [ 130.994375] niks3-server[1066]: 2026/09/20 07:58:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6091lb # [ 130.996336] niks3-server[1066]: 2026/09/20 07:58:21 INFO Signed narinfos id=51 count=16092worker1 # [ 131.000720] nix-grpc-daemon[1491]: time=2026-09-20T07:58:20.939Z level=INFO msg="Uploading 1 narinfos"6093lb # [ 131.001821] niks3-server[1066]: 2026/09/20 07:58:21 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6094lb # [ 131.005165] niks3-server[1066]: 2026/09/20 07:58:21 INFO Completed upload id=516095worker1 # [ 131.009358] nix-grpc-daemon[1491]: time=2026-09-20T07:58:20.947Z level=INFO msg="Upload complete. (198ms)"6096lb # [ 131.007428] niks3-server[1066]: 2026/09/20 07:58:21 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6097worker1 # [ 131.012476] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=9 outputs=16098worker1 # [ 131.017185] nix-grpc-daemon[1491]: time=2026-09-20T07:58:20.950Z level=WARN msg="Failed to register uploaded object" key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo error="server returned 404: object is not pending upload\n"6099worker1 # [ 131.019916] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:20Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16100worker1 # [ 131.026719] nix-daemon[907]: reaped child process 1801, status = succeeded6101worker1 # [ 131.057960] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351726102worker1 # [ 131.060992] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:20Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06103worker1 # [ 131.068561] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:351726104worker1 # [ 131.080256] nix-grpc-daemon[1491]: time=2026-09-20T07:58:21.018Z level=INFO msg="All 1 paths already cached"6105worker1 # [ 131.084826] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:351726106worker1 # [ 131.090587] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6107worker1 # [ 131.252461] nix-daemon[907]: accepted connection from pid 1827, user nix-grpc-daemon (trusted)6108worker1 # [ 131.265792] nix-daemon[907]: reaped child process 1830, status = succeeded6109worker1 # [ 131.427624] nix-daemon[907]: accepted connection from pid 1832, user nix-grpc-daemon (trusted)6110worker1 # [ 131.440466] nix-daemon[907]: reaped child process 1835, status = succeeded6111lb # [ 131.445055] niks3-server[1066]: 2026/09/20 07:58:21 INFO Received uploads request method=POST path=/api/pending_closures6112worker1 # [ 131.453273] nix-grpc-daemon[1491]: time=2026-09-20T07:58:21.391Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6113worker1 # [ 131.455197] nix-grpc-daemon[1491]: time=2026-09-20T07:58:21.393Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6114lb # [ 131.458211] niks3-server[1066]: 2026/09/20 07:58:21 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6115lb # [ 131.462723] niks3-server[1066]: 2026/09/20 07:58:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6116lb # [ 131.464525] niks3-server[1066]: 2026/09/20 07:58:21 INFO Signed narinfos id=52 count=16117worker1 # [ 131.469129] nix-grpc-daemon[1491]: time=2026-09-20T07:58:21.407Z level=INFO msg="Uploading 1 narinfos"6118lb # [ 131.469158] niks3-server[1066]: 2026/09/20 07:58:21 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6119lb # [ 131.473362] niks3-server[1066]: 2026/09/20 07:58:21 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6120lb # [ 131.476222] niks3-server[1066]: 2026/09/20 07:58:21 INFO Completed upload id=526121worker1 # [ 131.480273] nix-grpc-daemon[1491]: time=2026-09-20T07:58:21.418Z level=INFO msg="Upload complete. (384ms)"6122worker1 # [ 131.482222] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=0 paths=1 nar_bytes_in=6246123lb # [ 131.478748] niks3-server[1066]: 2026/09/20 07:58:21 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6124worker1 # [ 131.485076] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351726125worker1 # [ 131.489946] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6126worker1 # [ 131.494287] nix-daemon[907]: reaped child process 1825, status = succeeded6127worker1 # [ 131.499116] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6128worker1 # [ 132.513240] nix-daemon[907]: reaped child process 1839, status = succeeded6129worker1 # [ 132.641152] nix-daemon[907]: accepted connection from pid 1854, user nix-grpc-daemon (trusted)6130worker1 # [ 132.654692] nix-daemon[907]: reaped child process 1857, status = succeeded6131lb # [ 132.663767] niks3-server[1066]: 2026/09/20 07:58:22 INFO Received uploads request method=POST path=/api/pending_closures6132worker1 # [ 132.676266] nix-grpc-daemon[1491]: time=2026-09-20T07:58:22.613Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6133worker1 # [ 132.677679] nix-grpc-daemon[1491]: time=2026-09-20T07:58:22.613Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6134lb # [ 132.682032] niks3-server[1066]: 2026/09/20 07:58:22 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6135lb # [ 132.686153] niks3-server[1066]: 2026/09/20 07:58:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6136lb # [ 132.688109] niks3-server[1066]: 2026/09/20 07:58:22 INFO Signed narinfos id=53 count=16137worker1 # [ 132.694125] nix-grpc-daemon[1491]: time=2026-09-20T07:58:22.632Z level=INFO msg="Uploading 1 narinfos"6138lb # [ 132.690893] niks3-server[1066]: 2026/09/20 07:58:22 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6139lb # [ 132.697331] niks3-server[1066]: 2026/09/20 07:58:22 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6140lb # [ 132.701367] niks3-server[1066]: 2026/09/20 07:58:22 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6141lb # [ 132.703651] niks3-server[1066]: 2026/09/20 07:58:22 INFO Completed upload id=536142worker1 # [ 132.709026] nix-grpc-daemon[1491]: time=2026-09-20T07:58:22.647Z level=INFO msg="Upload complete. (203ms)"6143lb # [ 132.705138] niks3-server[1066]: 2026/09/20 07:58:22 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6144worker1 # [ 132.713297] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=10 outputs=16145worker1 # [ 132.717053] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:22Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16146worker1 # [ 132.719163] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351726147worker1 # [ 132.720742] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:22Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06148worker1 # [ 132.727325] nix-daemon[907]: reaped child process 1837, status = succeeded6149worker1 # [ 132.728676] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:351726150worker1 # [ 132.734658] nix-grpc-daemon[1491]: time=2026-09-20T07:58:22.673Z level=INFO msg="All 1 paths already cached"6151worker1 # [ 132.739048] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:351726152worker1 # [ 132.743913] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6153worker1 # [ 132.873403] nix-daemon[907]: accepted connection from pid 1863, user nix-grpc-daemon (trusted)6154worker1 # [ 132.886568] nix-daemon[907]: reaped child process 1866, status = succeeded6155worker1 # [ 133.002082] nix-daemon[907]: accepted connection from pid 1868, user nix-grpc-daemon (trusted)6156worker1 # [ 133.014464] nix-daemon[907]: reaped child process 1871, status = succeeded6157lb # [ 133.019269] niks3-server[1066]: 2026/09/20 07:58:23 INFO Received uploads request method=POST path=/api/pending_closures6158worker1 # [ 133.031895] nix-grpc-daemon[1491]: time=2026-09-20T07:58:22.970Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6159worker1 # [ 133.033290] nix-grpc-daemon[1491]: time=2026-09-20T07:58:22.970Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6160lb # [ 133.044154] niks3-server[1066]: 2026/09/20 07:58:23 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6161lb # [ 133.056786] niks3-server[1066]: 2026/09/20 07:58:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6162worker1 # [ 133.067774] nix-grpc-daemon[1491]: time=2026-09-20T07:58:23.006Z level=INFO msg="Uploading 1 narinfos"6163lb # [ 133.063439] niks3-server[1066]: 2026/09/20 07:58:23 INFO Signed narinfos id=54 count=16164lb # [ 133.068210] niks3-server[1066]: 2026/09/20 07:58:23 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6165lb # [ 133.078114] niks3-server[1066]: 2026/09/20 07:58:23 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6166worker1 # [ 133.088396] nix-grpc-daemon[1491]: time=2026-09-20T07:58:23.026Z level=INFO msg="Upload complete. (339ms)"6167lb # [ 133.084295] niks3-server[1066]: 2026/09/20 07:58:23 INFO Completed upload id=546168worker1 # [ 133.090399] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=0 paths=1 nar_bytes_in=6246169lb # [ 133.089335] niks3-server[1066]: 2026/09/20 07:58:23 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6170worker1 # [ 133.097367] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351726171worker1 # [ 133.102770] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6172worker1 # [ 133.104996] nix-daemon[907]: reaped child process 1861, status = succeeded6173worker1 # [ 133.110220] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6174worker1 # [ 134.525836] nix-daemon[907]: reaped child process 1875, status = succeeded6175worker1 # [ 134.633367] nix-daemon[907]: accepted connection from pid 1890, user nix-grpc-daemon (trusted)6176worker1 # [ 134.646550] nix-daemon[907]: reaped child process 1893, status = succeeded6177lb # [ 134.652163] niks3-server[1066]: 2026/09/20 07:58:24 INFO Received uploads request method=POST path=/api/pending_closures6178worker1 # [ 134.663081] nix-grpc-daemon[1491]: time=2026-09-20T07:58:24.601Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6179worker1 # [ 134.664666] nix-grpc-daemon[1491]: time=2026-09-20T07:58:24.603Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6180lb # [ 134.674053] niks3-server[1066]: 2026/09/20 07:58:24 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6181lb # [ 134.676566] niks3-server[1066]: 2026/09/20 07:58:24 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6182lb # [ 134.680815] niks3-server[1066]: 2026/09/20 07:58:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6183lb # [ 134.682516] niks3-server[1066]: 2026/09/20 07:58:24 INFO Signed narinfos id=55 count=16184worker1 # [ 134.687948] nix-grpc-daemon[1491]: time=2026-09-20T07:58:24.626Z level=INFO msg="Uploading 1 narinfos"6185lb # [ 134.686644] niks3-server[1066]: 2026/09/20 07:58:24 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6186lb # [ 134.690851] niks3-server[1066]: 2026/09/20 07:58:24 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6187lb # [ 134.708755] niks3-server[1066]: 2026/09/20 07:58:24 INFO Completed upload id=556188worker1 # [ 134.713108] nix-grpc-daemon[1491]: time=2026-09-20T07:58:24.651Z level=INFO msg="Upload complete. (195ms)"6189lb # [ 134.710578] niks3-server[1066]: 2026/09/20 07:58:24 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6190worker1 # [ 134.715569] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=11 outputs=16191worker1 # [ 134.720834] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:24Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16192worker1 # [ 134.723284] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351726193worker1 # [ 134.725972] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:24Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06194worker1 # [ 134.732287] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:351726195worker1 # [ 134.734770] nix-daemon[907]: reaped child process 1873, status = succeeded6196worker1 # [ 134.738575] nix-grpc-daemon[1491]: time=2026-09-20T07:58:24.677Z level=INFO msg="All 2 paths already cached"6197worker1 # [ 134.741643] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:351726198worker1 # [ 134.745141] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6199worker1 # [ 134.862926] nix-daemon[907]: accepted connection from pid 1899, user nix-grpc-daemon (trusted)6200worker1 # [ 134.875495] nix-daemon[907]: reaped child process 1902, status = succeeded6201worker1 # [ 135.003053] nix-daemon[907]: accepted connection from pid 1904, user nix-grpc-daemon (trusted)6202worker1 # [ 135.015573] nix-daemon[907]: reaped child process 1907, status = succeeded6203lb # [ 135.019909] niks3-server[1066]: 2026/09/20 07:58:25 INFO Received uploads request method=POST path=/api/pending_closures6204worker1 # [ 135.028123] nix-grpc-daemon[1491]: time=2026-09-20T07:58:24.966Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6205worker1 # [ 135.029578] nix-grpc-daemon[1491]: time=2026-09-20T07:58:24.968Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6206lb # [ 135.043359] niks3-server[1066]: 2026/09/20 07:58:25 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6207lb # [ 135.053770] niks3-server[1066]: 2026/09/20 07:58:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6208worker1 # [ 135.062422] nix-grpc-daemon[1491]: time=2026-09-20T07:58:25.000Z level=INFO msg="Uploading 1 narinfos"6209lb # [ 135.058653] niks3-server[1066]: 2026/09/20 07:58:25 INFO Signed narinfos id=56 count=16210lb # [ 135.065196] niks3-server[1066]: 2026/09/20 07:58:25 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6211lb # [ 135.076880] niks3-server[1066]: 2026/09/20 07:58:25 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6212lb # [ 135.081765] niks3-server[1066]: 2026/09/20 07:58:25 INFO Completed upload id=566213worker1 # [ 135.087954] nix-grpc-daemon[1491]: time=2026-09-20T07:58:25.026Z level=INFO msg="Upload complete. (337ms)"6214lb # [ 135.084798] niks3-server[1066]: 2026/09/20 07:58:25 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6215worker1 # [ 135.090208] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=0 paths=1 nar_bytes_in=7526216worker1 # [ 135.094747] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351726217worker1 # [ 135.101377] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6218worker1 # [ 135.104077] nix-daemon[907]: reaped child process 1897, status = succeeded6219worker1 # [ 135.107838] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6220worker1 # [ 136.725139] nix-daemon[907]: reaped child process 1911, status = succeeded6221worker1 # [ 136.839562] nix-daemon[907]: accepted connection from pid 1926, user nix-grpc-daemon (trusted)6222worker1 # [ 136.851913] nix-daemon[907]: reaped child process 1929, status = succeeded6223lb # [ 136.862862] niks3-server[1066]: 2026/09/20 07:58:27 INFO Received uploads request method=POST path=/api/pending_closures6224worker1 # [ 136.875939] nix-grpc-daemon[1491]: time=2026-09-20T07:58:26.814Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6225worker1 # [ 136.877475] nix-grpc-daemon[1491]: time=2026-09-20T07:58:26.815Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6226lb # [ 136.886641] niks3-server[1066]: 2026/09/20 07:58:27 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6227lb # [ 136.889551] niks3-server[1066]: 2026/09/20 07:58:27 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6228lb # [ 136.895955] niks3-server[1066]: 2026/09/20 07:58:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6229lb # [ 136.899266] niks3-server[1066]: 2026/09/20 07:58:27 INFO Signed narinfos id=57 count=16230worker1 # [ 136.903193] nix-grpc-daemon[1491]: time=2026-09-20T07:58:26.841Z level=INFO msg="Uploading 1 narinfos"6231lb # [ 136.902023] niks3-server[1066]: 2026/09/20 07:58:27 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6232lb # [ 136.906248] niks3-server[1066]: 2026/09/20 07:58:27 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6233lb # [ 136.909828] niks3-server[1066]: 2026/09/20 07:58:27 INFO Completed upload id=576234worker1 # [ 136.913866] nix-grpc-daemon[1491]: time=2026-09-20T07:58:26.852Z level=INFO msg="Upload complete. (198ms)"6235lb # [ 136.911393] niks3-server[1066]: 2026/09/20 07:58:27 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6236worker1 # [ 136.916248] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=12 outputs=16237worker1 # [ 136.920147] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:26Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16238worker1 # [ 136.922395] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351726239worker1 # [ 136.929289] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:351726240worker1 # [ 136.931539] nix-daemon[907]: reaped child process 1909, status = succeeded6241worker1 # [ 136.934829] nix-grpc-daemon[1491]: time=2026-09-20T07:58:26.873Z level=INFO msg="All 2 paths already cached"6242worker1 # [ 136.938192] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:351726243worker1 # [ 136.941752] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6244worker1 # [ 137.077370] nix-daemon[907]: accepted connection from pid 1933, user nix-grpc-daemon (trusted)6245worker1 # [ 137.089750] nix-daemon[907]: reaped child process 1936, status = succeeded6246worker1 # [ 137.254605] nix-daemon[907]: accepted connection from pid 1938, user nix-grpc-daemon (trusted)6247worker1 # [ 137.268111] nix-daemon[907]: reaped child process 1941, status = succeeded6248lb # [ 137.277610] niks3-server[1066]: 2026/09/20 07:58:27 INFO Received uploads request method=POST path=/api/pending_closures6249worker1 # [ 137.289392] nix-grpc-daemon[1491]: time=2026-09-20T07:58:27.227Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6250worker1 # [ 137.290963] nix-grpc-daemon[1491]: time=2026-09-20T07:58:27.229Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6251lb # [ 137.303886] niks3-server[1066]: 2026/09/20 07:58:27 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6252lb # [ 137.314671] niks3-server[1066]: 2026/09/20 07:58:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6253lb # [ 137.318984] niks3-server[1066]: 2026/09/20 07:58:27 INFO Signed narinfos id=58 count=16254worker1 # [ 137.326078] nix-grpc-daemon[1491]: time=2026-09-20T07:58:27.264Z level=INFO msg="Uploading 1 narinfos"6255lb # [ 137.328337] niks3-server[1066]: 2026/09/20 07:58:27 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6256lb # [ 137.338124] niks3-server[1066]: 2026/09/20 07:58:27 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6257lb # [ 137.344229] niks3-server[1066]: 2026/09/20 07:58:27 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6258lb # [ 137.348032] niks3-server[1066]: 2026/09/20 07:58:27 INFO Completed upload id=586259worker1 # [ 137.352452] nix-grpc-daemon[1491]: time=2026-09-20T07:58:27.290Z level=INFO msg="Upload complete. (404ms)"6260worker1 # [ 137.356413] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=0 paths=1 nar_bytes_in=7526261worker1 # [ 137.361174] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351726262worker1 # [ 137.365638] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6263worker1 # [ 137.370656] nix-daemon[907]: reaped child process 1931, status = succeeded6264worker1 # [ 137.376040] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6265worker1 # [ 138.391267] nix-daemon[907]: reaped child process 1945, status = succeeded6266worker1 # [ 138.530692] nix-daemon[907]: accepted connection from pid 1960, user nix-grpc-daemon (trusted)6267worker1 # [ 138.543058] nix-daemon[907]: reaped child process 1963, status = succeeded6268lb # [ 138.554237] niks3-server[1066]: 2026/09/20 07:58:28 INFO Received uploads request method=POST path=/api/pending_closures6269worker1 # [ 138.566938] nix-grpc-daemon[1491]: time=2026-09-20T07:58:28.505Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6270worker1 # [ 138.568985] nix-grpc-daemon[1491]: time=2026-09-20T07:58:28.506Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6271lb # [ 138.599238] niks3-server[1066]: 2026/09/20 07:58:28 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6272lb # [ 138.603134] niks3-server[1066]: 2026/09/20 07:58:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6273lb # [ 138.607736] niks3-server[1066]: 2026/09/20 07:58:28 INFO Signed narinfos id=59 count=16274worker1 # [ 138.615379] nix-grpc-daemon[1491]: time=2026-09-20T07:58:28.553Z level=INFO msg="Uploading 1 narinfos"6275lb # [ 138.617149] niks3-server[1066]: 2026/09/20 07:58:28 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6276lb # [ 138.626465] niks3-server[1066]: 2026/09/20 07:58:28 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6277lb # [ 138.632149] niks3-server[1066]: 2026/09/20 07:58:28 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6278lb # [ 138.637522] niks3-server[1066]: 2026/09/20 07:58:28 INFO Completed upload id=596279worker1 # [ 138.641864] nix-grpc-daemon[1491]: time=2026-09-20T07:58:28.580Z level=INFO msg="Upload complete. (258ms)"6280lb # [ 138.641965] niks3-server[1066]: 2026/09/20 07:58:28 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6281worker1 # [ 138.647478] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=13 outputs=16282worker1 # [ 138.654404] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:28Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16283worker1 # [ 138.657869] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351726284worker1 # [ 138.665708] nix-daemon[907]: reaped child process 1943, status = succeeded6285worker1 # [ 138.667165] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:351726286worker1 # [ 138.672661] nix-grpc-daemon[1491]: time=2026-09-20T07:58:28.611Z level=INFO msg="All 2 paths already cached"6287worker1 # [ 138.677161] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:351726288worker1 # [ 138.682094] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6289worker1 # [ 138.823354] nix-daemon[907]: accepted connection from pid 1967, user nix-grpc-daemon (trusted)6290worker1 # [ 138.835875] nix-daemon[907]: reaped child process 1970, status = succeeded6291worker1 # [ 138.970991] nix-daemon[907]: accepted connection from pid 1972, user nix-grpc-daemon (trusted)6292worker1 # [ 138.983072] nix-daemon[907]: reaped child process 1975, status = succeeded6293lb # [ 138.989735] niks3-server[1066]: 2026/09/20 07:58:29 INFO Received uploads request method=POST path=/api/pending_closures6294worker1 # [ 139.004344] nix-grpc-daemon[1491]: time=2026-09-20T07:58:28.942Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6295worker1 # [ 139.005741] nix-grpc-daemon[1491]: time=2026-09-20T07:58:28.942Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6296lb # [ 139.010109] niks3-server[1066]: 2026/09/20 07:58:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6297lb # [ 139.013916] niks3-server[1066]: 2026/09/20 07:58:29 INFO Signed narinfos id=60 count=16298worker1 # [ 139.021254] nix-grpc-daemon[1491]: time=2026-09-20T07:58:28.959Z level=INFO msg="Uploading 1 narinfos"6299lb # [ 139.019136] niks3-server[1066]: 2026/09/20 07:58:29 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6300lb # [ 139.030124] niks3-server[1066]: 2026/09/20 07:58:29 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6301lb # [ 139.037826] niks3-server[1066]: 2026/09/20 07:58:29 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6302lb # [ 139.041055] niks3-server[1066]: 2026/09/20 07:58:29 INFO Completed upload id=606303worker1 # [ 139.046603] nix-grpc-daemon[1491]: time=2026-09-20T07:58:28.985Z level=INFO msg="Upload complete. (359ms)"6304lb # [ 139.043127] niks3-server[1066]: 2026/09/20 07:58:29 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6305worker1 # [ 139.048549] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=0 paths=1 nar_bytes_in=7526306worker1 # [ 139.051676] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351726307worker1 # [ 139.058255] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6308worker1 # [ 139.061169] nix-daemon[907]: reaped child process 1965, status = succeeded6309worker1 # [ 139.066660] nix-daemon[907]: accepted connection from pid 1424, user nix-grpc-daemon (trusted)6310worker1 # [ 139.893295] nix-daemon[907]: reaped child process 1979, status = succeeded6311worker1 # [ 140.016845] nix-daemon[907]: accepted connection from pid 1994, user nix-grpc-daemon (trusted)6312worker1 # [ 140.028098] nix-daemon[907]: reaped child process 1997, status = succeeded6313lb # [ 140.037212] niks3-server[1066]: 2026/09/20 07:58:30 INFO Received uploads request method=POST path=/api/pending_closures6314worker1 # [ 140.046475] nix-grpc-daemon[1491]: time=2026-09-20T07:58:29.984Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6315worker1 # [ 140.047968] nix-grpc-daemon[1491]: time=2026-09-20T07:58:29.986Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6316lb # [ 140.059884] niks3-server[1066]: 2026/09/20 07:58:30 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6317lb # [ 140.062289] niks3-server[1066]: 2026/09/20 07:58:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6318lb # [ 140.064591] niks3-server[1066]: 2026/09/20 07:58:30 INFO Signed narinfos id=61 count=16319worker1 # [ 140.068525] nix-grpc-daemon[1491]: time=2026-09-20T07:58:30.006Z level=INFO msg="Uploading 1 narinfos"6320lb # [ 140.065571] niks3-server[1066]: 2026/09/20 07:58:30 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6321lb # [ 140.071128] niks3-server[1066]: 2026/09/20 07:58:30 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6322lb # [ 140.074242] niks3-server[1066]: 2026/09/20 07:58:30 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6323lb # [ 140.077280] niks3-server[1066]: 2026/09/20 07:58:30 INFO Completed upload id=616324worker1 # [ 140.082571] nix-grpc-daemon[1491]: time=2026-09-20T07:58:30.021Z level=INFO msg="Upload complete. (209ms)"6325lb # [ 140.079592] niks3-server[1066]: 2026/09/20 07:58:30 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6326worker1 # [ 140.084909] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35172 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=14 outputs=16327worker1 # [ 140.092039] nix-daemon[907]: reaped child process 1977, status = succeeded6328client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 15.46 seconds)6329worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6330worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.04 seconds)6331client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16332worker2 # [ 140.388803] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:382086333worker2 # [ 140.401470] nix-daemon[873]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)6334worker1 # [ 140.427590] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:30Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06335client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.28 seconds)6336(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 15.79 seconds)6337subtest: low disk drains a worker and builds go to the other6338worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6339worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.04 seconds)6340worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6341worker1 # [ 142.135393] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:32Z level=info event=unhealthy reason=min_free6342worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.09 seconds)6343client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&26344worker2 # [ 142.769912] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:382086345client # don't know how to build these paths:6346client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6347worker1 # [ 142.790386] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:32Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06348worker1 # [ 142.792388] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:32Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16349worker2 # [ 142.829452] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:382086350worker2 # [ 142.841450] nix-grpc-daemon[1652]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5)6351worker2 # [ 142.883291] nix-grpc-daemon[1652]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 180 ms (attempt 2/5)6352worker2 # [ 143.069366] nix-grpc-daemon[1652]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 285 ms (attempt 3/5)6353worker2 # [ 143.354679] nix-grpc-daemon[1652]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 713 ms (attempt 4/5)6354worker2 # [ 144.071937] nix-grpc-daemon[1652]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6355worker2 # [ 144.089732] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:382086356client # copying 1 paths to 'lb:50051'...6357client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6358worker2 # [ 144.101898] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:382086359worker2 # [ 144.114478] nix-daemon[873]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)6360worker2 # [ 144.132815] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:33Z level=info event=niks3_push_started pid=16786361worker2 # [ 144.454269] nix-daemon[873]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)6362worker2 # [ 144.467760] nix-daemon[873]: reaped child process 1694, status = succeeded6363worker2 # [ 144.606246] nix-daemon[873]: accepted connection from pid 1696, user nix-grpc-daemon (trusted)6364worker2 # [ 144.619595] nix-daemon[873]: reaped child process 1699, status = succeeded6365lb # [ 144.631114] niks3-server[1066]: 2026/09/20 07:58:34 INFO Received uploads request method=POST path=/api/pending_closures6366worker2 # [ 144.634094] nix-grpc-daemon[1678]: time=2026-09-20T07:58:34.422Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6367worker2 # [ 144.637524] nix-grpc-daemon[1678]: time=2026-09-20T07:58:34.424Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6368lb # [ 144.652745] niks3-server[1066]: 2026/09/20 07:58:34 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6369lb # [ 144.657110] niks3-server[1066]: 2026/09/20 07:58:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6370lb # [ 144.659145] niks3-server[1066]: 2026/09/20 07:58:34 INFO Signed narinfos id=62 count=16371worker2 # [ 144.659600] nix-grpc-daemon[1678]: time=2026-09-20T07:58:34.447Z level=INFO msg="Uploading 1 narinfos"6372lb # [ 144.664244] niks3-server[1066]: 2026/09/20 07:58:34 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6373lb # [ 144.668864] niks3-server[1066]: 2026/09/20 07:58:34 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6374lb # [ 144.671795] niks3-server[1066]: 2026/09/20 07:58:34 INFO Completed upload id=626375worker2 # [ 144.670588] nix-grpc-daemon[1678]: time=2026-09-20T07:58:34.458Z level=INFO msg="Upload complete. (348ms)"6376lb # [ 144.674637] niks3-server[1066]: 2026/09/20 07:58:34 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6377worker2 # [ 144.672881] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38208 duration_s=0 paths=1 nar_bytes_in=5126378worker2 # [ 144.675702] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:382086379worker2 # [ 144.681133] nix-daemon[873]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)6380worker2 # [ 144.686111] nix-daemon[873]: reaped child process 1676, status = succeeded6381worker2 # [ 144.691058] nix-daemon[873]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)6382client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6383client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6384client # farm-a> LOG-farm-a-drain6385worker2 # [ 145.507360] nix-daemon[873]: reaped child process 1703, status = succeeded6386worker2 # [ 145.624808] nix-daemon[873]: accepted connection from pid 1718, user nix-grpc-daemon (trusted)6387worker2 # [ 145.636355] nix-daemon[873]: reaped child process 1721, status = succeeded6388lb # [ 145.651042] niks3-server[1066]: 2026/09/20 07:58:35 INFO Received uploads request method=POST path=/api/pending_closures6389worker2 # [ 145.654415] nix-grpc-daemon[1678]: time=2026-09-20T07:58:35.442Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6390worker2 # [ 145.656093] nix-grpc-daemon[1678]: time=2026-09-20T07:58:35.444Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6391lb # [ 145.670549] niks3-server[1066]: 2026/09/20 07:58:35 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6392lb # [ 145.676448] niks3-server[1066]: 2026/09/20 07:58:35 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6393lb # [ 145.686314] niks3-server[1066]: 2026/09/20 07:58:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6394lb # [ 145.689391] niks3-server[1066]: 2026/09/20 07:58:35 INFO Signed narinfos id=63 count=16395worker2 # [ 145.689311] nix-grpc-daemon[1678]: time=2026-09-20T07:58:35.477Z level=INFO msg="Uploading 1 narinfos"6396lb # [ 145.691214] niks3-server[1066]: 2026/09/20 07:58:35 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6397lb # [ 145.696537] niks3-server[1066]: 2026/09/20 07:58:35 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6398lb # [ 145.700070] niks3-server[1066]: 2026/09/20 07:58:35 INFO Completed upload id=636399worker2 # [ 145.698644] nix-grpc-daemon[1678]: time=2026-09-20T07:58:35.487Z level=INFO msg="Upload complete. (200ms)"6400lb # [ 145.701892] niks3-server[1066]: 2026/09/20 07:58:35 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6401worker2 # [ 145.701190] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38208 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=15 outputs=16402worker2 # [ 145.708313] nix-daemon[873]: reaped child process 1701, status = succeeded6403worker1 # [ 145.716472] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:35Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06404worker1 # [ 145.720542] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:35Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16405worker2 # [ 145.753614] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:382086406worker2 # [ 145.760366] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:382086407worker2 # [ 145.768658] nix-grpc-daemon[1678]: time=2026-09-20T07:58:35.557Z level=INFO msg="All 1 paths already cached"6408client # copying 1 paths to 'lb:50051'...6409client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6410worker2 # [ 145.772900] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:382086411worker2 # [ 145.777335] nix-daemon[873]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)6412worker2 # [ 145.942598] nix-daemon[873]: accepted connection from pid 1725, user nix-grpc-daemon (trusted)6413worker2 # [ 145.956844] nix-daemon[873]: reaped child process 1728, status = succeeded6414worker2 # [ 146.106115] nix-daemon[873]: accepted connection from pid 1730, user nix-grpc-daemon (trusted)6415worker2 # [ 146.120598] nix-daemon[873]: reaped child process 1733, status = succeeded6416lb # [ 146.132440] niks3-server[1066]: 2026/09/20 07:58:36 INFO Received uploads request method=POST path=/api/pending_closures6417worker2 # [ 146.135652] nix-grpc-daemon[1678]: time=2026-09-20T07:58:35.923Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6418worker2 # [ 146.137224] nix-grpc-daemon[1678]: time=2026-09-20T07:58:35.923Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6419lb # [ 146.144563] niks3-server[1066]: 2026/09/20 07:58:36 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6420lb # [ 146.148846] niks3-server[1066]: 2026/09/20 07:58:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6421lb # [ 146.151282] niks3-server[1066]: 2026/09/20 07:58:36 INFO Signed narinfos id=64 count=16422worker2 # [ 146.150267] nix-grpc-daemon[1678]: time=2026-09-20T07:58:35.938Z level=INFO msg="Uploading 1 narinfos"6423lb # [ 146.155794] niks3-server[1066]: 2026/09/20 07:58:36 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6424lb # [ 146.162255] niks3-server[1066]: 2026/09/20 07:58:36 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6425lb # [ 146.165599] niks3-server[1066]: 2026/09/20 07:58:36 INFO Completed upload id=646426worker2 # [ 146.164299] nix-grpc-daemon[1678]: time=2026-09-20T07:58:35.952Z level=INFO msg="Upload complete. (380ms)"6427lb # [ 146.168158] niks3-server[1066]: 2026/09/20 07:58:36 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6428worker2 # [ 146.166487] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38208 duration_s=0 paths=1 nar_bytes_in=6246429worker2 # [ 146.170167] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:382086430worker2 # [ 146.177522] nix-daemon[873]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)6431worker2 # [ 146.180334] nix-daemon[873]: reaped child process 1723, status = succeeded6432client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6433client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6434worker2 # [ 146.185264] nix-daemon[873]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)6435client # farm-b> LOG-farm-b-drain6436worker2 # [ 147.400875] nix-daemon[873]: reaped child process 1737, status = succeeded6437worker2 # [ 147.516181] nix-daemon[873]: accepted connection from pid 1752, user nix-grpc-daemon (trusted)6438worker2 # [ 147.530741] nix-daemon[873]: reaped child process 1755, status = succeeded6439lb # [ 147.542432] niks3-server[1066]: 2026/09/20 07:58:37 INFO Received uploads request method=POST path=/api/pending_closures6440worker2 # [ 147.549859] nix-grpc-daemon[1678]: time=2026-09-20T07:58:37.338Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6441worker2 # [ 147.551941] nix-grpc-daemon[1678]: time=2026-09-20T07:58:37.339Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6442lb # [ 147.572227] niks3-server[1066]: 2026/09/20 07:58:37 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6443lb # [ 147.585929] niks3-server[1066]: 2026/09/20 07:58:37 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6444lb # [ 147.597877] niks3-server[1066]: 2026/09/20 07:58:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6445worker2 # [ 147.600957] nix-grpc-daemon[1678]: time=2026-09-20T07:58:37.389Z level=INFO msg="Uploading 1 narinfos"6446lb # [ 147.602092] niks3-server[1066]: 2026/09/20 07:58:37 INFO Signed narinfos id=65 count=16447lb # [ 147.607084] niks3-server[1066]: 2026/09/20 07:58:37 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6448lb # [ 147.615162] niks3-server[1066]: 2026/09/20 07:58:37 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6449lb # [ 147.625117] niks3-server[1066]: 2026/09/20 07:58:37 INFO Completed upload id=656450worker2 # [ 147.623846] nix-grpc-daemon[1678]: time=2026-09-20T07:58:37.412Z level=INFO msg="Upload complete. (231ms)"6451lb # [ 147.626309] niks3-server[1066]: 2026/09/20 07:58:37 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6452worker2 # [ 147.626525] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38208 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=16 outputs=16453worker2 # [ 147.633938] nix-daemon[873]: reaped child process 1735, status = succeeded6454worker1 # [ 147.639109] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:37Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06455worker1 # [ 147.641039] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:37Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16456worker2 # [ 147.676950] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:382086457worker2 # [ 147.688191] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:382086458worker2 # [ 147.696422] nix-grpc-daemon[1678]: time=2026-09-20T07:58:37.484Z level=INFO msg="All 2 paths already cached"6459client # copying 1 paths to 'lb:50051'...6460client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6461worker2 # [ 147.701150] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:382086462worker2 # [ 147.706780] nix-daemon[873]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)6463worker2 # [ 147.835911] nix-daemon[873]: accepted connection from pid 1759, user nix-grpc-daemon (trusted)6464worker2 # [ 147.851753] nix-daemon[873]: reaped child process 1762, status = succeeded6465lb # [ 147.939153] envoy[916]: conn peer=[2001:db8:1::1]:42514 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26808 tx=10633 ms=151956466lb # [ 147.940818] envoy[916]: conn peer=[2001:db8:1::1]:56790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=708 tx=439 ms=556467worker2 # [ 148.005684] nix-daemon[873]: accepted connection from pid 1764, user nix-grpc-daemon (trusted)6468worker2 # [ 148.019456] nix-daemon[873]: reaped child process 1767, status = succeeded6469lb # [ 148.030454] niks3-server[1066]: 2026/09/20 07:58:38 INFO Received uploads request method=POST path=/api/pending_closures6470worker2 # [ 148.033416] nix-grpc-daemon[1678]: time=2026-09-20T07:58:37.821Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6471worker2 # [ 148.034794] nix-grpc-daemon[1678]: time=2026-09-20T07:58:37.821Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6472lb # [ 148.043349] niks3-server[1066]: 2026/09/20 07:58:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6473lb # [ 148.046282] niks3-server[1066]: 2026/09/20 07:58:38 INFO Signed narinfos id=66 count=16474worker2 # [ 148.046275] nix-grpc-daemon[1678]: time=2026-09-20T07:58:37.834Z level=INFO msg="Uploading 1 narinfos"6475lb # [ 148.048332] niks3-server[1066]: 2026/09/20 07:58:38 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6476lb # [ 148.051594] niks3-server[1066]: 2026/09/20 07:58:38 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6477lb # [ 148.056151] niks3-server[1066]: 2026/09/20 07:58:38 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6478lb # [ 148.059309] niks3-server[1066]: 2026/09/20 07:58:38 INFO Completed upload id=666479worker2 # [ 148.058032] nix-grpc-daemon[1678]: time=2026-09-20T07:58:37.846Z level=INFO msg="Upload complete. (346ms)"6480lb # [ 148.061791] niks3-server[1066]: 2026/09/20 07:58:38 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6481worker2 # [ 148.059975] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38208 duration_s=0 paths=1 nar_bytes_in=7526482worker2 # [ 148.062935] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:382086483worker2 # [ 148.068127] nix-daemon[873]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)6484worker2 # [ 148.072746] nix-daemon[873]: reaped child process 1757, status = succeeded6485worker2 # [ 148.077386] nix-daemon[873]: accepted connection from pid 1652, user nix-grpc-daemon (trusted)6486client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6487client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6488client # farm-top> LOG-farm-top-drain6489worker2 # [ 149.505926] nix-daemon[873]: reaped child process 1771, status = succeeded6490worker2 # [ 149.631720] nix-daemon[873]: accepted connection from pid 1786, user nix-grpc-daemon (trusted)6491worker2 # [ 149.645742] nix-daemon[873]: reaped child process 1789, status = succeeded6492lb # [ 149.655557] niks3-server[1066]: 2026/09/20 07:58:39 INFO Received uploads request method=POST path=/api/pending_closures6493worker2 # [ 149.669626] nix-grpc-daemon[1678]: time=2026-09-20T07:58:39.457Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6494worker2 # [ 149.672330] nix-grpc-daemon[1678]: time=2026-09-20T07:58:39.459Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6495lb # [ 149.690275] niks3-server[1066]: 2026/09/20 07:58:39 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6496lb # [ 149.704130] niks3-server[1066]: 2026/09/20 07:58:39 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6497worker2 # [ 149.716312] nix-grpc-daemon[1678]: time=2026-09-20T07:58:39.504Z level=INFO msg="Uploading 1 narinfos"6498lb # [ 149.718093] niks3-server[1066]: 2026/09/20 07:58:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6499lb # [ 149.721061] niks3-server[1066]: 2026/09/20 07:58:39 INFO Signed narinfos id=67 count=16500lb # [ 149.725964] niks3-server[1066]: 2026/09/20 07:58:39 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6501lb # [ 149.734908] niks3-server[1066]: 2026/09/20 07:58:39 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6502lb # [ 149.741412] niks3-server[1066]: 2026/09/20 07:58:39 INFO Completed upload id=676503worker2 # [ 149.740288] nix-grpc-daemon[1678]: time=2026-09-20T07:58:39.528Z level=INFO msg="Upload complete. (254ms)"6504lb # [ 149.743863] niks3-server[1066]: 2026/09/20 07:58:39 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6505worker2 # [ 149.745759] nix-grpc-daemon[1652]: ts=2026-09-20T07:58:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38208 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=17 outputs=16506worker2 # [ 149.759641] nix-daemon[873]: reaped child process 1769, status = succeeded6507client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&2, in 7.20 seconds)6508client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath6509client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath, in 0.20 seconds)6510worker1: must succeed: rm /nix/.rw-store/fill6511worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.11 seconds)6512worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6513worker1 # [ 151.143817] nix-grpc-daemon[1424]: ts=2026-09-20T07:58:41Z level=info event=healthy reason=min_free6514worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.10 seconds)6515(finished: subtest: low disk drains a worker and builds go to the other, in 10.82 seconds)6516(finished: run the VM test script, in 152.20 seconds)6517test script finished in 152.39s6518cleanup6519kill QemuMachine (pid 49)6520client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6521kill QemuMachine (pid 50)6522lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6523kill QemuMachine (pid 51)6524worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6525kill QemuMachine (pid 52)6526worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6527(finished: cleanup, in 1.02 seconds)6528additionally exposed symbols:6529 client, lb, worker1, worker2,6530 vlan1,6531 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh