vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #237
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13client # Disk image does not exist, creating the virtualisation disk image...14worker2 # Formatting '/build/vm-state-worker2/tmp.G5WmL8pkLj', fmt=raw size=107374182415client # Formatting '/build/vm-state-client/tmp.9BqiUTcuU0', fmt=raw size=107374182416worker2: QEMU running (pid 51)17client: QEMU running (pid 50)18worker2 # mke2fs 1.47.4 (6-Mar-2025)19client # mke2fs 1.47.4 (6-Mar-2025)20worker2 # Discarding device blocks: 0/262144 done21client # Discarding device blocks: 0/262144 done22worker1 # Disk image does not exist, creating the virtualisation disk image...23worker1: QEMU running (pid 52)24worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes25client # Creating filesystem with 262144 4k blocks and 65536 inodes26worker2 # Filesystem UUID: 626bb4b4-1e47-4126-a1f6-cec85a421a2927client # Filesystem UUID: dc54dcd2-0788-4329-9b75-2cac09a2fb3e28worker2 # Superblock backups stored on blocks:29client # Superblock backups stored on blocks:30worker2 # 32768, 98304, 163840, 22937631client # 32768, 98304, 163840, 22937632worker2 # 33client # 34worker2 # Allocating group tables: 0/8 done35client # Allocating group tables: 0/8 done36worker2 # Writing inode tables: 0/8 done37client # Writing inode tables: 0/8 done38worker2 # Creating journal (8192 blocks): done39client # Creating journal (8192 blocks): done40worker2 # Writing superblocks and filesystem accounting information: 0/8 done41client # Writing superblocks and filesystem accounting information: 0/8 done42worker2 # 43client # 44worker2 # Virtualisation disk image created.45client # Virtualisation disk image created.46worker1 # Formatting '/build/vm-state-worker1/tmp.wxf1PNUsPX', fmt=raw size=107374182447worker1 # mke2fs 1.47.4 (6-Mar-2025)48worker1 # Discarding device blocks: 0/262144 done49worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes50worker1 # Filesystem UUID: 7d4171a9-d799-4c96-ac65-aed64cbddbc851worker1 # Superblock backups stored on blocks:52worker1 # 32768, 98304, 163840, 22937653worker1 # 54worker1 # Allocating group tables: 0/8 done55worker1 # Writing inode tables: 0/8 done56worker1 # Creating journal (8192 blocks): done57worker1 # Writing superblocks and filesystem accounting information: 0/8 done58worker1 # 59worker1 # Virtualisation disk image created.60lb # Disk image does not exist, creating the virtualisation disk image...61lb: QEMU running (pid 49)62lb # Formatting '/build/vm-state-lb/tmp.LcxtWaBE9M', fmt=raw size=107374182463lb # mke2fs 1.47.4 (6-Mar-2025)64lb # Discarding device blocks: 0/262144 done65lb # Creating filesystem with 262144 4k blocks and 65536 inodes66(finished: start all VMs, in 0.32 seconds)67lb # Filesystem UUID: 69e44a9a-fc78-42d6-96ec-31574485d80f68lb # Superblock backups stored on blocks:69lb # 32768, 98304, 163840, 22937670client: waiting for unit network-addresses-eth1.service71lb # 72client: waiting for the VM to finish booting73lb # Allocating group tables: 0/8 done74lb # Writing inode tables: 0/8 done75lb # Creating journal (8192 blocks): done76lb # Writing superblocks and filesystem accounting information: 0/8 done77lb # 78lb # Virtualisation disk image created.79client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83client # 84client # 85worker2 # 86worker2 # 87client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0088worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0089worker1 # 90worker1 # 91worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0092client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...93client # 94client # 95client # 96client # 97worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...98worker2 # 99worker2 # 100worker2 # 101worker2 # 102client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00103worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00104lb # 105lb # 106worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...107worker1 # 108worker1 # 109worker1 # 110worker1 # 111lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00112worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00113client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...114client # 115client # 116worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...117worker2 # 118worker2 # 119lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...120lb # 121lb # 122lb # 123lb # 124worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...125worker1 # 126worker1 # 127lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00128lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129lb # 130lb # 131client # Booting from ROM...132worker2 # Booting from ROM...133worker1 # Booting from ROM...134lb # Booting from ROM...135worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026137worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026138worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ci31dsya3r32k1hwv9hbykpc96xwk37c-nixos-system-worker2-test/init regInfo=/nix/store/gp83fzr5532vzz2r75wivka8s09kd04w-closure-info/registration console=ttyS0,115200n8 console=tty0139worker2 # [ 0.000000] BIOS-provided physical RAM map:140worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable141worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved142lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026143client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vpijc9l8bpbyqvlpg5fvx0ch6lm9zivm-nixos-system-client-test/init regInfo=/nix/store/wb3jq4w8wbij5gx7wpxdw5z2pyj2v5g6-closure-info/registration console=ttyS0,115200n8 console=tty0144worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved145worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qvn0xcjapwlvw9rdfzm2whpfww98lnra-nixos-system-worker1-test/init regInfo=/nix/store/3nfldfqr6ff63mm4w09dy193ra90n2ih-closure-info/registration console=ttyS0,115200n8 console=tty0146client # [ 0.000000] BIOS-provided physical RAM map:147worker1 # [ 0.000000] BIOS-provided physical RAM map:148worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable149client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable150worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable151worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved152client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved153worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved154worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved155client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved156lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0157worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved158worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved159client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable160lb # [ 0.000000] BIOS-provided physical RAM map:161worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved162worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable163client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved164lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable165worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved166worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved167client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved168lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved169worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved170worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved171client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved172lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved173worker2 # [ 0.000000] NX (Execute Disable) protection: active174worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved175client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved176worker2 # [ 0.000000] APIC: Static calls initialized177lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable178worker2 # [ 0.000000] SMBIOS 2.8 present.179worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved180client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved181lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved182worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved183worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014184client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved185lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved186worker2 # [ 0.000000] DMI: Memory slots populated: 1/1187worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved188client # [ 0.000000] NX (Execute Disable) protection: active189worker2 # [ 0.000000] Hypervisor detected: KVM190lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved191worker1 # [ 0.000000] NX (Execute Disable) protection: active192client # [ 0.000000] APIC: Static calls initialized193client # [ 0.000000] SMBIOS 2.8 present.194worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000195worker1 # [ 0.000000] APIC: Static calls initialized196lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved197worker1 # [ 0.000000] SMBIOS 2.8 present.198worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00199lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved200client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014201worker2 # [ 0.000000] kvm-clock: using sched offset of 522598399 cycles202worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014203client # [ 0.000000] DMI: Memory slots populated: 1/1204lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved205worker1 # [ 0.000000] DMI: Memory slots populated: 1/1206client # [ 0.000000] Hypervisor detected: KVM207lb # [ 0.000000] NX (Execute Disable) protection: active208worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns209worker1 # [ 0.000000] Hypervisor detected: KVM210client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000211lb # [ 0.000000] APIC: Static calls initialized212worker2 # [ 0.000006] tsc: Detected 2400.012 MHz processor213worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000214lb # [ 0.000000] SMBIOS 2.8 present.215client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00216worker2 # [ 0.000816] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000217worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00218client # [ 0.000000] kvm-clock: using sched offset of 526174221 cycles219worker1 # [ 0.000001] kvm-clock: using sched offset of 503433685 cycles220lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014221worker2 # [ 0.000844] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs222lb # [ 0.000000] DMI: Memory slots populated: 1/1223client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns224lb # [ 0.000000] Hypervisor detected: KVM225worker2 # [ 0.000847] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT226worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns227client # [ 0.000005] tsc: Detected 2400.012 MHz processor228lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000229worker2 # [ 0.002752] found SMP MP-table at [mem 0x000f5450-0x000f545f]230worker1 # [ 0.000006] tsc: Detected 2400.012 MHz processor231client # [ 0.000806] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000232lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00233worker2 # [ 0.002767] Using GB pages for direct mapping234worker1 # [ 0.000815] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000235worker2 # [ 0.002870] RAMDISK: [mem 0x5e367000-0x5ffcffff]236lb # [ 0.000001] kvm-clock: using sched offset of 497128445 cycles237client # [ 0.000833] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs238worker2 # [ 0.002879] ACPI: Early table checksum verification disabled239worker1 # [ 0.000842] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs240client # [ 0.000836] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT241worker2 # [ 0.002883] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )242lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns243worker1 # [ 0.000845] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT244client # [ 0.002736] found SMP MP-table at [mem 0x000f5450-0x000f545f]245lb # [ 0.000005] tsc: Detected 2400.012 MHz processor246worker1 # [ 0.002736] found SMP MP-table at [mem 0x000f5450-0x000f545f]247client # [ 0.002749] Using GB pages for direct mapping248worker2 # [ 0.002887] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)249lb # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000250worker1 # [ 0.002748] Using GB pages for direct mapping251client # [ 0.002834] RAMDISK: [mem 0x5e366000-0x5ffcffff]252worker1 # [ 0.002863] RAMDISK: [mem 0x5e367000-0x5ffcffff]253worker2 # [ 0.002892] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)254client # [ 0.002843] ACPI: Early table checksum verification disabled255lb # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs256worker1 # [ 0.002872] ACPI: Early table checksum verification disabled257client # [ 0.002846] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )258worker2 # [ 0.002900] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)259lb # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT260worker1 # [ 0.002875] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )261worker2 # [ 0.002903] ACPI: FACS 0x000000005FFE0000 000040262lb # [ 0.002730] found SMP MP-table at [mem 0x000f5450-0x000f545f]263client # [ 0.002850] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)264worker1 # [ 0.002879] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)265lb # [ 0.002750] Using GB pages for direct mapping266worker2 # [ 0.002904] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)267lb # [ 0.002839] RAMDISK: [mem 0x5e367000-0x5ffcffff]268client # [ 0.002855] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)269worker1 # [ 0.002884] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)270lb # [ 0.002849] ACPI: Early table checksum verification disabled271worker2 # [ 0.002906] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)272client # [ 0.002863] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)273lb # [ 0.002852] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )274worker1 # [ 0.002891] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)275client # [ 0.002866] ACPI: FACS 0x000000005FFE0000 000040276worker2 # [ 0.002907] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)277worker1 # [ 0.002893] ACPI: FACS 0x000000005FFE0000 000040278lb # [ 0.002857] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)279client # [ 0.002867] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)280worker2 # [ 0.002909] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)281worker1 # [ 0.002894] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)282lb # [ 0.002861] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)283worker2 # [ 0.002910] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]284client # [ 0.002869] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)285worker1 # [ 0.002896] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)286lb # [ 0.002869] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)287worker2 # [ 0.002911] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]288client # [ 0.002870] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)289lb # [ 0.002871] ACPI: FACS 0x000000005FFE0000 000040290worker1 # [ 0.002898] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)291worker2 # [ 0.002912] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]292client # [ 0.002872] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)293lb # [ 0.002872] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)294worker1 # [ 0.002899] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)295worker2 # [ 0.002912] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]296client # [ 0.002873] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]297worker1 # [ 0.002900] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]298worker2 # [ 0.002913] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]299lb # [ 0.002874] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)300client # [ 0.002874] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]301worker1 # [ 0.002901] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]302worker2 # [ 0.002913] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]303lb # [ 0.002875] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)304client # [ 0.002875] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]305worker1 # [ 0.002902] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]306worker2 # [ 0.002913] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]307lb # [ 0.002877] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)308client # [ 0.002875] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]309worker2 # [ 0.003151] No NUMA configuration found310worker1 # [ 0.002903] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]311worker2 # [ 0.003152] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]312lb # [ 0.002878] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]313client # [ 0.002876] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]314worker1 # [ 0.002903] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]315worker2 # [ 0.003155] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]316lb # [ 0.002879] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]317client # [ 0.002876] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]318worker2 # [ 0.005585] Zone ranges:319worker1 # [ 0.002904] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]320lb # [ 0.002880] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]321client # [ 0.002877] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]322worker2 # [ 0.005587] DMA [mem 0x0000000000001000-0x0000000000ffffff]323worker1 # [ 0.002904] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]324client # [ 0.003113] No NUMA configuration found325worker2 # [ 0.005588] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]326worker1 # [ 0.003135] No NUMA configuration found327lb # [ 0.002880] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]328worker2 # [ 0.005590] Normal empty329client # [ 0.003114] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]330worker2 # [ 0.005591] Device empty331worker1 # [ 0.003136] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]332lb # [ 0.002881] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]333worker2 # [ 0.005591] Movable zone start for each node334client # [ 0.003116] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]335worker1 # [ 0.003138] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]336client # [ 0.005514] Zone ranges:337worker2 # [ 0.005592] Early memory node ranges338lb # [ 0.002881] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]339worker1 # [ 0.005554] Zone ranges:340client # [ 0.005515] DMA [mem 0x0000000000001000-0x0000000000ffffff]341worker2 # [ 0.005593] node 0: [mem 0x0000000000001000-0x000000000009efff]342worker1 # [ 0.005555] DMA [mem 0x0000000000001000-0x0000000000ffffff]343lb # [ 0.002881] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]344client # [ 0.005517] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]345lb # [ 0.003116] No NUMA configuration found346worker2 # [ 0.005594] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]347worker1 # [ 0.005557] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]348client # [ 0.005518] Normal empty349worker1 # [ 0.005558] Normal empty350client # [ 0.005519] Device empty351lb # [ 0.003117] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]352worker2 # [ 0.005595] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]353worker1 # [ 0.005559] Device empty354client # [ 0.005520] Movable zone start for each node355worker1 # [ 0.005559] Movable zone start for each node356lb # [ 0.003119] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]357worker2 # [ 0.005617] On node 0, zone DMA: 1 pages in unavailable ranges358client # [ 0.005520] Early memory node ranges359lb # [ 0.005575] Zone ranges:360worker1 # [ 0.005560] Early memory node ranges361worker2 # [ 0.005896] On node 0, zone DMA: 97 pages in unavailable ranges362client # [ 0.005521] node 0: [mem 0x0000000000001000-0x000000000009efff]363worker1 # [ 0.005560] node 0: [mem 0x0000000000001000-0x000000000009efff]364lb # [ 0.005576] DMA [mem 0x0000000000001000-0x0000000000ffffff]365worker2 # [ 0.034612] On node 0, zone DMA32: 40 pages in unavailable ranges366client # [ 0.005522] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]367lb # [ 0.005577] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]368worker1 # [ 0.005561] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]369worker2 # [ 0.035093] ACPI: PM-Timer IO Port: 0x608370lb # [ 0.005579] Normal empty371client # [ 0.005523] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]372lb # [ 0.005579] Device empty373worker1 # [ 0.005563] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]374worker2 # [ 0.035107] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])375lb # [ 0.005580] Movable zone start for each node376client # [ 0.005543] On node 0, zone DMA: 1 pages in unavailable ranges377worker1 # [ 0.005586] On node 0, zone DMA: 1 pages in unavailable ranges378worker2 # [ 0.035139] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23379lb # [ 0.005581] Early memory node ranges380client # [ 0.005824] On node 0, zone DMA: 97 pages in unavailable ranges381worker1 # [ 0.005863] On node 0, zone DMA: 97 pages in unavailable ranges382lb # [ 0.005581] node 0: [mem 0x0000000000001000-0x000000000009efff]383worker2 # [ 0.035141] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)384client # [ 0.034196] On node 0, zone DMA32: 40 pages in unavailable ranges385worker1 # [ 0.034619] On node 0, zone DMA32: 40 pages in unavailable ranges386lb # [ 0.005582] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]387worker2 # [ 0.035143] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)388client # [ 0.034667] ACPI: PM-Timer IO Port: 0x608389worker1 # [ 0.035082] ACPI: PM-Timer IO Port: 0x608390client # [ 0.034680] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])391worker2 # [ 0.035144] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)392lb # [ 0.005583] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]393worker1 # [ 0.035095] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])394client # [ 0.034707] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23395lb # [ 0.005605] On node 0, zone DMA: 1 pages in unavailable ranges396worker2 # [ 0.035146] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)397worker1 # [ 0.035123] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23398lb # [ 0.005893] On node 0, zone DMA: 97 pages in unavailable ranges399client # [ 0.034709] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)400worker2 # [ 0.035146] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)401worker1 # [ 0.035126] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)402lb # [ 0.034666] On node 0, zone DMA32: 40 pages in unavailable ranges403client # [ 0.034711] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)404worker2 # [ 0.035149] ACPI: Using ACPI (MADT) for SMP configuration information405worker1 # [ 0.035128] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)406lb # [ 0.035138] ACPI: PM-Timer IO Port: 0x608407worker2 # [ 0.035150] ACPI: HPET id: 0x8086a201 base: 0xfed00000408client # [ 0.034712] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)409lb # [ 0.035152] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])410worker1 # [ 0.035129] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)411worker2 # [ 0.035155] TSC deadline timer available412client # [ 0.034713] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)413worker2 # [ 0.035160] CPU topo: Max. logical packages: 1414worker1 # [ 0.035130] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)415lb # [ 0.035178] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23416worker2 # [ 0.035160] CPU topo: Max. logical dies: 1417client # [ 0.034714] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)418lb # [ 0.035180] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)419worker1 # [ 0.035131] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)420worker2 # [ 0.035161] CPU topo: Max. dies per package: 1421client # [ 0.034716] ACPI: Using ACPI (MADT) for SMP configuration information422worker2 # [ 0.035165] CPU topo: Max. threads per core: 1423lb # [ 0.035182] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)424worker1 # [ 0.035133] ACPI: Using ACPI (MADT) for SMP configuration information425client # [ 0.034717] ACPI: HPET id: 0x8086a201 base: 0xfed00000426worker2 # [ 0.035165] CPU topo: Num. cores per package: 1427worker1 # [ 0.035134] ACPI: HPET id: 0x8086a201 base: 0xfed00000428lb # [ 0.035183] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)429client # [ 0.034722] TSC deadline timer available430worker1 # [ 0.035138] TSC deadline timer available431worker2 # [ 0.035166] CPU topo: Num. threads per package: 1432client # [ 0.034727] CPU topo: Max. logical packages: 1433lb # [ 0.035185] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)434worker1 # [ 0.035143] CPU topo: Max. logical packages: 1435worker2 # [ 0.035166] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs436client # [ 0.034727] CPU topo: Max. logical dies: 1437worker1 # [ 0.035143] CPU topo: Max. logical dies: 1438lb # [ 0.035185] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)439client # [ 0.034728] CPU topo: Max. dies per package: 1440worker2 # [ 0.035192] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()441worker1 # [ 0.035144] CPU topo: Max. dies per package: 1442client # [ 0.034731] CPU topo: Max. threads per core: 1443lb # [ 0.035188] ACPI: Using ACPI (MADT) for SMP configuration information444worker1 # [ 0.035147] CPU topo: Max. threads per core: 1445worker2 # [ 0.035238] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]446lb # [ 0.035189] ACPI: HPET id: 0x8086a201 base: 0xfed00000447client # [ 0.034732] CPU topo: Num. cores per package: 1448worker1 # [ 0.035148] CPU topo: Num. cores per package: 1449lb # [ 0.035193] TSC deadline timer available450client # [ 0.034732] CPU topo: Num. threads per package: 1451worker2 # [ 0.035239] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]452worker1 # [ 0.035148] CPU topo: Num. threads per package: 1453lb # [ 0.035197] CPU topo: Max. logical packages: 1454client # [ 0.034733] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs455worker2 # [ 0.035241] [mem 0x60000000-0xafffffff] available for PCI devices456worker1 # [ 0.035149] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs457lb # [ 0.035198] CPU topo: Max. logical dies: 1458worker2 # [ 0.035243] Booting paravirtualized kernel on KVM459client # [ 0.034757] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()460lb # [ 0.035199] CPU topo: Max. dies per package: 1461worker1 # [ 0.035169] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()462lb # [ 0.035202] CPU topo: Max. threads per core: 1463client # [ 0.034792] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]464worker1 # [ 0.035202] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]465lb # [ 0.035203] CPU topo: Num. cores per package: 1466worker2 # [ 0.035247] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns467lb # [ 0.035203] CPU topo: Num. threads per package: 1468client # [ 0.034794] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]469worker1 # [ 0.035204] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]470worker2 # [ 0.039737] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1471lb # [ 0.035204] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs472client # [ 0.034796] [mem 0x60000000-0xafffffff] available for PCI devices473worker1 # [ 0.035205] [mem 0x60000000-0xafffffff] available for PCI devices474worker2 # [ 0.042327] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152475client # [ 0.034798] Booting paravirtualized kernel on KVM476worker1 # [ 0.035207] Booting paravirtualized kernel on KVM477lb # [ 0.035225] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()478worker2 # [ 0.042371] kvm-guest: PV spinlocks disabled, single CPU479lb # [ 0.035265] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]480client # [ 0.034802] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns481worker1 # [ 0.035211] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns482lb # [ 0.035266] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]483client # [ 0.039274] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1484worker1 # [ 0.039758] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1485lb # [ 0.035268] [mem 0x60000000-0xafffffff] available for PCI devices486client # [ 0.041565] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152487worker1 # [ 0.042374] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152488lb # [ 0.035270] Booting paravirtualized kernel on KVM489client # [ 0.041607] kvm-guest: PV spinlocks disabled, single CPU490worker1 # [ 0.042417] kvm-guest: PV spinlocks disabled, single CPU491worker2 # [ 0.042373] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ci31dsya3r32k1hwv9hbykpc96xwk37c-nixos-system-worker2-test/init regInfo=/nix/store/gp83fzr5532vzz2r75wivka8s09kd04w-closure-info/registration console=ttyS0,115200n8 console=tty0492lb # [ 0.035274] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns493lb # [ 0.039806] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1494worker2 # [ 0.042472] Unknown kernel command line parameters "regInfo=/nix/store/gp83fzr5532vzz2r75wivka8s09kd04w-closure-info/registration", will be passed to user space.495worker2 # [ 0.042486] random: crng init done496lb # [ 0.042120] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152497lb # [ 0.042162] kvm-guest: PV spinlocks disabled, single CPU498worker2 # [ 0.042487] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes499client # [ 0.041609] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vpijc9l8bpbyqvlpg5fvx0ch6lm9zivm-nixos-system-client-test/init regInfo=/nix/store/wb3jq4w8wbij5gx7wpxdw5z2pyj2v5g6-closure-info/registration console=ttyS0,115200n8 console=tty0500worker1 # [ 0.042419] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qvn0xcjapwlvw9rdfzm2whpfww98lnra-nixos-system-worker1-test/init regInfo=/nix/store/3nfldfqr6ff63mm4w09dy193ra90n2ih-closure-info/registration console=ttyS0,115200n8 console=tty0501worker2 # [ 0.044758] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)502worker2 # [ 0.045880] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)503client # [ 0.041711] Unknown kernel command line parameters "regInfo=/nix/store/wb3jq4w8wbij5gx7wpxdw5z2pyj2v5g6-closure-info/registration", will be passed to user space.504worker1 # [ 0.042518] Unknown kernel command line parameters "regInfo=/nix/store/3nfldfqr6ff63mm4w09dy193ra90n2ih-closure-info/registration", will be passed to user space.505worker2 # [ 0.045914] Fallback order for Node 0: 0506client # [ 0.041724] random: crng init done507worker1 # [ 0.042531] random: crng init done508worker2 # [ 0.045917] Built 1 zonelists, mobility grouping on. Total pages: 393078509client # [ 0.041725] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes510worker1 # [ 0.042532] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes511worker2 # [ 0.045919] Policy zone: DMA32512lb # [ 0.042164] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0513client # [ 0.043981] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)514worker2 # [ 0.048554] mem auto-init: stack:all(zero), heap alloc:on, heap free:off515worker1 # [ 0.044792] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)516worker2 # [ 0.052131] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1517worker1 # [ 0.046001] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)518client # [ 0.045374] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)519lb # [ 0.042265] Unknown kernel command line parameters "regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration", will be passed to user space.520worker2 # [ 0.056052] allocated 3145728 bytes of page_ext521lb # [ 0.042278] random: crng init done522worker1 # [ 0.046033] Fallback order for Node 0: 0523client # [ 0.045408] Fallback order for Node 0: 0524worker2 # [ 0.066656] ftrace: allocating 48731 entries in 192 pages525client # [ 0.045412] Built 1 zonelists, mobility grouping on. Total pages: 393078526lb # [ 0.042279] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes527worker1 # [ 0.046036] Built 1 zonelists, mobility grouping on. Total pages: 393078528worker2 # [ 0.066658] ftrace: allocated 192 pages with 2 groups529worker1 # [ 0.046037] Policy zone: DMA32530client # [ 0.045413] Policy zone: DMA32531worker2 # [ 0.067597] Dynamic Preempt: lazy532lb # [ 0.043870] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)533client # [ 0.048104] mem auto-init: stack:all(zero), heap alloc:on, heap free:off534worker1 # [ 0.048705] mem auto-init: stack:all(zero), heap alloc:on, heap free:off535worker2 # [ 0.067766] rcu: Preemptible hierarchical RCU implementation.536lb # [ 0.045018] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)537worker2 # [ 0.067767] rcu: RCU event tracing is enabled.538client # [ 0.051699] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1539worker1 # [ 0.052208] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1540lb # [ 0.045046] Fallback order for Node 0: 0541worker1 # [ 0.056128] allocated 3145728 bytes of page_ext542client # [ 0.055239] allocated 3145728 bytes of page_ext543worker2 # [ 0.067768] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.544worker1 # [ 0.066642] ftrace: allocating 48731 entries in 192 pages545lb # [ 0.045049] Built 1 zonelists, mobility grouping on. Total pages: 393078546client # [ 0.065751] ftrace: allocating 48731 entries in 192 pages547worker2 # [ 0.067769] Trampoline variant of Tasks RCU enabled.548lb # [ 0.045050] Policy zone: DMA32549client # [ 0.065753] ftrace: allocated 192 pages with 2 groups550worker1 # [ 0.066645] ftrace: allocated 192 pages with 2 groups551worker2 # [ 0.067770] Rude variant of Tasks RCU enabled.552client # [ 0.066639] Dynamic Preempt: lazy553worker1 # [ 0.067546] Dynamic Preempt: lazy554lb # [ 0.047748] mem auto-init: stack:all(zero), heap alloc:on, heap free:off555worker2 # [ 0.067770] Tracing variant of Tasks RCU enabled.556worker1 # [ 0.067685] rcu: Preemptible hierarchical RCU implementation.557client # [ 0.066787] rcu: Preemptible hierarchical RCU implementation.558lb # [ 0.051166] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1559worker2 # [ 0.067771] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.560client # [ 0.066788] rcu: RCU event tracing is enabled.561worker1 # [ 0.067686] rcu: RCU event tracing is enabled.562lb # [ 0.054703] allocated 3145728 bytes of page_ext563worker2 # [ 0.067772] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1564worker1 # [ 0.067687] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.565client # [ 0.066788] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.566lb # [ 0.065169] ftrace: allocating 48731 entries in 192 pages567worker1 # [ 0.067688] Trampoline variant of Tasks RCU enabled.568client # [ 0.066790] Trampoline variant of Tasks RCU enabled.569lb # [ 0.065171] ftrace: allocated 192 pages with 2 groups570worker2 # [ 0.067794] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.571worker1 # [ 0.067689] Rude variant of Tasks RCU enabled.572lb # [ 0.066065] Dynamic Preempt: lazy573client # [ 0.066791] Rude variant of Tasks RCU enabled.574worker1 # [ 0.067689] Tracing variant of Tasks RCU enabled.575client # [ 0.066791] Tracing variant of Tasks RCU enabled.576lb # [ 0.066251] rcu: Preemptible hierarchical RCU implementation.577worker2 # [ 0.067796] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.578lb # [ 0.066251] rcu: RCU event tracing is enabled.579worker1 # [ 0.067690] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.580client # [ 0.066792] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.581worker2 # [ 0.067797] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.582lb # [ 0.066252] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.583worker1 # [ 0.067691] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1584client # [ 0.066793] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1585lb # [ 0.066254] Trampoline variant of Tasks RCU enabled.586worker2 # [ 0.072277] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16587lb # [ 0.066254] Rude variant of Tasks RCU enabled.588worker1 # [ 0.067752] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.589client # [ 0.066845] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.590worker2 # [ 0.072562] rcu: srcu_init: Setting srcu_struct sizes based on contention.591lb # [ 0.066254] Tracing variant of Tasks RCU enabled.592worker1 # [ 0.067754] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.593client # [ 0.066848] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.594lb # [ 0.066255] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.595worker2 # [ 0.072569] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns596worker1 # [ 0.067755] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.597lb # [ 0.066256] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1598client # [ 0.066848] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.599worker2 # [ 0.072684] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)600worker1 # [ 0.072246] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16601client # [ 0.071639] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16602worker2 # [ 0.076213] Console: colour VGA+ 80x25603lb # [ 0.066272] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.604worker2 # [ 0.076216] printk: legacy console [tty0] enabled605worker1 # [ 0.072533] rcu: srcu_init: Setting srcu_struct sizes based on contention.606client # [ 0.071917] rcu: srcu_init: Setting srcu_struct sizes based on contention.607worker2 # [ 0.105717] printk: legacy console [ttyS0] enabled608lb # [ 0.066274] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.609worker1 # [ 0.072540] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns610worker2 # [ 0.200529] ACPI: Core revision 20250807611client # [ 0.071923] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns612lb # [ 0.066275] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.613worker1 # [ 0.072665] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)614lb # [ 0.070718] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16615client # [ 0.072046] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)616worker1 # [ 0.076216] Console: colour VGA+ 80x25617worker2 # [ 0.201400] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns618client # [ 0.075577] Console: colour VGA+ 80x25619lb # [ 0.071005] rcu: srcu_init: Setting srcu_struct sizes based on contention.620worker1 # [ 0.076226] printk: legacy console [tty0] enabled621client # [ 0.075580] printk: legacy console [tty0] enabled622worker2 # [ 0.202887] APIC: Switch to symmetric I/O mode setup623worker1 # [ 0.105882] printk: legacy console [ttyS0] enabled624client # [ 0.104961] printk: legacy console [ttyS0] enabled625worker2 # [ 0.203814] x2apic enabled626lb # [ 0.071011] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns627worker1 # [ 0.200902] ACPI: Core revision 20250807628client # [ 0.200738] ACPI: Core revision 20250807629worker2 # [ 0.204553] APIC: Switched APIC routing to: physical x2apic630lb # [ 0.071124] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)631lb # [ 0.074652] Console: colour VGA+ 80x25632worker1 # [ 0.201772] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns633client # [ 0.201599] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns634lb # [ 0.074655] printk: legacy console [tty0] enabled635lb # [ 0.104137] printk: legacy console [ttyS0] enabled636worker1 # [ 0.203344] APIC: Switch to symmetric I/O mode setup637client # [ 0.203172] APIC: Switch to symmetric I/O mode setup638worker2 # [ 0.206573] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1639worker1 # [ 0.204278] x2apic enabled640lb # [ 0.199720] ACPI: Core revision 20250807641client # [ 0.204106] x2apic enabled642worker1 # [ 0.205033] APIC: Switched APIC routing to: physical x2apic643client # [ 0.204849] APIC: Switched APIC routing to: physical x2apic644worker2 # [ 0.207541] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns645lb # [ 0.200564] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns646lb # [ 0.202103] APIC: Switch to symmetric I/O mode setup647worker2 # [ 0.209180] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)648worker1 # [ 0.206818] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1649client # [ 0.206629] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1650lb # [ 0.203102] x2apic enabled651worker2 # [ 0.210265] x86/cpu: User Mode Instruction Prevention (UMIP) activated652lb # [ 0.203902] APIC: Switched APIC routing to: physical x2apic653worker1 # [ 0.207766] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns654client # [ 0.207608] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns655worker2 # [ 0.211348] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127656worker2 # [ 0.212840] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0657worker1 # [ 0.209393] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)658client # [ 0.209300] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)659lb # [ 0.205765] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1660worker1 # [ 0.210478] x86/cpu: User Mode Instruction Prevention (UMIP) activated661client # [ 0.210384] x86/cpu: User Mode Instruction Prevention (UMIP) activated662worker2 # [ 0.213921] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto663worker1 # [ 0.211533] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127664lb # [ 0.206751] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns665client # [ 0.211448] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127666worker2 # [ 0.215176] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl667worker1 # [ 0.212390] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0668client # [ 0.212969] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0669lb # [ 0.208413] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)670worker2 # [ 0.216177] Transient Scheduler Attacks: Vulnerable: No microcode671lb # [ 0.209499] x86/cpu: User Mode Instruction Prevention (UMIP) activated672worker1 # [ 0.213393] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto673worker2 # [ 0.217176] Spectre V2 : Mitigation: Enhanced / Automatic IBRS674client # [ 0.213302] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto675lb # [ 0.210543] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127676worker2 # [ 0.218176] Speculative Return Stack Overflow: Mitigation: Safe RET677worker1 # [ 0.214390] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl678client # [ 0.215297] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl679lb # [ 0.212096] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0680worker1 # [ 0.215389] Transient Scheduler Attacks: Vulnerable: No microcode681client # [ 0.216298] Transient Scheduler Attacks: Vulnerable: No microcode682worker1 # [ 0.216389] Spectre V2 : Mitigation: Enhanced / Automatic IBRS683client # [ 0.217297] Spectre V2 : Mitigation: Enhanced / Automatic IBRS684lb # [ 0.213205] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto685worker1 # [ 0.217390] Speculative Return Stack Overflow: Mitigation: Safe RET686client # [ 0.218297] Speculative Return Stack Overflow: Mitigation: Safe RET687worker2 # [ 0.219176] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization688lb # [ 0.214410] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl689worker2 # [ 0.221184] Spectre V2 : Enabling IBPB for BPF690lb # [ 0.215411] Transient Scheduler Attacks: Vulnerable: No microcode691lb # [ 0.217169] Spectre V2 : Mitigation: Enhanced / Automatic IBRS692worker2 # [ 0.222177] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier693worker2 # [ 0.223177] active return thunk: srso_alias_return_thunk694lb # [ 0.218118] Speculative Return Stack Overflow: Mitigation: Safe RET695worker1 # [ 0.218389] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization696client # [ 0.219297] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization697worker1 # [ 0.220398] Spectre V2 : Enabling IBPB for BPF698worker2 # [ 0.224198] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'699client # [ 0.221305] Spectre V2 : Enabling IBPB for BPF700worker1 # [ 0.221107] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier701worker2 # [ 0.225176] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'702client # [ 0.222111] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier703worker1 # [ 0.222390] active return thunk: srso_alias_return_thunk704worker2 # [ 0.226176] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'705client # [ 0.223298] active return thunk: srso_alias_return_thunk706lb # [ 0.219140] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization707worker1 # [ 0.223411] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'708worker2 # [ 0.227176] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'709lb # [ 0.220418] Spectre V2 : Enabling IBPB for BPF710client # [ 0.224934] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'711worker2 # [ 0.228176] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'712worker1 # [ 0.224390] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'713client # [ 0.226176] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'714lb # [ 0.221411] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier715worker1 # [ 0.225389] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'716worker2 # [ 0.229176] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'717lb # [ 0.222411] active return thunk: srso_alias_return_thunk718client # [ 0.227026] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'719worker1 # [ 0.226390] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'720worker2 # [ 0.230176] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'721client # [ 0.228023] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'722worker1 # [ 0.227389] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'723lb # [ 0.224039] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'724worker2 # [ 0.231177] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256725client # [ 0.229028] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'726worker1 # [ 0.228389] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'727lb # [ 0.224410] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'728worker2 # [ 0.232874] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64729client # [ 0.230017] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'730lb # [ 0.226145] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'731worker2 # [ 0.233868] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512732worker1 # [ 0.229389] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'733lb # [ 0.227136] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'734client # [ 0.230298] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'735worker2 # [ 0.234176] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024736worker1 # [ 0.230390] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256737lb # [ 0.228140] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'738client # [ 0.232186] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256739worker1 # [ 0.231389] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64740worker2 # [ 0.235176] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8741lb # [ 0.228410] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'742client # [ 0.232997] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64743worker1 # [ 0.232389] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512744worker2 # [ 0.236176] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.745client # [ 0.233999] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512746worker1 # [ 0.233389] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024747lb # [ 0.229410] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'748client # [ 0.234993] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024749worker1 # [ 0.234389] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8750lb # [ 0.231311] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256751client # [ 0.235297] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8752lb # [ 0.232149] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64753worker1 # [ 0.235304] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.754lb # [ 0.233147] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512755client # [ 0.236297] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.756lb # [ 0.234181] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024757lb # [ 0.235191] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8758lb # [ 0.236250] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.759worker2 # [ 0.272223] Freeing SMP alternatives memory: 44K760worker2 # [ 0.272998] pid_max: default: 32768 minimum: 301761worker2 # [ 0.273853] LSM: initializing lsm=capability,landlock,yama,bpf,ima762worker2 # [ 0.274279] landlock: Up and running.763worker1 # [ 0.270829] Freeing SMP alternatives memory: 44K764worker2 # [ 0.275177] Yama: becoming mindful.765client # [ 0.272155] Freeing SMP alternatives memory: 44K766worker1 # [ 0.271393] pid_max: default: 32768 minimum: 301767worker2 # [ 0.276395] LSM support for eBPF active768client # [ 0.272852] pid_max: default: 32768 minimum: 301769worker1 # [ 0.272481] LSM: initializing lsm=capability,landlock,yama,bpf,ima770client # [ 0.273388] LSM: initializing lsm=capability,landlock,yama,bpf,ima771worker2 # [ 0.277182] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)772worker1 # [ 0.273498] landlock: Up and running.773client # [ 0.274404] landlock: Up and running.774worker1 # [ 0.274120] Yama: becoming mindful.775client # [ 0.275298] Yama: becoming mindful.776worker2 # [ 0.278218] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)777worker1 # [ 0.275010] LSM support for eBPF active778lb # [ 0.271814] Freeing SMP alternatives memory: 44K779client # [ 0.276315] LSM support for eBPF active780lb # [ 0.272413] pid_max: default: 32768 minimum: 301781worker1 # [ 0.275505] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)782client # [ 0.277100] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)783lb # [ 0.273481] LSM: initializing lsm=capability,landlock,yama,bpf,ima784worker2 # [ 0.280700] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)785worker1 # [ 0.276428] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)786lb # [ 0.274526] landlock: Up and running.787client # [ 0.278322] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)788lb # [ 0.275131] Yama: becoming mindful.789worker2 # [ 0.281731] Performance Events: Fam17h+ core perfctr, AMD PMU driver.790lb # [ 0.275627] LSM support for eBPF active791worker2 # [ 0.282182] ... version: 2792worker1 # [ 0.279308] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)793worker2 # [ 0.282864] ... bit width: 48794client # [ 0.280530] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)795lb # [ 0.276551] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)796worker2 # [ 0.283179] ... generic counters: 6797worker1 # [ 0.279929] Performance Events: Fam17h+ core perfctr, AMD PMU driver.798worker2 # [ 0.283883] ... generic bitmap: 000000000000003f799lb # [ 0.277453] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)800client # [ 0.281898] Performance Events: Fam17h+ core perfctr, AMD PMU driver.801worker1 # [ 0.280394] ... version: 2802worker2 # [ 0.284233] ... fixed-purpose counters: 0803client # [ 0.282306] ... version: 2804worker1 # [ 0.281088] ... bit width: 48805worker2 # [ 0.284937] ... fixed-purpose bitmap: 0000000000000000806client # [ 0.282996] ... bit width: 48807worker1 # [ 0.281392] ... generic counters: 6808client # [ 0.283300] ... generic counters: 6809worker2 # [ 0.285179] ... value mask: 0000ffffffffffff810lb # [ 0.280409] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)811worker1 # [ 0.282099] ... generic bitmap: 000000000000003f812client # [ 0.283997] ... generic bitmap: 000000000000003f813worker2 # [ 0.286066] ... max period: 00007fffffffffff814worker1 # [ 0.282453] ... fixed-purpose counters: 0815client # [ 0.284300] ... fixed-purpose counters: 0816worker2 # [ 0.286840] ... global_ctrl mask: 000000000000003f817worker1 # [ 0.283128] ... fixed-purpose bitmap: 0000000000000000818client # [ 0.284990] ... fixed-purpose bitmap: 0000000000000000819lb # [ 0.281487] Performance Events: Fam17h+ core perfctr, AMD PMU driver.820worker2 # [ 0.287308] signal: max sigframe size: 3376821worker1 # [ 0.283392] ... value mask: 0000ffffffffffff822lb # [ 0.282415] ... version: 2823client # [ 0.285299] ... value mask: 0000ffffffffffff824worker2 # [ 0.288104] rcu: Hierarchical SRCU implementation.825worker1 # [ 0.284244] ... max period: 00007fffffffffff826lb # [ 0.283134] ... bit width: 48827client # [ 0.286162] ... max period: 00007fffffffffff828worker2 # [ 0.288777] rcu: Max phase no-delay instances is 400.829lb # [ 0.283423] ... generic counters: 6830worker1 # [ 0.285040] ... global_ctrl mask: 000000000000003f831client # [ 0.286950] ... global_ctrl mask: 000000000000003f832worker1 # [ 0.285507] signal: max sigframe size: 3376833lb # [ 0.284100] ... generic bitmap: 000000000000003f834client # [ 0.287398] signal: max sigframe size: 3376835lb # [ 0.284413] ... fixed-purpose counters: 0836worker1 # [ 0.286291] rcu: Hierarchical SRCU implementation.837client # [ 0.288187] rcu: Hierarchical SRCU implementation.838worker1 # [ 0.286958] rcu: Max phase no-delay instances is 400.839lb # [ 0.285130] ... fixed-purpose bitmap: 0000000000000000840client # [ 0.288888] rcu: Max phase no-delay instances is 400.841lb # [ 0.285412] ... value mask: 0000ffffffffffff842lb # [ 0.286341] ... max period: 00007fffffffffff843worker2 # [ 0.293747] smp: Bringing up secondary CPUs ...844lb # [ 0.287179] ... global_ctrl mask: 000000000000003f845worker2 # [ 0.294192] smp: Brought up 1 node, 1 CPU846lb # [ 0.287531] signal: max sigframe size: 3376847worker2 # [ 0.294883] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)848lb # [ 0.288341] rcu: Hierarchical SRCU implementation.849lb # [ 0.288985] rcu: Max phase no-delay instances is 400.850worker1 # [ 0.292063] smp: Bringing up secondary CPUs ...851client # [ 0.293895] smp: Bringing up secondary CPUs ...852worker1 # [ 0.292407] smp: Brought up 1 node, 1 CPU853client # [ 0.294314] smp: Brought up 1 node, 1 CPU854worker2 # [ 0.295340] Memory: 1454572K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)855worker1 # [ 0.293051] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)856client # [ 0.294974] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)857worker2 # [ 0.296440] devtmpfs: initialized858worker2 # [ 0.297246] x86/mm: Memory block size: 128MB859worker1 # [ 0.293656] Memory: 1454548K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)860client # [ 0.295553] Memory: 1454548K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)861worker1 # [ 0.294673] devtmpfs: initialized862client # [ 0.296566] devtmpfs: initialized863worker2 # [ 0.299116] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)864lb # [ 0.294178] smp: Bringing up secondary CPUs ...865worker1 # [ 0.295500] x86/mm: Memory block size: 128MB866lb # [ 0.294429] smp: Brought up 1 node, 1 CPU867client # [ 0.297373] x86/mm: Memory block size: 128MB868worker2 # [ 0.300101] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).869lb # [ 0.295074] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)870worker2 # [ 0.301271] pinctrl core: initialized pinctrl subsystem871worker1 # [ 0.297293] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)872client # [ 0.299211] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)873worker2 # [ 0.302405] PM: RTC time: 08:16:01, date: 2026-09-20874lb # [ 0.295639] Memory: 1454572K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)875worker1 # [ 0.298318] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).876client # [ 0.300185] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).877lb # [ 0.296709] devtmpfs: initialized878worker1 # [ 0.299475] pinctrl core: initialized pinctrl subsystem879client # [ 0.301380] pinctrl core: initialized pinctrl subsystem880lb # [ 0.297559] x86/mm: Memory block size: 128MB881worker1 # [ 0.300551] PM: RTC time: 08:16:01, date: 2026-09-20882client # [ 0.302494] PM: RTC time: 08:16:01, date: 2026-09-20883worker2 # [ 0.306403] NET: Registered PF_NETLINK/PF_ROUTE protocol family884lb # [ 0.299473] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)885worker2 # [ 0.307703] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations886lb # [ 0.300439] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).887worker1 # [ 0.304474] NET: Registered PF_NETLINK/PF_ROUTE protocol family888client # [ 0.306088] NET: Registered PF_NETLINK/PF_ROUTE protocol family889worker2 # [ 0.308204] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations890lb # [ 0.301523] pinctrl core: initialized pinctrl subsystem891lb # [ 0.302590] PM: RTC time: 08:16:01, date: 2026-09-20892worker1 # [ 0.305936] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations893client # [ 0.307516] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations894worker2 # [ 0.309476] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations895worker2 # [ 0.310189] audit: initializing netlink subsys (disabled)896worker1 # [ 0.306417] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations897client # [ 0.308324] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations898worker2 # [ 0.311181] audit: type=2000 audit(1789892162.150:1): state=initialized audit_enabled=0 res=1899worker1 # [ 0.307686] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations900client # [ 0.309591] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations901worker1 # [ 0.308403] audit: initializing netlink subsys (disabled)902worker2 # [ 0.312333] thermal_sys: Registered thermal governor 'fair_share'903client # [ 0.310311] audit: initializing netlink subsys (disabled)904lb # [ 0.306347] NET: Registered PF_NETLINK/PF_ROUTE protocol family905worker2 # [ 0.312335] thermal_sys: Registered thermal governor 'bang_bang'906client # [ 0.311577] thermal_sys: Registered thermal governor 'fair_share'907worker1 # [ 0.309394] audit: type=2000 audit(1789892162.150:1): state=initialized audit_enabled=0 res=1908lb # [ 0.307640] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations909worker2 # [ 0.313180] thermal_sys: Registered thermal governor 'step_wise'910worker1 # [ 0.310548] thermal_sys: Registered thermal governor 'fair_share'911client # [ 0.311580] thermal_sys: Registered thermal governor 'bang_bang'912worker2 # [ 0.314180] thermal_sys: Registered thermal governor 'user_space'913lb # [ 0.308439] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations914worker1 # [ 0.310550] thermal_sys: Registered thermal governor 'bang_bang'915client # [ 0.312305] audit: type=2000 audit(1789892162.153:1): state=initialized audit_enabled=0 res=1916worker2 # [ 0.315109] thermal_sys: Registered thermal governor 'power_allocator'917worker1 # [ 0.311393] thermal_sys: Registered thermal governor 'step_wise'918lb # [ 0.309714] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations919worker2 # [ 0.315915] cpuidle: using governor menu920client # [ 0.314303] thermal_sys: Registered thermal governor 'step_wise'921worker1 # [ 0.312310] thermal_sys: Registered thermal governor 'user_space'922lb # [ 0.310424] audit: initializing netlink subsys (disabled)923client # [ 0.314304] thermal_sys: Registered thermal governor 'user_space'924worker2 # [ 0.317393] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5925worker1 # [ 0.313096] thermal_sys: Registered thermal governor 'power_allocator'926lb # [ 0.311592] thermal_sys: Registered thermal governor 'fair_share'927worker1 # [ 0.313406] cpuidle: using governor menu928client # [ 0.315288] thermal_sys: Registered thermal governor 'power_allocator'929lb # [ 0.311594] thermal_sys: Registered thermal governor 'bang_bang'930client # [ 0.316104] cpuidle: using governor menu931worker2 # [ 0.318459] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]932worker1 # [ 0.315616] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5933lb # [ 0.312414] thermal_sys: Registered thermal governor 'step_wise'934worker2 # [ 0.319182] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry935client # [ 0.318457] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5936worker2 # [ 0.320198] PCI: Using configuration type 1 for base access937lb # [ 0.313416] audit: type=2000 audit(1789892162.157:1): state=initialized audit_enabled=0 res=1938worker1 # [ 0.316630] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]939lb # [ 0.315415] thermal_sys: Registered thermal governor 'user_space'940worker1 # [ 0.317395] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry941client # [ 0.319626] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]942worker2 # [ 0.321295] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.943lb # [ 0.315417] thermal_sys: Registered thermal governor 'power_allocator'944worker1 # [ 0.318404] PCI: Using configuration type 1 for base access945client # [ 0.320305] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry946lb # [ 0.316393] cpuidle: using governor menu947client # [ 0.321316] PCI: Using configuration type 1 for base access948worker1 # [ 0.319504] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.949lb # [ 0.317977] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5950client # [ 0.322459] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.951lb # [ 0.318654] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]952lb # [ 0.319417] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry953lb # [ 0.320426] PCI: Using configuration type 1 for base access954worker2 # [ 0.328198] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages955worker2 # [ 0.329179] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page956lb # [ 0.321520] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.957client # [ 0.327584] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages958client # [ 0.328302] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page959worker1 # [ 0.327409] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages960worker1 # [ 0.328393] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page961worker2 # [ 0.334180] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages962worker2 # [ 0.335180] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page963client # [ 0.333302] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages964client # [ 0.334300] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page965worker1 # [ 0.333396] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages966lb # [ 0.330435] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages967worker1 # [ 0.334392] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page968lb # [ 0.331414] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page969worker1 # [ 0.340488] ACPI: Added _OSI(Module Device)970lb # [ 0.336414] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages971worker1 # [ 0.341211] ACPI: Added _OSI(Processor Device)972lb # [ 0.337413] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page973worker1 # [ 0.341955] ACPI: Added _OSI(Processor Aggregator Device)974worker2 # [ 0.346466] ACPI: Added _OSI(Module Device)975worker2 # [ 0.347158] ACPI: Added _OSI(Processor Device)976client # [ 0.344674] ACPI: Added _OSI(Module Device)977worker2 # [ 0.347700] ACPI: Added _OSI(Processor Aggregator Device)978client # [ 0.345302] ACPI: Added _OSI(Processor Device)979client # [ 0.346046] ACPI: Added _OSI(Processor Aggregator Device)980lb # [ 0.345189] ACPI: Added _OSI(Module Device)981lb # [ 0.345415] ACPI: Added _OSI(Processor Device)982worker2 # [ 0.354002] ACPI: 1 ACPI AML tables successfully acquired and loaded983lb # [ 0.346182] ACPI: Added _OSI(Processor Aggregator Device)984worker2 # [ 0.357876] ACPI: Interpreter enabled985client # [ 0.354571] ACPI: 1 ACPI AML tables successfully acquired and loaded986worker1 # [ 0.353562] ACPI: 1 ACPI AML tables successfully acquired and loaded987worker2 # [ 0.358195] ACPI: PM: (supports S0 S3 S4 S5)988worker2 # [ 0.358927] ACPI: Using IOAPIC for interrupt routing989worker1 # [ 0.355382] ACPI: Interpreter enabled990worker1 # [ 0.355894] ACPI: PM: (supports S0 S3 S4 S5)991client # [ 0.358724] ACPI: Interpreter enabled992lb # [ 0.352967] ACPI: 1 ACPI AML tables successfully acquired and loaded993client # [ 0.359316] ACPI: PM: (supports S0 S3 S4 S5)994worker2 # [ 0.361234] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug995worker1 # [ 0.358393] ACPI: Using IOAPIC for interrupt routing996client # [ 0.360049] ACPI: Using IOAPIC for interrupt routing997worker2 # [ 0.362179] PCI: Using E820 reservations for host bridge windows998worker1 # [ 0.359293] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug999client # [ 0.360353] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1000lb # [ 0.356383] ACPI: Interpreter enabled1001client # [ 0.361301] PCI: Using E820 reservations for host bridge windows1002lb # [ 0.356893] ACPI: PM: (supports S0 S3 S4 S5)1003worker2 # [ 0.365279] ACPI: Enabled 2 GPEs in block 00 to 3F1004lb # [ 0.357413] ACPI: Using IOAPIC for interrupt routing1005worker1 # [ 0.362392] PCI: Using E820 reservations for host bridge windows1006lb # [ 0.358271] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1007worker1 # [ 0.363529] ACPI: Enabled 2 GPEs in block 00 to 3F1008client # [ 0.364410] ACPI: Enabled 2 GPEs in block 00 to 3F1009lb # [ 0.363414] PCI: Using E820 reservations for host bridge windows1010lb # [ 0.364528] ACPI: Enabled 2 GPEs in block 00 to 3F1011worker2 # [ 0.373269] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1012worker2 # [ 0.374185] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1013worker2 # [ 0.375256] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1014worker1 # [ 0.372197] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1015client # [ 0.373039] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1016worker2 # [ 0.376302] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1017worker1 # [ 0.373177] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1018client # [ 0.373307] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1019worker2 # [ 0.377530] PCI host bridge to bus 0000:001020worker1 # [ 0.374475] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1021worker2 # [ 0.378185] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1022client # [ 0.375321] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1023worker1 # [ 0.375515] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1024worker2 # [ 0.379181] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1025worker1 # [ 0.376763] PCI host bridge to bus 0000:001026client # [ 0.376423] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1027worker2 # [ 0.380179] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1028lb # [ 0.372961] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1029worker1 # [ 0.377397] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1030client # [ 0.377660] PCI host bridge to bus 0000:001031worker2 # [ 0.381179] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1032lb # [ 0.373421] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1033worker1 # [ 0.378392] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1034client # [ 0.378305] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1035worker2 # [ 0.382179] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1036client # [ 0.379300] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1037lb # [ 0.374489] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1038worker1 # [ 0.379392] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1039worker2 # [ 0.383179] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1040client # [ 0.380300] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1041lb # [ 0.375534] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1042worker1 # [ 0.380392] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1043worker2 # [ 0.384194] pci_bus 0000:00: root bus resource [bus 00-ff]1044lb # [ 0.376774] PCI host bridge to bus 0000:001045client # [ 0.381310] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1046worker1 # [ 0.381392] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1047worker2 # [ 0.385180] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1048lb # [ 0.377417] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1049client # [ 0.382300] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1050worker1 # [ 0.382392] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1051lb # [ 0.378413] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1052worker1 # [ 0.383392] pci_bus 0000:00: root bus resource [bus 00-ff]1053client # [ 0.383300] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1054worker2 # [ 0.386637] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1055lb # [ 0.379413] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1056client # [ 0.384301] pci_bus 0000:00: root bus resource [bus 00-ff]1057worker1 # [ 0.384367] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1058lb # [ 0.380413] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1059client # [ 0.385323] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1060worker1 # [ 0.385865] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1061lb # [ 0.381413] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1062client # [ 0.386778] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1063lb # [ 0.382413] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1064lb # [ 0.383413] pci_bus 0000:00: root bus resource [bus 00-ff]1065lb # [ 0.384441] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1066lb # [ 0.385873] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1067worker2 # [ 0.389289] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1068worker2 # [ 0.390191] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1069worker2 # [ 0.391200] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1070worker1 # [ 0.388484] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1071worker1 # [ 0.389534] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1072client # [ 0.389492] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1073worker2 # [ 0.392521] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1074client # [ 0.390357] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1075worker1 # [ 0.390414] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1076worker2 # [ 0.393905] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1077client # [ 0.391322] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1078worker1 # [ 0.391810] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1079client # [ 0.392637] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1080worker1 # [ 0.393151] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1081lb # [ 0.388508] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1082worker2 # [ 0.397215] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1083client # [ 0.394045] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1084worker2 # [ 0.398067] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1085lb # [ 0.389472] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1086lb # [ 0.390435] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1087worker2 # [ 0.398957] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1088worker1 # [ 0.396427] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1089worker2 # [ 0.400051] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1090lb # [ 0.391764] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1091client # [ 0.397309] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1092worker1 # [ 0.397318] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1093client # [ 0.398140] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1094worker1 # [ 0.398131] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1095worker2 # [ 0.401491] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1096lb # [ 0.393201] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1097client # [ 0.399051] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1098worker1 # [ 0.398693] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1099client # [ 0.399308] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1100worker1 # [ 0.399951] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1101worker2 # [ 0.404189] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1102lb # [ 0.396447] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1103client # [ 0.400867] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1104worker2 # [ 0.405021] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1105lb # [ 0.397312] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1106worker2 # [ 0.405904] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1107lb # [ 0.398173] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1108worker1 # [ 0.402428] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1109client # [ 0.403308] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1110lb # [ 0.399419] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1111worker1 # [ 0.403344] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1112worker2 # [ 0.406760] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1113client # [ 0.404135] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1114worker1 # [ 0.404118] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1115client # [ 0.405008] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1116lb # [ 0.400917] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1117worker1 # [ 0.404937] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1118client # [ 0.405879] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1119worker2 # [ 0.410170] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1120lb # [ 0.403443] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1121worker2 # [ 0.411059] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1122lb # [ 0.404265] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1123worker2 # [ 0.411925] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1124worker1 # [ 0.407380] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1125lb # [ 0.405132] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1126worker1 # [ 0.408046] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1127client # [ 0.409174] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1128worker2 # [ 0.412742] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1129worker1 # [ 0.408414] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1130client # [ 0.409928] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1131lb # [ 0.405987] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1132client # [ 0.410322] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1133worker1 # [ 0.409977] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1134worker2 # [ 0.415142] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1135client # [ 0.411852] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1136lb # [ 0.407420] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1137worker2 # [ 0.415804] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1138lb # [ 0.408238] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1139lb # [ 0.409268] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1140worker2 # [ 0.416200] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1141client # [ 0.414320] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1142worker1 # [ 0.412429] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1143client # [ 0.415174] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1144lb # [ 0.410768] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1145worker1 # [ 0.414066] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1146worker2 # [ 0.417737] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1147worker1 # [ 0.414414] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1148client # [ 0.416029] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1149worker2 # [ 0.419987] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1150worker1 # [ 0.415984] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1151client # [ 0.416851] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1152worker2 # [ 0.420810] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1153lb # [ 0.413424] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1154worker2 # [ 0.421202] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1155lb # [ 0.414420] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1156worker1 # [ 0.418272] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1157client # [ 0.419185] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1158lb # [ 0.415336] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1159worker1 # [ 0.419012] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1160client # [ 0.419926] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1161worker2 # [ 0.422791] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1162worker1 # [ 0.419413] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1163client # [ 0.420322] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1164lb # [ 0.416762] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1165client # [ 0.421895] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1166worker2 # [ 0.425198] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1167worker1 # [ 0.421754] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1168lb # [ 0.419288] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1169worker2 # [ 0.426056] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1170lb # [ 0.420117] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1171worker2 # [ 0.426962] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1172lb # [ 0.420443] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1173worker1 # [ 0.424376] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1174client # [ 0.424340] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1175worker1 # [ 0.425083] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1176worker2 # [ 0.428638] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1177client # [ 0.425210] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1178lb # [ 0.422001] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1179worker1 # [ 0.425414] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1180client # [ 0.426047] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1181worker2 # [ 0.430187] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1182worker1 # [ 0.426956] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1183client # [ 0.426974] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1184worker2 # [ 0.431023] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1185lb # [ 0.424269] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1186lb # [ 0.425076] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1187worker2 # [ 0.431903] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1188lb # [ 0.425450] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1189client # [ 0.430142] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1190worker2 # [ 0.432185] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1191client # [ 0.430968] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1192worker1 # [ 0.429687] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1193lb # [ 0.427003] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1194worker1 # [ 0.431038] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1195worker2 # [ 0.433734] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1196client # [ 0.431327] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1197worker1 # [ 0.431414] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1198client # [ 0.432308] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1199worker1 # [ 0.432397] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1200worker2 # [ 0.435192] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1201lb # [ 0.429414] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1202client # [ 0.433854] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1203worker1 # [ 0.433933] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1204worker2 # [ 0.436201] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1205lb # [ 0.430419] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1206lb # [ 0.431386] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1207worker2 # [ 0.437724] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1208client # [ 0.435333] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1209worker1 # [ 0.435404] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1210lb # [ 0.432303] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1211client # [ 0.436286] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1212worker1 # [ 0.436335] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1213lb # [ 0.433782] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1214client # [ 0.437719] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1215worker2 # [ 0.440181] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1216worker1 # [ 0.437797] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1217lb # [ 0.435426] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1218worker2 # [ 0.441186] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1219lb # [ 0.436394] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1220worker2 # [ 0.442173] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1221worker1 # [ 0.440187] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1222client # [ 0.440266] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1223worker1 # [ 0.441056] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1224client # [ 0.440986] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1225worker2 # [ 0.443747] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1226lb # [ 0.437822] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1227worker1 # [ 0.441427] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1228client # [ 0.441324] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1229worker2 # [ 0.445976] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1230worker1 # [ 0.442933] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1231lb # [ 0.439433] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1232client # [ 0.442856] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1233worker2 # [ 0.446805] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1234lb # [ 0.440248] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1235worker2 # [ 0.447201] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1236lb # [ 0.441165] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1237worker1 # [ 0.444410] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1238client # [ 0.445072] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1239client # [ 0.445307] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1240lb # [ 0.441982] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1241worker1 # [ 0.445392] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1242worker2 # [ 0.449601] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1243client # [ 0.446296] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1244worker1 # [ 0.447108] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1245worker2 # [ 0.451018] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1246lb # [ 0.444168] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1247worker1 # [ 0.447959] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1248client # [ 0.448430] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1249worker2 # [ 0.452071] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1250lb # [ 0.444420] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1251worker1 # [ 0.449241] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1252client # [ 0.450162] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1253lb # [ 0.445435] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1254worker2 # [ 0.453941] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1255worker1 # [ 0.450244] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1256client # [ 0.451341] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1257lb # [ 0.446978] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1258worker1 # [ 0.452134] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1259client # [ 0.453075] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1260lb # [ 0.448263] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1261lb # [ 0.449297] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1262lb # [ 0.451133] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1263worker2 # [ 0.454375] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1264worker2 # [ 0.457002] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1265worker1 # [ 0.452594] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1266client # [ 0.453513] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1267worker2 # [ 0.458351] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1268worker2 # [ 0.459898] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1269client # [ 0.456280] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1270lb # [ 0.451645] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1271worker2 # [ 0.460456] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1272client # [ 0.457240] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1273worker2 # [ 0.461482] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1274client # [ 0.459127] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1275worker1 # [ 0.456143] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1276worker2 # [ 0.462448] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1277worker1 # [ 0.456686] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1278client # [ 0.460375] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1279lb # [ 0.455091] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1280client # [ 0.461626] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1281lb # [ 0.455658] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1282worker1 # [ 0.458411] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1283worker2 # [ 0.464209] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1284worker2 # [ 0.465186] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1285client # [ 0.462588] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1286worker1 # [ 0.459590] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1287lb # [ 0.457421] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1288worker2 # [ 0.466423] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1289worker1 # [ 0.460703] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1290lb # [ 0.458668] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1291client # [ 0.465035] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1292worker2 # [ 0.467991] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1293worker1 # [ 0.461650] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1294lb # [ 0.459698] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1295client # [ 0.465310] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1296lb # [ 0.460691] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1297client # [ 0.466626] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1298worker1 # [ 0.464392] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1299client # [ 0.468070] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1300worker2 # [ 0.471813] ACPI: PCI: Interrupt link LNKA configured for IRQ 101301worker1 # [ 0.465287] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1302lb # [ 0.463206] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1303worker2 # [ 0.472292] ACPI: PCI: Interrupt link LNKB configured for IRQ 101304lb # [ 0.464107] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1305worker1 # [ 0.466419] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1306worker2 # [ 0.473282] ACPI: PCI: Interrupt link LNKC configured for IRQ 111307lb # [ 0.464755] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1308worker2 # [ 0.474285] ACPI: PCI: Interrupt link LNKD configured for IRQ 111309worker1 # [ 0.468420] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1310worker2 # [ 0.475277] ACPI: PCI: Interrupt link LNKE configured for IRQ 101311client # [ 0.471566] ACPI: PCI: Interrupt link LNKA configured for IRQ 101312lb # [ 0.466441] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1313worker2 # [ 0.476281] ACPI: PCI: Interrupt link LNKF configured for IRQ 101314client # [ 0.472413] ACPI: PCI: Interrupt link LNKB configured for IRQ 101315worker2 # [ 0.477279] ACPI: PCI: Interrupt link LNKG configured for IRQ 111316client # [ 0.473427] ACPI: PCI: Interrupt link LNKC configured for IRQ 111317worker2 # [ 0.478285] ACPI: PCI: Interrupt link LNKH configured for IRQ 111318client # [ 0.474409] ACPI: PCI: Interrupt link LNKD configured for IRQ 111319worker1 # [ 0.472473] ACPI: PCI: Interrupt link LNKA configured for IRQ 101320worker2 # [ 0.479215] ACPI: PCI: Interrupt link GSIA configured for IRQ 161321client # [ 0.475405] ACPI: PCI: Interrupt link LNKE configured for IRQ 101322worker1 # [ 0.473508] ACPI: PCI: Interrupt link LNKB configured for IRQ 101323lb # [ 0.470357] ACPI: PCI: Interrupt link LNKA configured for IRQ 101324worker2 # [ 0.480198] ACPI: PCI: Interrupt link GSIB configured for IRQ 171325worker1 # [ 0.474493] ACPI: PCI: Interrupt link LNKC configured for IRQ 111326client # [ 0.476425] ACPI: PCI: Interrupt link LNKF configured for IRQ 101327worker2 # [ 0.481143] ACPI: PCI: Interrupt link GSIC configured for IRQ 181328lb # [ 0.471303] ACPI: PCI: Interrupt link LNKB configured for IRQ 101329worker1 # [ 0.475502] ACPI: PCI: Interrupt link LNKD configured for IRQ 111330client # [ 0.477415] ACPI: PCI: Interrupt link LNKG configured for IRQ 111331worker2 # [ 0.481889] ACPI: PCI: Interrupt link GSID configured for IRQ 191332lb # [ 0.472222] ACPI: PCI: Interrupt link LNKC configured for IRQ 111333worker1 # [ 0.476491] ACPI: PCI: Interrupt link LNKE configured for IRQ 101334client # [ 0.478416] ACPI: PCI: Interrupt link LNKH configured for IRQ 111335worker2 # [ 0.482197] ACPI: PCI: Interrupt link GSIE configured for IRQ 201336lb # [ 0.473237] ACPI: PCI: Interrupt link LNKD configured for IRQ 111337worker1 # [ 0.477502] ACPI: PCI: Interrupt link LNKF configured for IRQ 101338client # [ 0.479339] ACPI: PCI: Interrupt link GSIA configured for IRQ 161339worker2 # [ 0.483191] ACPI: PCI: Interrupt link GSIF configured for IRQ 211340lb # [ 0.474216] ACPI: PCI: Interrupt link LNKE configured for IRQ 101341worker1 # [ 0.478496] ACPI: PCI: Interrupt link LNKG configured for IRQ 111342worker2 # [ 0.484114] ACPI: PCI: Interrupt link GSIG configured for IRQ 221343client # [ 0.480320] ACPI: PCI: Interrupt link GSIB configured for IRQ 171344lb # [ 0.475250] ACPI: PCI: Interrupt link LNKF configured for IRQ 101345worker1 # [ 0.479490] ACPI: PCI: Interrupt link LNKH configured for IRQ 111346worker2 # [ 0.484886] ACPI: PCI: Interrupt link GSIH configured for IRQ 231347client # [ 0.481315] ACPI: PCI: Interrupt link GSIC configured for IRQ 181348lb # [ 0.476223] ACPI: PCI: Interrupt link LNKG configured for IRQ 111349worker1 # [ 0.480426] ACPI: PCI: Interrupt link GSIA configured for IRQ 161350client # [ 0.482312] ACPI: PCI: Interrupt link GSID configured for IRQ 191351lb # [ 0.477238] ACPI: PCI: Interrupt link LNKH configured for IRQ 111352worker1 # [ 0.481395] ACPI: PCI: Interrupt link GSIB configured for IRQ 171353worker2 # [ 0.486315] iommu: Default domain type: Translated1354client # [ 0.483319] ACPI: PCI: Interrupt link GSIE configured for IRQ 201355lb # [ 0.478182] ACPI: PCI: Interrupt link GSIA configured for IRQ 161356worker2 # [ 0.487070] iommu: DMA domain TLB invalidation policy: lazy mode1357client # [ 0.484268] ACPI: PCI: Interrupt link GSIF configured for IRQ 211358worker1 # [ 0.482322] ACPI: PCI: Interrupt link GSIC configured for IRQ 181359lb # [ 0.478425] ACPI: PCI: Interrupt link GSIB configured for IRQ 171360worker2 # [ 0.488171] ACPI: bus type USB registered1361client # [ 0.485028] ACPI: PCI: Interrupt link GSIG configured for IRQ 221362worker1 # [ 0.483236] ACPI: PCI: Interrupt link GSID configured for IRQ 191363lb # [ 0.479425] ACPI: PCI: Interrupt link GSIC configured for IRQ 181364worker2 # [ 0.488917] usbcore: registered new interface driver usbfs1365worker1 # [ 0.484162] ACPI: PCI: Interrupt link GSIE configured for IRQ 201366client # [ 0.485312] ACPI: PCI: Interrupt link GSIH configured for IRQ 231367worker2 # [ 0.489191] usbcore: registered new interface driver hub1368lb # [ 0.480442] ACPI: PCI: Interrupt link GSID configured for IRQ 191369worker1 # [ 0.484407] ACPI: PCI: Interrupt link GSIF configured for IRQ 211370worker2 # [ 0.490053] usbcore: registered new device driver usb1371lb # [ 0.481377] ACPI: PCI: Interrupt link GSIE configured for IRQ 201372client # [ 0.487353] iommu: Default domain type: Translated1373worker1 # [ 0.485398] ACPI: PCI: Interrupt link GSIG configured for IRQ 221374lb # [ 0.482151] ACPI: PCI: Interrupt link GSIF configured for IRQ 211375client # [ 0.488153] iommu: DMA domain TLB invalidation policy: lazy mode1376worker1 # [ 0.486374] ACPI: PCI: Interrupt link GSIH configured for IRQ 231377worker2 # [ 0.491756] NetLabel: Initializing1378lb # [ 0.482429] ACPI: PCI: Interrupt link GSIG configured for IRQ 221379client # [ 0.489289] ACPI: bus type USB registered1380worker2 # [ 0.492185] NetLabel: domain hash size = 1281381lb # [ 0.483394] ACPI: PCI: Interrupt link GSIH configured for IRQ 231382client # [ 0.489834] usbcore: registered new interface driver usbfs1383worker2 # [ 0.492957] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1384worker1 # [ 0.488294] iommu: Default domain type: Translated1385client # [ 0.490313] usbcore: registered new interface driver hub1386worker2 # [ 0.493280] NetLabel: unlabeled traffic allowed by default1387worker1 # [ 0.489005] iommu: DMA domain TLB invalidation policy: lazy mode1388lb # [ 0.485269] iommu: Default domain type: Translated1389client # [ 0.491168] usbcore: registered new device driver usb1390worker2 # [ 0.494192] PCI: Using ACPI for IRQ routing1391worker1 # [ 0.489671] ACPI: bus type USB registered1392lb # [ 0.486005] iommu: DMA domain TLB invalidation policy: lazy mode1393worker1 # [ 0.490427] usbcore: registered new interface driver usbfs1394client # [ 0.492902] NetLabel: Initializing1395lb # [ 0.486695] ACPI: bus type USB registered1396worker1 # [ 0.491366] usbcore: registered new interface driver hub1397lb # [ 0.487462] usbcore: registered new interface driver usbfs1398worker1 # [ 0.492084] usbcore: registered new device driver usb1399lb # [ 0.488422] usbcore: registered new interface driver hub1400client # [ 0.493307] NetLabel: domain hash size = 1281401lb # [ 0.489347] usbcore: registered new device driver usb1402worker1 # [ 0.493306] NetLabel: Initializing1403client # [ 0.494310] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1404worker1 # [ 0.493829] NetLabel: domain hash size = 1281405lb # [ 0.491065] NetLabel: Initializing1406client # [ 0.495406] NetLabel: unlabeled traffic allowed by default1407client # [ 0.496278] PCI: Using ACPI for IRQ routing1408lb # [ 0.491420] NetLabel: domain hash size = 1281409lb # [ 0.492163] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1410worker1 # [ 0.494392] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1411lb # [ 0.492504] NetLabel: unlabeled traffic allowed by default1412worker1 # [ 0.495459] NetLabel: unlabeled traffic allowed by default1413lb # [ 0.493425] PCI: Using ACPI for IRQ routing1414worker1 # [ 0.496406] PCI: Using ACPI for IRQ routing1415worker2 # [ 0.538775] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416worker2 # [ 0.539175] pci 0000:00:01.0: vgaarb: bridge control possible1417worker2 # [ 0.539175] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418worker2 # [ 0.539184] vgaarb: loaded1419worker2 # [ 0.539960] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420worker2 # [ 0.540179] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421client # [ 0.542381] pci 0000:00:01.0: vgaarb: setting as boot VGA device1422worker1 # [ 0.540377] pci 0000:00:01.0: vgaarb: setting as boot VGA device1423client # [ 0.543296] pci 0000:00:01.0: vgaarb: bridge control possible1424worker1 # [ 0.540388] pci 0000:00:01.0: vgaarb: bridge control possible1425worker2 # [ 0.543274] clocksource: Switched to clocksource kvm-clock1426lb # [ 0.538266] pci 0000:00:01.0: vgaarb: setting as boot VGA device1427client # [ 0.543296] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1428client # [ 0.543304] vgaarb: loaded1429worker1 # [ 0.540388] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1430lb # [ 0.538409] pci 0000:00:01.0: vgaarb: bridge control possible1431worker1 # [ 0.540396] vgaarb: loaded1432client # [ 0.544078] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01433worker1 # [ 0.541138] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01434lb # [ 0.538409] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1435client # [ 0.544302] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1436lb # [ 0.538418] vgaarb: loaded1437worker1 # [ 0.541392] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1438worker2 # [ 0.547132] VFS: Disk quotas dquot_6.6.01439lb # [ 0.539187] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01440worker2 # [ 0.547891] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1441lb # [ 0.539414] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1442worker2 # [ 0.549284] pnp: PnP ACPI init1443worker2 # [ 0.550115] ACPI: IRQ 4 override to edge(!), high(!)1444worker1 # [ 0.544491] clocksource: Switched to clocksource kvm-clock1445client # [ 0.548395] clocksource: Switched to clocksource kvm-clock1446worker2 # [ 0.551179] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1447worker2 # [ 0.552737] pnp: PnP ACPI: found 6 devices1448lb # [ 0.544508] clocksource: Switched to clocksource kvm-clock1449worker1 # [ 0.548090] VFS: Disk quotas dquot_6.6.01450client # [ 0.552030] VFS: Disk quotas dquot_6.6.01451lb # [ 0.546270] VFS: Disk quotas dquot_6.6.01452worker1 # [ 0.548835] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1453client # [ 0.552756] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1454worker1 # [ 0.550223] pnp: PnP ACPI init1455client # [ 0.554069] pnp: PnP ACPI init1456worker1 # [ 0.551079] ACPI: IRQ 4 override to edge(!), high(!)1457client # [ 0.554884] ACPI: IRQ 4 override to edge(!), high(!)1458lb # [ 0.548895] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1459worker1 # [ 0.552074] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1460client # [ 0.555843] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1461lb # [ 0.550344] pnp: PnP ACPI init1462worker1 # [ 0.553603] pnp: PnP ACPI: found 6 devices1463client # [ 0.557407] pnp: PnP ACPI: found 6 devices1464lb # [ 0.551210] ACPI: IRQ 4 override to edge(!), high(!)1465worker2 # [ 0.560465] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1466lb # [ 0.552206] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1467worker2 # [ 0.562012] clocksource: Switched to clocksource acpi_pm1468worker2 # [ 0.563020] NET: Registered PF_INET protocol family1469lb # [ 0.553822] pnp: PnP ACPI: found 6 devices1470worker2 # [ 0.564275] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1471worker1 # [ 0.561297] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1472client # [ 0.565184] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1473worker1 # [ 0.562771] clocksource: Switched to clocksource acpi_pm1474client # [ 0.566650] clocksource: Switched to clocksource acpi_pm1475worker1 # [ 0.563765] NET: Registered PF_INET protocol family1476client # [ 0.567612] NET: Registered PF_INET protocol family1477lb # [ 0.561571] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1478worker1 # [ 0.564998] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1479client # [ 0.568817] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1480lb # [ 0.563049] clocksource: Switched to clocksource acpi_pm1481lb # [ 0.564034] NET: Registered PF_INET protocol family1482lb # [ 0.565265] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1483worker2 # [ 0.581334] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1484worker2 # [ 0.582981] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1485worker2 # [ 0.584365] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1486worker2 # [ 0.585761] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1487worker2 # [ 0.587047] TCP: Hash tables configured (established 16384 bind 16384)1488worker2 # [ 0.588218] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1489worker1 # [ 0.582244] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1490client # [ 0.585835] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1491worker2 # [ 0.589503] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1492worker1 # [ 0.583774] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1493worker2 # [ 0.590556] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1494client # [ 0.587447] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1495worker2 # [ 0.591779] NET: Registered PF_UNIX/PF_LOCAL protocol family1496worker1 # [ 0.585089] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1497lb # [ 0.582257] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1498client # [ 0.588774] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1499worker2 # [ 0.592716] NET: Registered PF_XDP protocol family1500worker1 # [ 0.586388] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1501client # [ 0.590049] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1502lb # [ 0.583759] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1503worker2 # [ 0.593516] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1504worker1 # [ 0.587596] TCP: Hash tables configured (established 16384 bind 16384)1505client # [ 0.591244] TCP: Hash tables configured (established 16384 bind 16384)1506worker2 # [ 0.594503] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1507lb # [ 0.585007] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1508worker1 # [ 0.588678] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1509client # [ 0.592332] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1510worker2 # [ 0.595491] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1511lb # [ 0.586295] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1512worker1 # [ 0.589912] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1513client # [ 0.593570] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1514worker2 # [ 0.596548] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1515lb # [ 0.587541] TCP: Hash tables configured (established 16384 bind 16384)1516worker1 # [ 0.590967] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1517worker2 # [ 0.597632] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1518client # [ 0.594622] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1519lb # [ 0.588610] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1520worker1 # [ 0.592125] NET: Registered PF_UNIX/PF_LOCAL protocol family1521client # [ 0.595806] NET: Registered PF_UNIX/PF_LOCAL protocol family1522worker2 # [ 0.598688] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1523lb # [ 0.589835] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1524worker1 # [ 0.593050] NET: Registered PF_XDP protocol family1525client # [ 0.596735] NET: Registered PF_XDP protocol family1526worker2 # [ 0.600389] ACPI: \_SB_.GSIA: Enabled at IRQ 161527lb # [ 0.590878] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1528worker1 # [ 0.593891] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1529client # [ 0.597547] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1530worker1 # [ 0.594843] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1531lb # [ 0.592063] NET: Registered PF_UNIX/PF_LOCAL protocol family1532client # [ 0.598527] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1533lb # [ 0.593063] NET: Registered PF_XDP protocol family1534worker1 # [ 0.595841] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1535client # [ 0.599513] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1536worker2 # [ 0.603127] ACPI: \_SB_.GSIB: Enabled at IRQ 171537lb # [ 0.593916] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1538worker1 # [ 0.596947] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1539client # [ 0.600585] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1540lb # [ 0.594905] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1541worker1 # [ 0.598029] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1542client # [ 0.601693] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1543worker2 # [ 0.605040] ACPI: \_SB_.GSIC: Enabled at IRQ 181544lb # [ 0.595880] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1545worker1 # [ 0.599129] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1546client # [ 0.602837] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1547lb # [ 0.596947] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1548worker2 # [ 0.607046] ACPI: \_SB_.GSID: Enabled at IRQ 191549worker1 # [ 0.600879] ACPI: \_SB_.GSIA: Enabled at IRQ 161550lb # [ 0.598044] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1551client # [ 0.604726] ACPI: \_SB_.GSIA: Enabled at IRQ 161552worker2 # [ 0.608768] PCI: CLS 0 bytes, default 641553lb # [ 0.599130] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1554worker2 # [ 0.609769] Trying to unpack rootfs image as initramfs...1555worker1 # [ 0.603505] ACPI: \_SB_.GSIB: Enabled at IRQ 171556lb # [ 0.600887] ACPI: \_SB_.GSIA: Enabled at IRQ 161557client # [ 0.607795] ACPI: \_SB_.GSIB: Enabled at IRQ 171558worker1 # [ 0.605480] ACPI: \_SB_.GSIC: Enabled at IRQ 181559client # [ 0.609724] ACPI: \_SB_.GSIC: Enabled at IRQ 181560lb # [ 0.603693] ACPI: \_SB_.GSIB: Enabled at IRQ 171561worker1 # [ 0.607472] ACPI: \_SB_.GSID: Enabled at IRQ 191562client # [ 0.611676] ACPI: \_SB_.GSID: Enabled at IRQ 191563lb # [ 0.605640] ACPI: \_SB_.GSIC: Enabled at IRQ 181564worker2 # [ 0.614123] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1565worker1 # [ 0.609237] PCI: CLS 0 bytes, default 641566client # [ 0.613330] PCI: CLS 0 bytes, default 641567lb # [ 0.607922] ACPI: \_SB_.GSID: Enabled at IRQ 191568worker1 # [ 0.610129] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1569client # [ 0.614233] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1570worker1 # [ 0.611902] Trying to unpack rootfs image as initramfs...1571lb # [ 0.609649] PCI: CLS 0 bytes, default 641572client # [ 0.615980] Trying to unpack rootfs image as initramfs...1573lb # [ 0.610570] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1574lb # [ 0.612391] Trying to unpack rootfs image as initramfs...1575worker2 # [ 0.655098] Initialise system trusted keyrings1576worker2 # [ 0.657702] workingset: timestamp_bits=40 max_order=19 bucket_order=01577worker1 # [ 0.656311] Initialise system trusted keyrings1578client # [ 0.660861] Initialise system trusted keyrings1579worker1 # [ 0.659935] workingset: timestamp_bits=40 max_order=19 bucket_order=01580lb # [ 0.657872] Initialise system trusted keyrings1581client # [ 0.664448] workingset: timestamp_bits=40 max_order=19 bucket_order=01582lb # [ 0.661473] workingset: timestamp_bits=40 max_order=19 bucket_order=01583worker2 # [ 0.680879] Key type asymmetric registered1584worker2 # [ 0.681678] Asymmetric key parser 'x509' registered1585worker2 # [ 0.682554] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1586worker1 # [ 0.679150] Key type asymmetric registered1587worker2 # [ 0.685777] io scheduler mq-deadline registered1588worker2 # [ 0.686539] io scheduler kyber registered1589worker1 # [ 0.681883] Asymmetric key parser 'x509' registered1590client # [ 0.685698] Key type asymmetric registered1591client # [ 0.686439] Asymmetric key parser 'x509' registered1592worker1 # [ 0.682762] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1593client # [ 0.687303] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1594worker2 # [ 0.690671] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1595lb # [ 0.682976] Key type asymmetric registered1596worker2 # [ 0.691964] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1597worker1 # [ 0.688014] io scheduler mq-deadline registered1598lb # [ 0.685443] Asymmetric key parser 'x509' registered1599worker1 # [ 0.688797] io scheduler kyber registered1600client # [ 0.692578] io scheduler mq-deadline registered1601lb # [ 0.686349] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1602client # [ 0.693358] io scheduler kyber registered1603worker2 # [ 0.697815] Linux agpgart interface v0.1031604worker1 # [ 0.691455] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1605worker2 # [ 0.698576] ACPI: bus type drm_connector registered1606lb # [ 0.689547] io scheduler mq-deadline registered1607client # [ 0.696054] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1608lb # [ 0.690293] io scheduler kyber registered1609worker1 # [ 0.692788] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1610client # [ 0.697314] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1611worker2 # [ 0.701959] usbcore: registered new interface driver usbserial_generic1612worker2 # [ 0.703057] usbserial: USB Serial support registered for generic1613lb # [ 0.694618] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1614worker1 # [ 0.698610] Linux agpgart interface v0.1031615lb # [ 0.695950] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1616worker1 # [ 0.699448] ACPI: bus type drm_connector registered1617client # [ 0.703187] Linux agpgart interface v0.1031618client # [ 0.704000] ACPI: bus type drm_connector registered1619worker2 # [ 0.706697] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1620worker2 # [ 0.706697] Please enable it if your BIOS has the CPPC option.1621worker1 # [ 0.702384] usbcore: registered new interface driver usbserial_generic1622worker2 # [ 0.708996] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1623client # [ 0.706886] usbcore: registered new interface driver usbserial_generic1624worker1 # [ 0.703478] usbserial: USB Serial support registered for generic1625lb # [ 0.701208] Linux agpgart interface v0.1031626client # [ 0.707956] usbserial: USB Serial support registered for generic1627lb # [ 0.701980] ACPI: bus type drm_connector registered1628worker2 # [ 0.712819] drop_monitor: Initializing network drop monitor service1629worker2 # [ 0.713997] NET: Registered PF_INET6 protocol family1630worker1 # [ 0.706895] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1631lb # [ 0.704918] usbcore: registered new interface driver usbserial_generic1632worker1 # [ 0.706895] Please enable it if your BIOS has the CPPC option.1633client # [ 0.711412] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1634lb # [ 0.705956] usbserial: USB Serial support registered for generic1635client # [ 0.711412] Please enable it if your BIOS has the CPPC option.1636worker1 # [ 0.709094] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1637client # [ 0.713597] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1638worker2 # [ 0.717150] Segment Routing with IPv61639lb # [ 0.709431] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1640worker2 # [ 0.719664] In-situ OAM (IOAM) with IPv61641worker1 # [ 0.713032] drop_monitor: Initializing network drop monitor service1642lb # [ 0.709431] Please enable it if your BIOS has the CPPC option.1643worker2 # [ 0.720753] IPI shorthand broadcast: enabled1644worker1 # [ 0.714244] NET: Registered PF_INET6 protocol family1645client # [ 0.717560] drop_monitor: Initializing network drop monitor service1646lb # [ 0.711550] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1647client # [ 0.718774] NET: Registered PF_INET6 protocol family1648worker1 # [ 0.718204] Segment Routing with IPv61649client # [ 0.721929] Segment Routing with IPv61650lb # [ 0.715562] drop_monitor: Initializing network drop monitor service1651worker1 # [ 0.718921] In-situ OAM (IOAM) with IPv61652lb # [ 0.716736] NET: Registered PF_INET6 protocol family1653client # [ 0.724430] In-situ OAM (IOAM) with IPv61654client # [ 0.725571] IPI shorthand broadcast: enabled1655worker1 # [ 0.722222] IPI shorthand broadcast: enabled1656lb # [ 0.719981] Segment Routing with IPv61657worker2 # [ 0.729190] sched_clock: Marking stable (597015011, 131607147)->(803203654, -74581496)1658lb # [ 0.722442] In-situ OAM (IOAM) with IPv61659lb # [ 0.723510] IPI shorthand broadcast: enabled1660worker2 # [ 0.734803] registered taskstats version 11661worker2 # [ 0.735817] Loading compiled-in X.509 certificates1662worker1 # [ 0.728895] sched_clock: Marking stable (596014249, 132848986)->(806921815, -78058580)1663client # [ 0.733961] sched_clock: Marking stable (600013715, 133374293)->(807683821, -74295813)1664worker1 # [ 0.733092] registered taskstats version 11665worker1 # [ 0.734111] Loading compiled-in X.509 certificates1666lb # [ 0.731865] sched_clock: Marking stable (599014236, 132398653)->(807830031, -76417142)1667client # [ 0.739751] registered taskstats version 11668client # [ 0.740738] Loading compiled-in X.509 certificates1669lb # [ 0.736656] registered taskstats version 11670lb # [ 0.737632] Loading compiled-in X.509 certificates1671worker2 # [ 0.754632] Demotion targets for Node 0: null1672worker2 # [ 0.755565] Key type .fscrypt registered1673worker2 # [ 0.757640] Key type fscrypt-provisioning registered1674worker2 # [ 0.758602] ima: No TPM chip found, activating TPM-bypass!1675worker1 # [ 0.752647] Demotion targets for Node 0: null1676worker2 # [ 0.759537] ima: Allocated hash algorithm: sha11677worker1 # [ 0.755925] Key type .fscrypt registered1678client # [ 0.759400] Demotion targets for Node 0: null1679worker1 # [ 0.756613] Key type fscrypt-provisioning registered1680client # [ 0.760353] Key type .fscrypt registered1681worker2 # [ 0.763677] ima: No architecture policies found1682worker1 # [ 0.757597] ima: No TPM chip found, activating TPM-bypass!1683worker2 # [ 0.764716] PM: Magic number: 10:89:2711684client # [ 0.762410] Key type fscrypt-provisioning registered1685lb # [ 0.756434] Demotion targets for Node 0: null1686worker1 # [ 0.759876] ima: Allocated hash algorithm: sha11687client # [ 0.763359] ima: No TPM chip found, activating TPM-bypass!1688lb # [ 0.757318] Key type .fscrypt registered1689worker2 # [ 0.766429] RAS: Correctable Errors collector initialized.1690worker1 # [ 0.760646] ima: No architecture policies found1691client # [ 0.764265] ima: Allocated hash algorithm: sha11692lb # [ 0.757985] Key type fscrypt-provisioning registered1693lb # [ 0.760541] ima: No TPM chip found, activating TPM-bypass!1694lb # [ 0.761476] ima: Allocated hash algorithm: sha11695worker1 # [ 0.764895] PM: Magic number: 10:89:2711696client # [ 0.768441] ima: No architecture policies found1697lb # [ 0.762234] ima: No architecture policies found1698client # [ 0.769467] PM: Magic number: 10:89:2711699worker1 # [ 0.766671] RAS: Correctable Errors collector initialized.1700client # [ 0.771179] RAS: Correctable Errors collector initialized.1701worker2 # [ 0.775430] clk: Disabling unused clocks1702lb # [ 0.766628] PM: Magic number: 10:89:2711703worker2 # [ 0.777634] PM: genpd: Disabling unused power domains1704lb # [ 0.768287] RAS: Correctable Errors collector initialized.1705worker1 # [ 0.775652] clk: Disabling unused clocks1706client # [ 0.780277] clk: Disabling unused clocks1707worker1 # [ 0.777884] PM: genpd: Disabling unused power domains1708lb # [ 0.776136] clk: Disabling unused clocks1709client # [ 0.784408] PM: genpd: Disabling unused power domains1710lb # [ 0.778427] PM: genpd: Disabling unused power domains1711worker2 # [ 0.960472] Freeing initrd memory: 29092K1712lb # [ 0.952467] Freeing initrd memory: 29092K1713worker2 # [ 0.963946] Freeing unused decrypted memory: 2028K1714lb # [ 0.955729] Freeing unused decrypted memory: 2028K1715worker1 # [ 0.959306] Freeing initrd memory: 29092K1716worker2 # [ 0.966678] Freeing unused kernel image (initmem) memory: 3644K1717worker2 # [ 0.967751] Write protecting the kernel read-only data: 32768k1718lb # [ 0.958436] Freeing unused kernel image (initmem) memory: 3644K1719lb # [ 0.959501] Write protecting the kernel read-only data: 32768k1720worker1 # [ 0.962605] Freeing unused decrypted memory: 2028K1721worker2 # [ 0.969625] Freeing unused kernel image (text/rodata gap) memory: 1208K1722lb # [ 0.961387] Freeing unused kernel image (text/rodata gap) memory: 1208K1723worker2 # [ 0.971136] Freeing unused kernel image (rodata/data gap) memory: 752K1724worker1 # [ 0.965375] Freeing unused kernel image (initmem) memory: 3644K1725lb # [ 0.962885] Freeing unused kernel image (rodata/data gap) memory: 752K1726worker1 # [ 0.966502] Write protecting the kernel read-only data: 32768k1727client # [ 0.970729] Freeing initrd memory: 29096K1728worker1 # [ 0.968457] Freeing unused kernel image (text/rodata gap) memory: 1208K1729worker1 # [ 0.970061] Freeing unused kernel image (rodata/data gap) memory: 752K1730client # [ 0.974087] Freeing unused decrypted memory: 2028K1731client # [ 0.976775] Freeing unused kernel image (initmem) memory: 3644K1732client # [ 0.977838] Write protecting the kernel read-only data: 32768k1733client # [ 0.979751] Freeing unused kernel image (text/rodata gap) memory: 1208K1734client # [ 0.981268] Freeing unused kernel image (rodata/data gap) memory: 752K1735worker2 # [ 1.022176] x86/mm: Checked W+X mappings: passed, no W+X pages found.1736worker2 # [ 1.023267] Run /init as init process1737lb # [ 1.013990] x86/mm: Checked W+X mappings: passed, no W+X pages found.1738lb # [ 1.015073] Run /init as init process1739worker1 # [ 1.020991] x86/mm: Checked W+X mappings: passed, no W+X pages found.1740worker1 # [ 1.022148] Run /init as init process1741worker2 # [ 1.034510] systemd[1]: Inserted module 'autofs4'1742lb # [ 1.025751] systemd[1]: Inserted module 'autofs4'1743client # [ 1.033739] x86/mm: Checked W+X mappings: passed, no W+X pages found.1744client # [ 1.034875] Run /init as init process1745worker1 # [ 1.032904] systemd[1]: Inserted module 'autofs4'1746client # [ 1.046117] systemd[1]: Inserted module 'autofs4'1747worker2 # [ 1.051117] fuse: init (API version 7.45)1748lb # [ 1.042140] fuse: init (API version 7.45)1749worker1 # [ 1.049414] fuse: init (API version 7.45)1750worker2 # [ 1.057103] ACPI: \_SB_.GSIG: Enabled at IRQ 221751lb # [ 1.047985] ACPI: \_SB_.GSIG: Enabled at IRQ 221752worker2 # [ 1.059951] ACPI: \_SB_.GSIH: Enabled at IRQ 231753lb # [ 1.050763] ACPI: \_SB_.GSIH: Enabled at IRQ 231754worker1 # [ 1.055350] ACPI: \_SB_.GSIG: Enabled at IRQ 221755lb # [ 1.054363] ACPI: \_SB_.GSIE: Enabled at IRQ 201756worker2 # [ 1.063939] ACPI: \_SB_.GSIE: Enabled at IRQ 201757worker1 # [ 1.058126] ACPI: \_SB_.GSIH: Enabled at IRQ 231758client # [ 1.063100] fuse: init (API version 7.45)1759lb # [ 1.056965] ACPI: \_SB_.GSIF: Enabled at IRQ 211760worker2 # [ 1.066364] ACPI: \_SB_.GSIF: Enabled at IRQ 211761worker1 # [ 1.062298] ACPI: \_SB_.GSIE: Enabled at IRQ 201762worker1 # [ 1.064793] ACPI: \_SB_.GSIF: Enabled at IRQ 211763client # [ 1.069127] ACPI: \_SB_.GSIG: Enabled at IRQ 221764client # [ 1.071801] ACPI: \_SB_.GSIH: Enabled at IRQ 231765client # [ 1.076122] ACPI: \_SB_.GSIE: Enabled at IRQ 201766client # [ 1.078726] ACPI: \_SB_.GSIF: Enabled at IRQ 211767worker2 # [ 1.094756] systemd[1]: Successfully made /usr/ read-only.1768lb # [ 1.085579] systemd[1]: Successfully made /usr/ read-only.1769worker1 # [ 1.093017] systemd[1]: Successfully made /usr/ read-only.1770client # [ 1.106511] systemd[1]: Successfully made /usr/ read-only.1771lb # [ 1.421289] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772lb # [ 1.426449] systemd[1]: Detected virtualization kvm.1773lb # [ 1.427324] systemd[1]: Detected architecture x86-64.1774lb # [ 1.428214] systemd[1]: Running in initrd.1775lb # [ 1.429547] systemd[1]: Initializing machine ID from random generator.1776lb # [ 1.430719] systemd[1]: Hostname set to <lb>.1777worker2 # [ 1.431896] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778worker2 # [ 1.445566] systemd[1]: Detected virtualization kvm.1779worker1 # [ 1.429752] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1780worker2 # [ 1.447701] systemd[1]: Detected architecture x86-64.1781worker1 # [ 1.441844] systemd[1]: Detected virtualization kvm.1782worker2 # [ 1.449766] systemd[1]: Running in initrd.1783worker1 # [ 1.443983] systemd[1]: Detected architecture x86-64.1784worker1 # [ 1.446040] systemd[1]: Running in initrd.1785worker2 # [ 1.452411] systemd[1]: Initializing machine ID from random generator.1786worker2 # [ 1.455290] systemd[1]: Hostname set to <worker2>.1787worker1 # [ 1.448647] systemd[1]: Initializing machine ID from random generator.1788client # [ 1.443180] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1789worker1 # [ 1.451582] systemd[1]: Hostname set to <worker1>.1790client # [ 1.455500] systemd[1]: Detected virtualization kvm.1791client # [ 1.457692] systemd[1]: Detected architecture x86-64.1792client # [ 1.459830] systemd[1]: Running in initrd.1793client # [ 1.462532] systemd[1]: Initializing machine ID from random generator.1794client # [ 1.465561] systemd[1]: Hostname set to <client>.1795lb # [ 1.623119] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796worker1 # [ 1.664452] systemd[1]: bpf-restrict-fs: LSM BPF program attached1797lb # [ 1.663957] systemd[1]: Queued start job for default target Initrd Default Target.1798lb # [ 1.667862] systemd[1]: Created slice Slice /system/modprobe.1799worker2 # [ 1.677008] systemd[1]: bpf-restrict-fs: LSM BPF program attached1800lb # [ 1.669065] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1801lb # [ 1.670460] systemd[1]: Expecting device /dev/disk/by-label/nixos...1802lb # [ 1.671561] systemd[1]: Reached target Path Units.1803lb # [ 1.672381] systemd[1]: Reached target Slice Units.1804lb # [ 1.673248] systemd[1]: Reached target Swaps.1805lb # [ 1.674054] systemd[1]: Reached target Timer Units.1806lb # [ 1.675032] systemd[1]: Listening on D-Bus System Message Bus Socket.1807lb # [ 1.676250] systemd[1]: Listening on Journal Socket (/dev/log).1808lb # [ 1.677476] systemd[1]: Listening on Journal Sockets.1809lb # [ 1.678471] systemd[1]: Listening on udev Control Socket.1810lb # [ 1.679490] systemd[1]: Listening on udev Kernel Socket.1811lb # [ 1.680445] systemd[1]: Reached target Socket Units.1812lb # [ 1.682317] systemd[1]: Starting Create List of Static Device Nodes...1813lb # [ 1.686324] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1814client # [ 1.694262] systemd[1]: bpf-restrict-fs: LSM BPF program attached1815lb # [ 1.692493] systemd[1]: Starting Load Kernel Module configfs...1816worker1 # [ 1.705317] systemd[1]: Queued start job for default target Initrd Default Target.1817lb # [ 1.705511] systemd[1]: Starting Journal Service...1818worker1 # [ 1.709315] systemd[1]: Created slice Slice /system/modprobe.1819worker1 # [ 1.710453] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1820worker1 # [ 1.711834] systemd[1]: Expecting device /dev/disk/by-label/nixos...1821worker1 # [ 1.712908] systemd[1]: Reached target Path Units.1822worker1 # [ 1.713727] systemd[1]: Reached target Slice Units.1823worker1 # [ 1.714582] systemd[1]: Reached target Swaps.1824worker1 # [ 1.715372] systemd[1]: Reached target Timer Units.1825worker1 # [ 1.716335] systemd[1]: Listening on D-Bus System Message Bus Socket.1826worker1 # [ 1.717525] systemd[1]: Listening on Journal Socket (/dev/log).1827lb # [ 1.715499] systemd[1]: Starting Load Kernel Modules...1828worker1 # [ 1.718692] systemd[1]: Listening on Journal Sockets.1829worker1 # [ 1.719709] systemd[1]: Listening on udev Control Socket.1830worker1 # [ 1.720715] systemd[1]: Listening on udev Kernel Socket.1831worker1 # [ 1.721645] systemd[1]: Reached target Socket Units.1832worker1 # [ 1.723552] systemd[1]: Starting Create List of Static Device Nodes...1833worker2 # [ 1.732591] systemd[1]: Queued start job for default target Initrd Default Target.1834worker1 # [ 1.727933] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1835worker2 # [ 1.737152] systemd[1]: Created slice Slice /system/modprobe.1836worker2 # [ 1.738395] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1837worker2 # [ 1.739863] systemd[1]: Expecting device /dev/disk/by-label/nixos...1838worker2 # [ 1.741051] systemd[1]: Reached target Path Units.1839worker1 # [ 1.734594] systemd[1]: Starting Load Kernel Module configfs...1840worker2 # [ 1.741988] systemd[1]: Reached target Slice Units.1841worker2 # [ 1.742895] systemd[1]: Reached target Swaps.1842worker2 # [ 1.743722] systemd[1]: Reached target Timer Units.1843worker2 # [ 1.744743] systemd[1]: Listening on D-Bus System Message Bus Socket.1844lb # [ 1.724482] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1845worker2 # [ 1.745995] systemd[1]: Listening on Journal Socket (/dev/log).1846worker2 # [ 1.747224] systemd[1]: Listening on Journal Sockets.1847worker2 # [ 1.748255] systemd[1]: Listening on udev Control Socket.1848worker2 # [ 1.749340] systemd[1]: Listening on udev Kernel Socket.1849worker2 # [ 1.750320] systemd[1]: Reached target Socket Units.1850worker2 # [ 1.752381] systemd[1]: Starting Create List of Static Device Nodes...1851client # [ 1.750024] systemd[1]: Queued start job for default target Initrd Default Target.1852lb # [ 1.744982] netfs: FS-Cache loaded1853worker1 # [ 1.749094] systemd[1]: Starting Journal Service...1854worker2 # [ 1.756713] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1855client # [ 1.754864] systemd[1]: Created slice Slice /system/modprobe.1856lb # [ 1.749774] 9pnet: Installing 9P2000 support1857client # [ 1.756074] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1858client # [ 1.757616] systemd[1]: Expecting device /dev/disk/by-label/nixos...1859client # [ 1.758774] systemd[1]: Reached target Path Units.1860client # [ 1.759675] systemd[1]: Reached target Slice Units.1861client # [ 1.760575] systemd[1]: Reached target Swaps.1862client # [ 1.761453] systemd[1]: Reached target Timer Units.1863worker2 # [ 1.764706] systemd[1]: Starting Load Kernel Module configfs...1864client # [ 1.762483] systemd[1]: Listening on D-Bus System Message Bus Socket.1865lb # [ 1.757190] systemd[1]: Starting Coldplug All udev Devices...1866client # [ 1.763781] systemd[1]: Listening on Journal Socket (/dev/log).1867client # [ 1.764977] systemd[1]: Listening on Journal Sockets.1868client # [ 1.766028] systemd[1]: Listening on udev Control Socket.1869client # [ 1.767103] systemd[1]: Listening on udev Kernel Socket.1870worker1 # [ 1.763938] systemd[1]: Starting Load Kernel Modules...1871client # [ 1.768140] systemd[1]: Reached target Socket Units.1872client # [ 1.770298] systemd[1]: Starting Create List of Static Device Nodes...1873client # [ 1.774329] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1874worker2 # [ 1.780837] systemd[1]: Starting Journal Service...1875lb # [ 1.776503] systemd[1]: Finished Create List of Static Device Nodes.1876client # [ 1.783587] systemd[1]: Starting Load Kernel Module configfs...1877worker1 # [ 1.768904] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1878lb # [ 1.782090] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1879worker1 # [ 1.787305] netfs: FS-Cache loaded1880worker2 # [ 1.795726] systemd[1]: Starting Load Kernel Modules...1881worker1 # [ 1.792447] 9pnet: Installing 9P2000 support1882lb # [ 1.790825] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1883client # [ 1.799093] systemd[1]: Starting Journal Service...1884lb # [ 1.793850] systemd-journald[67]: Collecting audit messages is disabled.1885lb # [ 1.797845] systemd[1]: modprobe@configfs.service: Deactivated successfully.1886worker1 # [ 1.801964] systemd[1]: Starting Coldplug All udev Devices...1887worker2 # [ 1.799725] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1888lb # [ 1.802717] systemd[1]: Finished Load Kernel Module configfs.1889client # [ 1.812508] systemd[1]: Starting Load Kernel Modules...1890worker2 # [ 1.817284] netfs: FS-Cache loaded1891lb # [ 1.807921] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1892worker2 # [ 1.822347] 9pnet: Installing 9P2000 support1893lb # [ 1.812603] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1894worker1 # [ 1.817368] systemd[1]: Finished Create List of Static Device Nodes.1895lb # [ 1.818649] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1896lb # [ 1.821437] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1897worker1 # [ 1.824591] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1898client # [ 1.819510] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1899worker2 # [ 1.835717] systemd[1]: Starting Coldplug All udev Devices...1900worker1 # [ 1.832337] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1901client # [ 1.837035] netfs: FS-Cache loaded1902worker1 # [ 1.838529] systemd-journald[67]: Collecting audit messages is disabled.1903client # [ 1.842527] 9pnet: Installing 9P2000 support1904worker1 # [ 1.840132] systemd[1]: modprobe@configfs.service: Deactivated successfully.1905worker2 # [ 1.852929] systemd[1]: Finished Create List of Static Device Nodes.1906worker1 # [ 1.847276] systemd[1]: Finished Load Kernel Module configfs.1907client # [ 1.854478] systemd[1]: Starting Coldplug All udev Devices...1908worker1 # [ 1.850439] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1909worker2 # [ 1.858394] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1910lb # [ 1.851968] systemd[1]: Finished Load Kernel Modules.1911worker1 # [ 1.854434] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1912worker2 # [ 1.865677] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1913worker2 # [ 1.867395] systemd-journald[67]: Collecting audit messages is disabled.1914worker1 # [ 1.862084] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1915lb # [ 1.860639] systemd[1]: Starting Apply Kernel Variables...1916worker1 # [ 1.863575] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1917worker2 # [ 1.871073] systemd[1]: modprobe@configfs.service: Deactivated successfully.1918client # [ 1.871470] systemd[1]: Finished Create List of Static Device Nodes.1919client # [ 1.875067] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1920worker2 # [ 1.879996] systemd[1]: Finished Load Kernel Module configfs.1921lb # [ 1.874561] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1922worker2 # [ 1.884075] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1923client # [ 1.883801] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1924worker2 # [ 1.886576] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1925client # [ 1.888192] systemd-journald[67]: Collecting audit messages is disabled.1926client # [ 1.889882] systemd[1]: modprobe@configfs.service: Deactivated successfully.1927worker2 # [ 1.894698] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1928lb # [ 1.885834] systemd[1]: Starting Create Static Device Nodes in /dev...1929client # [ 1.894814] systemd[1]: Finished Load Kernel Module configfs.1930worker2 # [ 1.897822] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1931worker1 # [ 1.899952] systemd[1]: Finished Load Kernel Modules.1932client # [ 1.903677] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1933lb # [ 1.900542] systemd[1]: Finished Apply Kernel Variables.1934client # [ 1.906505] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1935client # [ 1.913457] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1936worker1 # [ 1.910943] systemd[1]: Starting Apply Kernel Variables...1937client # [ 1.916413] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1938lb # [ 1.782428] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.915949] systemd[1]: Started Journal Service.1939worker2 # [ 1.925204] systemd[1]: Finished Load Kernel Modules.1940lb # 1941lb # [ 1.786547] systemd-modules-load[68]: Inserted module 'virtio_balloon'1942lb # [ 1.788277] systemd-modules-load[68]: Inserted module 'virtio_gpu'1943worker1 # [ 1.924011] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1944worker2 # [ 1.932818] systemd[1]: Starting Apply Kernel Variables...1945worker1 # [ 1.934072] systemd[1]: Starting Create Static Device Nodes in /dev...1946lb # [ 1.800231] systemd[1]: Finished Create Static Device Nodes in /dev.1947lb # [ 1.801208] systemd[1]: Reached target Preparation for Local File Systems.1948lb # [ 1.802224] systemd[1]: Reached target Local File Systems.1949worker2 # [ 1.945059] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1950client # [ 1.944631] systemd[1]: Finished Load Kernel Modules.1951lb # [ 1.807093] systemd[1]: Starting Create System Files and Directories...1952lb # [ 1.812336] systemd[1]: Starting Rule-based Manager for Device Events and Files...1953client # [ 1.952619] systemd[1]: Starting Apply Kernel Variables...1954worker2 # [ 1.955822] systemd[1]: Starting Create Static Device Nodes in /dev...1955worker1 # [ 1.949992] systemd[1]: Finished Apply Kernel Variables.1956worker2 # [ 1.968215] systemd[1]: Finished Apply Kernel Variables.1957client # [ 1.965536] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1958worker1 # [ 1.969532] systemd[1]: Finished Create Static Device Nodes in /dev.1959client # [ 1.973732] systemd[1]: Starting Create Static Device Nodes in /dev...1960worker1 # [ 1.839502] systemd-modules-load[68]: Inserted module 'dm_mod'1961worker1 # [ 1.841161] systemd-modules-load[68]: Inserted module 'virtio_balloon'1962worker1 # [ 1.975349] systemd[1]: Started Journal Service.1963lb # [ 1.840296] systemd[1]: Finished Create System Files and Directories.1964worker1 # [ 1.843628] systemd-modules-load[68]: Inserted module 'virtio_gpu'1965worker2 # [ 1.984586] systemd[1]: Started Journal Service.1966worker2 # [ 1.855223] systemd-modules-load[68]: Inserted module 'dm_mod'1967worker2 # [ 1.857331] systemd-modules-load[68]: Inserted module 'virtio_balloon'1968worker2 # [ 1.859466] systemd-modules-load[68]: Inserted module 'virtio_gpu'1969worker1 # [ 1.856766] systemd[1]: Reached target Preparation for Local File Systems.1970worker2 # [ 1.865144] systemd[1]: Finished Create Static Device Nodes in /dev.1971client # [ 1.994507] systemd[1]: Finished Apply Kernel Variables.1972worker1 # [ 1.860170] systemd[1]: Reached target Local File Systems.1973worker2 # [ 1.869986] systemd[1]: Reached target Preparation for Local File Systems.1974worker1 # [ 1.863995] systemd[1]: Starting Create System Files and Directories...1975worker2 # [ 1.872777] systemd[1]: Reached target Local File Systems.1976lb # [ 1.863767] systemd-udevd[83]: Using default interface naming scheme 'v261'.1977worker2 # [ 1.874154] systemd[1]: Starting Create System Files and Directories...1978worker1 # [ 1.871070] systemd[1]: Starting Rule-based Manager for Device Events and Files...1979client # [ 2.008534] systemd[1]: Started Journal Service.1980worker2 # [ 1.882082] systemd[1]: Starting Rule-based Manager for Device Events and Files...1981client # [ 1.876153] systemd-modules-load[68]: Inserted module 'dm_mod'1982client # [ 1.878864] systemd-modules-load[68]: Inserted module 'virtio_balloon'1983client # [ 1.879938] systemd-modules-load[68]: Inserted module 'virtio_gpu'1984client # [ 1.882291] systemd[1]: Finished Create Static Device Nodes in /dev.1985client # [ 1.884364] systemd[1]: Reached target Preparation for Local File Systems.1986client # [ 1.885515] systemd[1]: Reached target Local File Systems.1987client # [ 1.889042] systemd[1]: Starting Create System Files and Directories...1988lb # [ 1.888083] systemd[1]: Started Rule-based Manager for Device Events and Files.1989client # [ 1.895192] systemd[1]: Starting Rule-based Manager for Device Events and Files...1990worker2 # [ 1.905520] systemd[1]: Finished Create System Files and Directories.1991worker1 # [ 1.898507] systemd[1]: Finished Create System Files and Directories.1992worker1 # [ 1.917367] systemd-udevd[83]: Using default interface naming scheme 'v261'.1993worker2 # [ 1.927252] systemd-udevd[83]: Using default interface naming scheme 'v261'.1994client # [ 1.928536] systemd[1]: Finished Create System Files and Directories.1995lb # [ 1.935186] systemd[1]: Finished Coldplug All udev Devices.1996lb # [ 1.936157] systemd[1]: Reached target System Initialization.1997lb # [ 1.936946] systemd[1]: Reached target Basic System.1998worker1 # [ 1.941908] systemd[1]: Started Rule-based Manager for Device Events and Files.1999worker2 # [ 1.950862] systemd[1]: Started Rule-based Manager for Device Events and Files.2000client # [ 1.951256] systemd-udevd[77]: Using default interface naming scheme 'v261'.
loading 1,748 hidden lines…
3749client # [ 10.959860] systemd[1]: Reached target User and Group Name Lookups.3750lb # [ 10.955363] systemd[1]: linger-users.service: Deactivated successfully.3751lb # [ 10.961179] systemd[1]: Finished linger-users.service.3752worker1 # [ 10.975182] systemd[1]: Started Name Service Cache Daemon (nsncd).3753worker1 # [ 10.976755] systemd[1]: Reached target Host and Network Name Lookups.3754worker1 # [ 10.979117] systemd[1]: Reached target User and Group Name Lookups.3755lb # [ 10.980684] systemd[1]: Finished Address configuration of eth1.3756worker1 # [ 10.982400] nsncd[600]: Sep 20 08:16:12.897 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3757worker1 # [ 10.988177] dbus-broker-launch[534]: Ready3758worker1 # [ 11.007563] systemd[1]: Finished resolvconf update.3759worker1 # [ 11.009674] systemd[1]: Reached target Preparation for Network.3760worker1 # [ 11.015031] systemd[1]: Starting DHCP Client...3761worker1 # [ 11.018196] systemd[1]: Starting Address configuration of eth1...3762worker1 # [ 11.021473] systemd[1]: Starting Extra networking commands....3763worker1 # [ 11.023637] systemd[1]: linger-users.service: Deactivated successfully.3764worker1 # [ 11.025404] systemd[1]: Finished linger-users.service.3765client # [ 11.083256] dhcpcd[556]: dhcpcd-10.3.2 starting3766client # [ 11.093248] dhcpcd[565]: dev: loaded udev3767client # [ 11.249180] 8021q: 802.1Q VLAN Support v1.83768lb # [ 11.131514] systemd[1]: Finished Extra networking commands..3769worker1 # [ 11.134354] network-addresses-eth1-start[630]: adding address 192.168.1.3/24... done3770lb # [ 11.136174] systemd[1]: Reached target Network.3771client # [ 11.146082] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3772lb # [ 11.141297] dhcpcd[708]: dhcpcd-10.3.2 starting3773lb # [ 11.146584] systemd[1]: Starting PostgreSQL Server...3774worker1 # [ 11.151458] network-addresses-eth1-start[630]: adding address 2001:db8:1::3/64... done3775lb # [ 11.155187] dhcpcd[774]: dev: loaded udev3776lb # [ 11.158074] systemd[1]: Starting Permit User Sessions...3777worker1 # [ 11.174356] systemd[1]: Finished Address configuration of eth1.3778lb # [ 11.193447] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3779worker1 # [ 11.198491] dhcpcd[637]: dhcpcd-10.3.2 starting3780lb # [ 11.328848] 8021q: 802.1Q VLAN Support v1.83781lb # [ 11.329295] 8021q: adding VLAN 0 to HW filter on device eth13782lb # [ 11.198857] systemd[1]: Stopped Virtual Console Setup.3783worker1 # [ 11.208751] dhcpcd[691]: dev: loaded udev3784client # [ 11.355921] cfg80211: Loading compiled-in X.509 certificates for regulatory database3785worker1 # [ 11.222302] systemd[1]: Finished Extra networking commands..3786lb # [ 11.219895] systemd[1]: Starting Virtual Console Setup...3787worker1 # [ 11.223616] systemd[1]: Reached target Network.3788worker1 # [ 11.226660] systemd[1]: Starting Permit User Sessions...3789client # [ 11.237517] systemd[1]: Finished nftables firewall.3790client # [ 11.239915] systemd[1]: Reached target Preparation for Network.3791worker1 # [ 11.371062] 8021q: 802.1Q VLAN Support v1.83792worker1 # [ 11.371555] 8021q: adding VLAN 0 to HW filter on device eth13793client # [ 11.243980] systemd[1]: Starting Address configuration of eth1...3794client # [ 11.249136] systemd[1]: Starting Extra networking commands....3795client # [ 11.388871] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3796client # [ 11.390486] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3797lb # [ 11.251816] systemd[1]: Finished Permit User Sessions.3798client # [ 11.393823] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23799client # [ 11.394662] cfg80211: failed to load regulatory.db3800worker1 # [ 11.263157] systemd[1]: Finished Permit User Sessions.3801worker1 # [ 11.268092] systemd[1]: Started Getty on tty1.3802worker1 # [ 11.270640] systemd[1]: Reached target Login Prompts.3803lb # [ 11.273545] systemd[1]: Started Getty on tty1.3804worker1 # [ 11.280626] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3805lb # [ 11.280689] systemd[1]: Reached target Login Prompts.3806lb # [ 11.329895] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3807client # [ 11.469970] 8021q: adding VLAN 0 to HW filter on device eth13808client # [ 11.473113] 8021q: adding VLAN 0 to HW filter on device eth03809worker1 # [ 11.470452] cfg80211: Loading compiled-in X.509 certificates for regulatory database3810client # [ 11.341658] dhcpcd[565]: eth0: waiting for carrier3811client # [ 11.343692] dhcpcd[565]: eth0: carrier acquired3812client # [ 11.356293] dhcpcd[565]: DUID 00:01:00:01:32:42:52:cd:52:54:00:12:34:563813client # [ 11.357432] dhcpcd[565]: eth0: IAID 00:12:34:563814client # [ 11.358427] dhcpcd[565]: eth0: adding address fe80::5054:ff:fe12:34563815client # [ 11.360417] network-addresses-eth1-start[578]: adding address 192.168.1.1/24... done3816client # [ 11.372376] network-addresses-eth1-start[578]: adding address 2001:db8:1::1/64... done3817worker1 # [ 11.508186] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3818worker1 # [ 11.509157] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3819worker1 # [ 11.512696] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23820worker1 # [ 11.513634] cfg80211: failed to load regulatory.db3821client # [ 11.387877] systemd[1]: Finished Address configuration of eth1.3822worker1 # [ 11.577325] 8021q: adding VLAN 0 to HW filter on device eth03823worker1 # [ 11.446041] dhcpcd[691]: eth0: waiting for carrier3824worker1 # [ 11.447119] dhcpcd[691]: eth0: carrier acquired3825worker1 # [ 11.457258] dhcpcd[691]: DUID 00:01:00:01:32:42:52:cd:52:54:00:12:34:563826worker1 # [ 11.458341] dhcpcd[691]: eth0: IAID 00:12:34:563827worker1 # [ 11.459116] dhcpcd[691]: eth0: adding address fe80::5054:ff:fe12:34563828lb # [ 11.660224] kvm_amd: TSC scaling supported3829lb # [ 11.661161] kvm_amd: Nested Virtualization enabled3830lb # [ 11.661947] kvm_amd: Nested Paging enabled3831lb # [ 11.662486] kvm_amd: LBR virtualization supported3832lb # [ 11.662960] kvm_amd: Virtual VMLOAD VMSAVE supported3833lb # [ 11.664104] kvm_amd: Virtual GIF supported3834lb # [ 11.664708] kvm_amd: Virtual NMI enabled3835lb # [ 11.670222] cfg80211: Loading compiled-in X.509 certificates for regulatory database3836lb # [ 11.710209] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3837lb # [ 11.712865] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3838lb # [ 11.718794] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23839lb # [ 11.719729] cfg80211: failed to load regulatory.db3840lb # [ 11.759071] EDAC MC: Ver: 3.0.03841lb # [ 11.681242] postgresql-pre-start[791]: The files belonging to this database system will be owned by user "postgres".3842lb # [ 11.683251] postgresql-pre-start[791]: This user must also own the server process.3843lb # [ 11.820668] 8021q: adding VLAN 0 to HW filter on device eth03844lb # [ 11.692088] dhcpcd[774]: eth0: waiting for carrier3845lb # [ 11.694060] dhcpcd[774]: libudev: received NULL device3846lb # [ 11.696502] dhcpcd[774]: libudev: received NULL device3847lb # [ 11.697513] dhcpcd[774]: eth0: carrier acquired3848lb # [ 11.699463] postgresql-pre-start[791]: The database cluster will be initialized with locale "en_US.UTF-8".3849lb # [ 11.701328] postgresql-pre-start[791]: The default database encoding has accordingly been set to "UTF8".3850lb # [ 11.703298] postgresql-pre-start[791]: The default text search configuration will be set to "english".3851lb # [ 11.704824] postgresql-pre-start[791]: Data page checksums are enabled.3852lb # [ 11.706884] postgresql-pre-start[791]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3853lb # [ 11.709461] postgresql-pre-start[791]: creating subdirectories ... ok3854lb # [ 11.711365] postgresql-pre-start[791]: selecting dynamic shared memory implementation ... posix3855lb # [ 11.724632] dhcpcd[774]: DUID 00:01:00:01:32:42:52:cd:52:54:00:12:34:563856lb # [ 11.726066] dhcpcd[774]: eth0: IAID 00:12:34:563857lb # [ 11.727647] dhcpcd[774]: eth0: adding address fe80::5054:ff:fe12:34563858lb # [ 11.786273] systemd-vconsole-setup[780]: Configuration of first virtual console was skipped, ignoring remaining ones.3859lb # [ 11.792155] systemd[1]: Finished Virtual Console Setup.3860lb # [ 11.817419] postgresql-pre-start[791]: selecting default "max_connections" ... 1003861client # [ 11.853487] dhcpcd[565]: eth0: soliciting a DHCP lease3862lb # [ 11.877935] postgresql-pre-start[791]: selecting default "shared_buffers" ... 128MB3863client # [ 12.020276] NET: Registered PF_PACKET protocol family3864client # [ 11.899169] dhcpcd[565]: eth0: offered 10.0.2.15 from 10.0.2.23865client # [ 11.902419] dhcpcd[565]: eth0: probing address 10.0.2.15/243866client: (finished: waiting for unit network-addresses-eth1.service, in 12.61 seconds)3867client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3868client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3869lb: waiting for unit network-addresses-eth1.service3870lb: waiting for the VM to finish booting3871lb: Guest shell says: b'Spawning backdoor root shell...\n'3872lb: connected to guest root shell3873lb: (connecting took 0.00 seconds)3874lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3875worker2 # [ 12.009403] dhcpcd[693]: eth0: soliciting an IPv6 router3876worker2 # [ 12.011561] dhcpcd[693]: eth0: Router Advertisement from fe80::23877worker2 # [ 12.013606] dhcpcd[693]: eth0: adding address fec0::5054:ff:fe12:3456/643878worker2 # [ 12.015719] dhcpcd[693]: eth0: adding route to fec0::/643879worker2 # [ 12.017596] dhcpcd[693]: eth0: adding default route via fe80::23880worker1 # [ 12.014516] dhcpcd[691]: eth0: soliciting a DHCP lease3881worker1 # [ 12.174748] NET: Registered PF_PACKET protocol family3882lb: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds)3883lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3884worker1 # [ 12.048950] dhcpcd[691]: eth0: offered 10.0.2.15 from 10.0.2.23885worker1 # [ 12.053418] dhcpcd[691]: eth0: probing address 10.0.2.15/243886lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3887worker1: waiting for unit network-addresses-eth1.service3888worker1: waiting for the VM to finish booting3889worker1: Guest shell says: b'Spawning backdoor root shell...\n'3890worker1: connected to guest root shell3891worker1: (connecting took 0.00 seconds)3892worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3893worker2 # [ 12.121598] dhcpcd[693]: eth0: soliciting a DHCP lease3894worker2 # [ 12.274778] NET: Registered PF_PACKET protocol family3895worker2 # [ 12.148764] dhcpcd[693]: eth0: offered 10.0.2.15 from 10.0.2.23896worker2 # [ 12.153951] dhcpcd[693]: eth0: probing address 10.0.2.15/243897worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds)3898worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3899worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3900worker2: waiting for unit network-addresses-eth1.service3901worker2: waiting for the VM to finish booting3902worker2: Guest shell says: b'Spawning backdoor root shell...\n'3903worker2: connected to guest root shell3904worker2: (connecting took 0.00 seconds)3905worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3906worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds)3907worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3908worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3909lb: waiting for unit niks3.service3910client # [ 12.420969] systemd[1]: Finished Extra networking commands..3911client # [ 12.423344] systemd[1]: Reached target Network.3912client # [ 12.426843] systemd[1]: Starting Permit User Sessions...3913client # [ 12.457176] systemd[1]: Finished Permit User Sessions.3914client # [ 12.461840] systemd[1]: Started Getty on tty1.3915client # [ 12.463182] systemd[1]: Reached target Login Prompts.3916lb # [ 12.688288] dhcpcd[774]: eth0: soliciting a DHCP lease3917lb # [ 12.838474] NET: Registered PF_PACKET protocol family3918lb # [ 12.711662] dhcpcd[774]: eth0: offered 10.0.2.15 from 10.0.2.23919lb # [ 12.714168] dhcpcd[774]: eth0: probing address 10.0.2.15/243920client # [ 12.748412] dhcpcd[565]: eth0: soliciting an IPv6 router3921client # [ 12.751505] dhcpcd[565]: eth0: Router Advertisement from fe80::23922client # [ 12.753667] dhcpcd[565]: eth0: adding address fec0::5054:ff:fe12:3456/643923client # [ 12.755850] dhcpcd[565]: eth0: adding route to fec0::/643924client # [ 12.757802] dhcpcd[565]: eth0: adding default route via fe80::23925lb # [ 13.017902] dhcpcd[774]: eth0: soliciting an IPv6 router3926lb # [ 13.019405] dhcpcd[774]: eth0: Router Advertisement from fe80::23927lb # [ 13.020614] dhcpcd[774]: eth0: adding address fec0::5054:ff:fe12:3456/643928lb # [ 13.021770] dhcpcd[774]: eth0: adding route to fec0::/643929lb # [ 13.022850] dhcpcd[774]: eth0: adding default route via fe80::23930worker1 # [ 13.068615] dhcpcd[691]: eth0: soliciting an IPv6 router3931worker1 # [ 13.071656] dhcpcd[691]: eth0: Router Advertisement from fe80::23932worker1 # [ 13.074283] dhcpcd[691]: eth0: adding address fec0::5054:ff:fe12:3456/643933worker1 # [ 13.076545] dhcpcd[691]: eth0: adding route to fec0::/643934worker1 # [ 13.078485] dhcpcd[691]: eth0: adding default route via fe80::23935lb # [ 13.774773] postgresql-pre-start[791]: selecting default time zone ... UTC3936lb # [ 13.778204] postgresql-pre-start[791]: creating configuration files ... ok3937lb # [ 14.012523] postgresql-pre-start[791]: running bootstrap script ... ok3938lb # [ 14.582121] postgresql-pre-start[791]: performing post-bootstrap initialization ... ok3939lb # [ 14.844677] postgresql-pre-start[791]: syncing data to disk ... ok3940lb # [ 14.846601] postgresql-pre-start[791]: initdb: warning: enabling "trust" authentication for local connections3941lb # [ 14.847836] postgresql-pre-start[791]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3942lb # [ 14.849697] postgresql-pre-start[791]: Success. You can now start the database server using:3943lb # [ 14.850719] postgresql-pre-start[791]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3944lb # [ 14.964451] postgres[876]: [876] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3945lb # [ 14.968158] postgres[876]: [876] LOG: listening on IPv6 address "::1", port 54323946lb # [ 14.969508] postgres[876]: [876] LOG: listening on IPv4 address "127.0.0.1", port 54323947lb # [ 14.971889] postgres[876]: [876] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3948lb # [ 14.985313] postgres[885]: [885] LOG: database system was shut down at 2026-09-20 08:16:16 GMT3949lb # [ 14.991145] postgres[876]: [876] LOG: database system is ready to accept connections3950lb # [ 14.997374] systemd[1]: Started PostgreSQL Server.3951lb # [ 15.003467] systemd[1]: Starting PostgreSQL Setup Scripts...3952lb # [ 15.194145] postgresql-setup-start[896]: CREATE DATABASE3953lb # [ 15.237136] postgresql-setup-start[901]: CREATE ROLE3954lb # [ 15.257666] postgresql-setup-start[903]: ALTER DATABASE3955lb # [ 15.263664] systemd[1]: Finished PostgreSQL Setup Scripts.3956lb # [ 15.265541] systemd[1]: Reached target PostgreSQL.3957client # [ 16.777747] dhcpcd[565]: eth0: leased 10.0.2.15 for 86400 seconds3958client # [ 16.780454] dhcpcd[565]: eth0: adding route to 10.0.2.0/243959client # [ 16.782747] dhcpcd[565]: eth0: adding default route via 10.0.2.23960client # [ 16.881992] systemd[1]: Started DHCP Client.3961client # [ 16.883898] systemd[1]: Reached target Multi-User System.3962client # [ 16.885977] systemd[1]: Startup finished in 905ms (kernel) + 5.135s (initrd) + 10.844s (userspace) = 16.884s.3963worker2 # [ 17.326174] dhcpcd[693]: eth0: leased 10.0.2.15 for 86400 seconds3964worker2 # [ 17.329257] dhcpcd[693]: eth0: adding route to 10.0.2.0/243965worker2 # [ 17.331410] dhcpcd[693]: eth0: adding default route via 10.0.2.23966worker1 # [ 17.421494] dhcpcd[691]: eth0: leased 10.0.2.15 for 86400 seconds3967worker1 # [ 17.424705] dhcpcd[691]: eth0: adding route to 10.0.2.0/243968worker1 # [ 17.426683] dhcpcd[691]: eth0: adding default route via 10.0.2.23969worker2 # [ 17.443504] systemd[1]: Started DHCP Client.3970worker2 # [ 17.445385] systemd[1]: Reached target Multi-User System.3971worker2 # [ 17.446335] systemd[1]: Startup finished in 895ms (kernel) + 4.141s (initrd) + 12.408s (userspace) = 17.444s.3972worker1 # [ 17.532764] systemd[1]: Started DHCP Client.3973worker1 # [ 17.534527] systemd[1]: Reached target Multi-User System.3974worker1 # [ 17.535679] systemd[1]: Startup finished in 892ms (kernel) + 5.097s (initrd) + 11.544s (userspace) = 17.534s.3975lb # [ 17.904547] dhcpcd[774]: eth0: leased 10.0.2.15 for 86400 seconds3976lb # [ 17.905964] dhcpcd[774]: eth0: adding route to 10.0.2.0/243977lb # [ 17.906840] dhcpcd[774]: eth0: adding default route via 10.0.2.23978lb # [ 18.016951] systemd[1]: Started DHCP Client.3979lb # [ 18.020101] systemd[1]: Reached target Network is Online.3980lb # [ 18.025557] systemd[1]: Started Envoy reverse proxy.3981lb # [ 18.029633] systemd[1]: Started mock-oidc.service.3982lb # [ 18.139406] mock-oidc-server[989]: Mock OIDC Server running3983lb # [ 18.140249] mock-oidc-server[989]: OIDC Address: 192.168.1.2:80803984lb # [ 18.141403] mock-oidc-server[989]: Issue Address: 0.0.0.0:80813985lb # [ 18.142404] mock-oidc-server[989]: Issuer: http://192.168.1.2:8080/oidc3986lb # [ 18.143779] mock-oidc-server[989]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3987lb # [ 18.145151] mock-oidc-server[989]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3988lb # [ 18.146721] mock-oidc-server[989]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3989lb # [ 18.631142] envoy[988]: [2026-09-20 08:16:20.305][988][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3990lb # [ 18.633235] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:469] statically linked extensions:3991lb # [ 18.634840] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3992lb # [ 18.638581] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3993lb # [ 18.640112] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3994lb # [ 18.642099] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3995lb # [ 18.643742] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3996lb # [ 18.645245] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23997lb # [ 18.646761] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3998lb # [ 18.650950] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3999lb # [ 18.665566] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4000lb # [ 18.667237] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4001lb # [ 18.669073] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4002lb # [ 18.670772] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4003lb # [ 18.673060] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4004lb # [ 18.674807] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4005lb # [ 18.681679] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84006lb # [ 18.683447] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4007lb # [ 18.685203] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4008lb # [ 18.688168] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4009lb # [ 18.690088] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4010lb # [ 18.692117] envoy[988]: [2026-09-20 08:16:20.306][988][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4011lb # [ 18.693892] envoy[988]: [2026-09-20 08:16:20.308][988][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4012lb # [ 18.695322] envoy[988]: [2026-09-20 08:16:20.308][988][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4013lb # [ 18.697445] envoy[988]: [2026-09-20 08:16:20.308][988][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4014lb # [ 18.699948] envoy[988]: [2026-09-20 08:16:20.308][988][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4015lb # [ 18.702222] envoy[988]: [2026-09-20 08:16:20.308][988][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4016lb # [ 18.705160] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4017lb # [ 18.708040] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4018lb # [ 18.710328] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4019lb # [ 18.715821] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4020lb # [ 18.717906] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24021lb # [ 18.720068] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4022lb # [ 18.722036] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4023lb # [ 18.723727] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4024lb # [ 18.727611] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4025lb # [ 18.729245] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4026lb # [ 18.731550] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4027lb # [ 18.733146] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4028lb # [ 18.735537] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4029lb # [ 18.738266] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4030lb # [ 18.740483] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4031lb # [ 18.742381] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4032lb # [ 18.744738] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4033lb # [ 18.754066] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4034lb # [ 18.759334] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4035lb # [ 18.761327] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4036lb # [ 18.766745] envoy[988]: [2026-09-20 08:16:20.310][988][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4037lb # [ 18.768623] envoy[988]: [2026-09-20 08:16:20.326][988][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4038lb # [ 18.771743] envoy[988]: [2026-09-20 08:16:20.332][988][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4039lb # [ 18.774114] envoy[988]: [2026-09-20 08:16:20.332][988][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4040lb # [ 18.775807] envoy[988]: [2026-09-20 08:16:20.332][988][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4041lb # [ 18.777580] envoy[988]: [2026-09-20 08:16:20.332][988][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4042lb # [ 18.779803] envoy[988]: [2026-09-20 08:16:20.332][988][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4043lb # [ 18.785764] envoy[988]: [2026-09-20 08:16:20.332][988][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4044lb # [ 18.787445] envoy[988]: [2026-09-20 08:16:20.332][988][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4045lb # [ 18.789143] envoy[988]: [2026-09-20 08:16:20.332][988][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4046lb # [ 18.790821] envoy[988]: [2026-09-20 08:16:20.332][988][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4047lb # [ 18.792734] envoy[988]: [2026-09-20 08:16:20.332][988][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4048lb # [ 18.794898] envoy[988]: [2026-09-20 08:16:20.332][988][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4049lb # [ 18.796808] envoy[988]: [2026-09-20 08:16:20.332][988][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4050lb # [ 18.798789] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4051lb # [ 18.804858] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4052lb # [ 18.809088] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4053lb # [ 18.811420] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4054lb # [ 18.813486] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4055lb # [ 18.815674] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4056lb # [ 18.819708] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14057lb # [ 18.821600] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4058lb # [ 18.823277] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4059lb # [ 18.825485] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4060lb # [ 18.827435] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4061lb # [ 18.829509] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4062lb # [ 18.831365] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4063lb # [ 18.842462] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4064lb # [ 18.845468] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4065lb # [ 18.847386] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4066lb # [ 18.849031] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4067lb # [ 18.851516] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4068lb # [ 18.854056] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4069lb # [ 18.859457] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts4070lb # [ 18.861966] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4071lb # [ 18.863723] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4072lb # [ 18.865210] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4073lb # [ 18.869795] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4074lb # [ 18.894389] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4075lb # [ 18.897684] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4076lb # [ 18.901113] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4077lb # [ 18.904361] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4078lb # [ 18.906874] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4079lb # [ 18.909719] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4080lb # [ 18.912221] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4081lb # [ 18.914395] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4082lb # [ 18.916259] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4083lb # [ 18.919108] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4084lb # [ 18.925597] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4085lb # [ 18.928225] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4086lb # [ 18.930234] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4087lb # [ 18.933520] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4088lb # [ 18.937153] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4089lb # [ 18.938635] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4090lb # [ 18.940227] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4091lb # [ 18.942770] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4092lb # [ 18.945174] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4093lb # [ 18.947073] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24094lb # [ 18.948788] envoy[988]: [2026-09-20 08:16:20.333][988][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4095lb # [ 18.952155] envoy[988]: [2026-09-20 08:16:20.429][988][info][main] [source/server/server.cc:531] HTTP header map info:4096lb # [ 18.953857] envoy[988]: [2026-09-20 08:16:20.472][988][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4097lb # [ 18.966665] envoy[988]: [2026-09-20 08:16:20.472][988][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4098lb # [ 18.968475] envoy[988]: [2026-09-20 08:16:20.472][988][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4099lb # [ 18.975847] envoy[988]: [2026-09-20 08:16:20.472][988][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4100lb # [ 19.020987] envoy[988]: [2026-09-20 08:16:20.696][988][info][main] [source/server/server.cc:968] runtime: {}4101lb # [ 19.028289] envoy[988]: [2026-09-20 08:16:20.704][988][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4102lb # [ 19.030661] envoy[988]: [2026-09-20 08:16:20.706][988][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014103lb # [ 19.033528] envoy[988]: [2026-09-20 08:16:20.709][988][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014104lb # [ 19.037719] envoy[988]: [2026-09-20 08:16:20.713][988][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4105lb # [ 19.039341] envoy[988]: [2026-09-20 08:16:20.715][988][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4106lb # [ 19.040868] envoy[988]: [2026-09-20 08:16:20.715][988][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4107worker1 # [ 19.097357] systemd[1]: Starting Nix worker-protocol over gRPC...4108lb # [ 19.095138] envoy[988]: [2026-09-20 08:16:20.770][988][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4109worker2 # [ 19.109994] systemd[1]: Starting Nix worker-protocol over gRPC...4110lb # [ 19.117819] envoy[988]: [2026-09-20 08:16:20.793][988][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4111lb # [ 19.120409] envoy[988]: [2026-09-20 08:16:20.796][988][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4112lb # [ 19.123411] envoy[988]: [2026-09-20 08:16:20.796][988][info][main] [source/server/server.cc:1077] starting main dispatch loop4113worker2 # [ 19.271737] nix-grpc-daemon[784]: ts=2026-09-20T08:16:21Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4114worker2 # [ 19.285520] nix-grpc-daemon[784]: ts=2026-09-20T08:16:21Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14115worker1 # [ 19.298454] nix-grpc-daemon[787]: ts=2026-09-20T08:16:21Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4116worker1 # [ 19.309417] nix-grpc-daemon[787]: ts=2026-09-20T08:16:21Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14117worker2 # [ 19.323170] nix-grpc-daemon[784]: ts=2026-09-20T08:16:21Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4118worker2 # [ 19.326572] systemd[1]: Started Nix worker-protocol over gRPC.4119worker1 # [ 19.346253] nix-grpc-daemon[787]: ts=2026-09-20T08:16:21Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4120worker1 # [ 19.349900] systemd[1]: Started Nix worker-protocol over gRPC.4121lb # [ 19.369178] envoy[988]: [2026-09-20 08:16:21.044][988][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4122lb # [ 19.373547] envoy[988]: [2026-09-20 08:16:21.049][988][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4123lb # [ 19.377994] envoy[988]: [2026-09-20 08:16:21.049][988][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4124lb # [ 19.382715] envoy[988]: [2026-09-20 08:16:21.053][988][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4125worker2 # [ 19.394686] nix-grpc-daemon[784]: ts=2026-09-20T08:16:21Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4126worker1 # [ 19.426343] nix-grpc-daemon[787]: ts=2026-09-20T08:16:21Z level=info event=scheduler_connected addr=lb:500514127worker1 # [ 19.449130] nix-grpc-daemon[787]: ts=2026-09-20T08:16:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4128worker2 # [ 19.595451] nix-grpc-daemon[784]: ts=2026-09-20T08:16:21Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4129worker1 # [ 19.650111] nix-grpc-daemon[787]: ts=2026-09-20T08:16:21Z level=info event=scheduler_connected addr=lb:500514130worker1 # [ 19.662755] nix-grpc-daemon[787]: ts=2026-09-20T08:16:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4131worker1 # [ 19.863509] nix-grpc-daemon[787]: ts=2026-09-20T08:16:21Z level=info event=scheduler_connected addr=lb:500514132worker1 # [ 19.866342] nix-grpc-daemon[787]: ts=2026-09-20T08:16:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4133worker2 # [ 19.995862] nix-grpc-daemon[784]: ts=2026-09-20T08:16:21Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4134worker1 # [ 20.067216] nix-grpc-daemon[787]: ts=2026-09-20T08:16:21Z level=info event=scheduler_connected addr=lb:500514135worker1 # [ 20.070390] nix-grpc-daemon[787]: ts=2026-09-20T08:16:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4136worker1 # [ 20.271664] nix-grpc-daemon[787]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500514137worker1 # [ 20.277335] nix-grpc-daemon[787]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4138worker1 # [ 20.478543] nix-grpc-daemon[787]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500514139worker1 # [ 20.480643] nix-grpc-daemon[787]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4140worker1 # [ 20.681548] nix-grpc-daemon[787]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500514141worker1 # [ 20.684445] nix-grpc-daemon[787]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4142worker2 # [ 20.798684] nix-grpc-daemon[784]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500514143worker2 # [ 20.802401] nix-grpc-daemon[784]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4144worker1 # [ 20.885697] nix-grpc-daemon[787]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500514145worker1 # [ 20.890424] nix-grpc-daemon[787]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4146worker2 # [ 21.003145] nix-grpc-daemon[784]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500514147worker2 # [ 21.005583] nix-grpc-daemon[784]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4148worker1 # [ 21.091658] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500514149worker1 # [ 21.096706] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4150worker2 # [ 21.206439] nix-grpc-daemon[784]: ts=2026-09-20T08:16:22Z level=info event=scheduler_connected addr=lb:500514151worker2 # [ 21.212346] nix-grpc-daemon[784]: ts=2026-09-20T08:16:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4152worker1 # [ 21.297557] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500514153worker1 # [ 21.300330] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4154worker2 # [ 21.413193] nix-grpc-daemon[784]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500514155worker2 # [ 21.418183] nix-grpc-daemon[784]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4156worker1 # [ 21.501574] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500514157worker1 # [ 21.503938] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4158worker2 # [ 21.618644] nix-grpc-daemon[784]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500514159worker2 # [ 21.620816] nix-grpc-daemon[784]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4160worker1 # [ 21.704971] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500514161worker1 # [ 21.708129] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4162worker2 # [ 21.823780] nix-grpc-daemon[784]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500514163worker2 # [ 21.827695] nix-grpc-daemon[784]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4164worker1 # [ 21.908887] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500514165worker1 # [ 21.911801] nix-grpc-daemon[787]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4166worker2 # [ 22.028617] nix-grpc-daemon[784]: ts=2026-09-20T08:16:23Z level=info event=scheduler_connected addr=lb:500514167worker2 # [ 22.033649] nix-grpc-daemon[784]: ts=2026-09-20T08:16:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4168worker1 # [ 22.112677] nix-grpc-daemon[787]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500514169worker1 # [ 22.115233] nix-grpc-daemon[787]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4170worker2 # [ 22.234359] nix-grpc-daemon[784]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500514171worker2 # [ 22.237143] nix-grpc-daemon[784]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4172worker1 # [ 22.316383] nix-grpc-daemon[787]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500514173worker1 # [ 22.321469] nix-grpc-daemon[787]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4174worker2 # [ 22.437799] nix-grpc-daemon[784]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500514175worker2 # [ 22.440616] nix-grpc-daemon[784]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4176worker1 # [ 22.523557] nix-grpc-daemon[787]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500514177worker1 # [ 22.528151] nix-grpc-daemon[787]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4178worker2 # [ 22.641254] nix-grpc-daemon[784]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500514179worker2 # [ 22.643903] nix-grpc-daemon[784]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4180worker1 # [ 22.728881] nix-grpc-daemon[787]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500514181worker1 # [ 22.731582] nix-grpc-daemon[787]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4182worker2 # [ 22.845261] nix-grpc-daemon[784]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500514183worker2 # [ 22.848133] nix-grpc-daemon[784]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4184worker1 # [ 22.932477] nix-grpc-daemon[787]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500514185worker1 # [ 22.935204] nix-grpc-daemon[787]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4186worker2 # [ 23.048872] nix-grpc-daemon[784]: ts=2026-09-20T08:16:24Z level=info event=scheduler_connected addr=lb:500514187worker2 # [ 23.051881] nix-grpc-daemon[784]: ts=2026-09-20T08:16:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4188worker1 # [ 23.136045] nix-grpc-daemon[787]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500514189worker1 # [ 23.139161] nix-grpc-daemon[787]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4190worker2 # [ 23.252651] nix-grpc-daemon[784]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500514191worker2 # [ 23.255370] nix-grpc-daemon[784]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4192worker1 # [ 23.340549] nix-grpc-daemon[787]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500514193worker1 # [ 23.345660] nix-grpc-daemon[787]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4194worker2 # [ 23.456200] nix-grpc-daemon[784]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500514195worker2 # [ 23.458915] nix-grpc-daemon[784]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4196worker1 # [ 23.546978] nix-grpc-daemon[787]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500514197worker1 # [ 23.549343] nix-grpc-daemon[787]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4198worker2 # [ 23.659562] nix-grpc-daemon[784]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500514199worker2 # [ 23.661764] nix-grpc-daemon[784]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4200worker1 # [ 23.750191] nix-grpc-daemon[787]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500514201worker1 # [ 23.752772] nix-grpc-daemon[787]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4202worker2 # [ 23.862789] nix-grpc-daemon[784]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500514203worker2 # [ 23.865178] nix-grpc-daemon[784]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4204worker1 # [ 23.953992] nix-grpc-daemon[787]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500514205worker1 # [ 23.959326] nix-grpc-daemon[787]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4206worker2 # [ 24.066369] nix-grpc-daemon[784]: ts=2026-09-20T08:16:25Z level=info event=scheduler_connected addr=lb:500514207worker2 # [ 24.071103] nix-grpc-daemon[784]: ts=2026-09-20T08:16:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4208worker1 # [ 24.160626] nix-grpc-daemon[787]: ts=2026-09-20T08:16:26Z level=info event=scheduler_connected addr=lb:500514209worker1 # [ 24.165844] nix-grpc-daemon[787]: ts=2026-09-20T08:16:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4210worker2 # [ 24.272175] nix-grpc-daemon[784]: ts=2026-09-20T08:16:26Z level=info event=scheduler_connected addr=lb:500514211worker2 # [ 24.277210] nix-grpc-daemon[784]: ts=2026-09-20T08:16:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4212worker1 # [ 24.366830] nix-grpc-daemon[787]: ts=2026-09-20T08:16:26Z level=info event=scheduler_connected addr=lb:500514213worker1 # [ 24.371732] nix-grpc-daemon[787]: ts=2026-09-20T08:16:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4214worker2 # [ 24.478344] nix-grpc-daemon[784]: ts=2026-09-20T08:16:26Z level=info event=scheduler_connected addr=lb:500514215worker2 # [ 24.483613] nix-grpc-daemon[784]: ts=2026-09-20T08:16:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4216worker1 # [ 24.575850] nix-grpc-daemon[787]: ts=2026-09-20T08:16:26Z level=info event=scheduler_connected addr=lb:500514217worker1 # [ 24.579106] nix-grpc-daemon[787]: ts=2026-09-20T08:16:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4218worker2 # [ 24.684672] nix-grpc-daemon[784]: ts=2026-09-20T08:16:26Z level=info event=scheduler_connected addr=lb:500514219worker2 # [ 24.689429] nix-grpc-daemon[784]: ts=2026-09-20T08:16:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4220worker1 # [ 24.776037] nix-grpc-daemon[787]: ts=2026-09-20T08:16:26Z level=info event=scheduler_connected addr=lb:500514221worker1 # [ 24.779131] nix-grpc-daemon[787]: ts=2026-09-20T08:16:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4222worker2 # [ 24.890407] nix-grpc-daemon[784]: ts=2026-09-20T08:16:26Z level=info event=scheduler_connected addr=lb:500514223worker2 # [ 24.892724] nix-grpc-daemon[784]: ts=2026-09-20T08:16:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4224worker1 # [ 24.980551] nix-grpc-daemon[787]: ts=2026-09-20T08:16:26Z level=info event=scheduler_connected addr=lb:500514225worker1 # [ 24.985653] nix-grpc-daemon[787]: ts=2026-09-20T08:16:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4226worker2 # [ 25.093542] nix-grpc-daemon[784]: ts=2026-09-20T08:16:26Z level=info event=scheduler_connected addr=lb:500514227worker2 # [ 25.096352] nix-grpc-daemon[784]: ts=2026-09-20T08:16:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4228worker1 # [ 25.186880] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=info event=scheduler_connected addr=lb:500514229worker1 # [ 25.191935] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4230worker2 # [ 25.297150] nix-grpc-daemon[784]: ts=2026-09-20T08:16:27Z level=info event=scheduler_connected addr=lb:500514231worker2 # [ 25.299899] nix-grpc-daemon[784]: ts=2026-09-20T08:16:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4232worker1 # [ 25.392685] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=info event=scheduler_connected addr=lb:500514233worker1 # [ 25.395367] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4234worker2 # [ 25.500620] nix-grpc-daemon[784]: ts=2026-09-20T08:16:27Z level=info event=scheduler_connected addr=lb:500514235worker2 # [ 25.505438] nix-grpc-daemon[784]: ts=2026-09-20T08:16:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4236worker1 # [ 25.598947] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=info event=scheduler_connected addr=lb:500514237worker1 # [ 25.602130] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4238worker2 # [ 25.706560] nix-grpc-daemon[784]: ts=2026-09-20T08:16:27Z level=info event=scheduler_connected addr=lb:500514239worker2 # [ 25.711807] nix-grpc-daemon[784]: ts=2026-09-20T08:16:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4240worker1 # [ 25.800141] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=info event=scheduler_connected addr=lb:500514241worker1 # [ 25.805295] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4242worker2 # [ 25.913573] nix-grpc-daemon[784]: ts=2026-09-20T08:16:27Z level=info event=scheduler_connected addr=lb:500514243worker2 # [ 25.918885] nix-grpc-daemon[784]: ts=2026-09-20T08:16:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4244worker1 # [ 26.006374] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=info event=scheduler_connected addr=lb:500514245worker1 # [ 26.011330] nix-grpc-daemon[787]: ts=2026-09-20T08:16:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4246worker2 # [ 26.119878] nix-grpc-daemon[784]: ts=2026-09-20T08:16:27Z level=info event=scheduler_connected addr=lb:500514247worker2 # [ 26.124550] nix-grpc-daemon[784]: ts=2026-09-20T08:16:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4248worker1 # [ 26.212461] nix-grpc-daemon[787]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500514249worker1 # [ 26.217213] nix-grpc-daemon[787]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4250worker2 # [ 26.325501] nix-grpc-daemon[784]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500514251worker2 # [ 26.331319] nix-grpc-daemon[784]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4252worker1 # [ 26.417741] nix-grpc-daemon[787]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500514253worker1 # [ 26.420269] nix-grpc-daemon[787]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4254worker2 # [ 26.532474] nix-grpc-daemon[784]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500514255worker2 # [ 26.537473] nix-grpc-daemon[784]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4256worker1 # [ 26.621669] nix-grpc-daemon[787]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500514257worker1 # [ 26.624282] nix-grpc-daemon[787]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4258worker2 # [ 26.738271] nix-grpc-daemon[784]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500514259worker2 # [ 26.741233] nix-grpc-daemon[784]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4260worker1 # [ 26.825137] nix-grpc-daemon[787]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500514261worker1 # [ 26.827581] nix-grpc-daemon[787]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4262lb # [ 26.861500] rustfs-bucket-start[1079]: mb s3://farm4263lb # [ 26.867957] systemd[1]: Finished rustfs-bucket.service.4264lb # [ 26.874348] systemd[1]: Starting niks3 server...4265worker2 # [ 26.942469] nix-grpc-daemon[784]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500514266worker2 # [ 26.945369] nix-grpc-daemon[784]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4267worker1 # [ 27.029928] nix-grpc-daemon[787]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500514268worker1 # [ 27.033740] nix-grpc-daemon[787]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4269lb # [ 27.079586] postgres[1093]: [1093] ERROR: relation "goose_db_version" does not exist at character 364270lb # [ 27.081041] postgres[1093]: [1093] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4271lb # [ 27.115518] niks3-server[1088]: 2026/09/20 08:16:28 OK 20241026095416_initial_model.sql (17.54ms)4272lb # [ 27.118395] niks3-server[1088]: 2026/09/20 08:16:28 OK 20251210153512_drop_unused_gin_index.sql (3.15ms)4273lb # [ 27.123394] niks3-server[1088]: 2026/09/20 08:16:28 OK 20251218171726_add_pins.sql (3.6ms)4274lb # [ 27.127797] niks3-server[1088]: 2026/09/20 08:16:28 OK 20260628120000_add_object_size_and_stats.sql (4.44ms)4275lb # [ 27.132221] niks3-server[1088]: 2026/09/20 08:16:28 OK 20260905000000_add_claims.sql (3.1ms)4276worker2 # [ 27.146029] nix-grpc-daemon[784]: ts=2026-09-20T08:16:28Z level=info event=scheduler_connected addr=lb:500514277lb # [ 27.137328] niks3-server[1088]: 2026/09/20 08:16:28 OK 20260920000000_drop_claims.sql (4.97ms)4278lb # [ 27.138543] niks3-server[1088]: 2026/09/20 08:16:28 goose: successfully migrated database to version: 202609200000004279worker2 # [ 27.150732] nix-grpc-daemon[784]: ts=2026-09-20T08:16:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4280lb # [ 27.143951] niks3-server[1088]: 2026/09/20 08:16:28 OK 1_commit_pending_closure.sql (6.6ms)4281lb # [ 27.146262] niks3-server[1088]: 2026/09/20 08:16:28 OK 2_object_stats_trigger.sql (2.33ms)4282lb # [ 27.147505] niks3-server[1088]: 2026/09/20 08:16:28 goose: up to current file version: 24283lb # [ 27.153559] niks3-server[1088]: 2026/09/20 08:16:28 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4284lb # [ 27.222117] niks3-server[1088]: 2026/09/20 08:16:28 INFO Read proxy enabled — serving cache objects from S34285lb # [ 27.224062] niks3-server[1088]: 2026/09/20 08:16:28 INFO Using socket-activated listener address=0.0.0.0:57514286worker1 # [ 27.231394] nix-grpc-daemon[787]: ts=2026-09-20T08:16:29Z level=info event=scheduler_connected addr=lb:500514287lb # [ 27.231874] niks3-server[1088]: 2026/09/20 08:16:28 INFO systemd watchdog enabled interval=15s4288lb # [ 27.233133] systemd[1]: Started niks3 server.4289lb # [ 27.233770] systemd[1]: Reached target Multi-User System.4290worker1 # [ 27.237713] nix-grpc-daemon[787]: ts=2026-09-20T08:16:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4291lb # [ 27.236533] niks3-server[1088]: 2026/09/20 08:16:28 INFO Starting HTTP server address=0.0.0.0:57514292lb # [ 27.238170] systemd[1]: Startup finished in 886ms (kernel) + 5.054s (initrd) + 21.295s (userspace) = 27.236s.4293lb # [ 27.244195] niks3-server[1088]: 2026/09/20 08:16:28 INFO lead: acquired remote=192.168.1.3:581704294worker1 # [ 27.251782] nix-grpc-daemon[787]: ts=2026-09-20T08:16:29Z level=info event=scheduler_take_over4295worker2 # [ 27.351892] nix-grpc-daemon[784]: ts=2026-09-20T08:16:29Z level=info event=scheduler_connected addr=lb:500514296worker2 # [ 27.355828] nix-grpc-daemon[784]: ts=2026-09-20T08:16:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4297worker1 # [ 27.439148] nix-grpc-daemon[787]: ts=2026-09-20T08:16:29Z level=info event=scheduler_connected addr=lb:500514298worker1 # [ 27.442415] nix-grpc-daemon[787]: ts=2026-09-20T08:16:29Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04299worker2 # [ 27.556666] nix-grpc-daemon[784]: ts=2026-09-20T08:16:29Z level=info event=scheduler_connected addr=lb:500514300worker1 # [ 27.551571] nix-grpc-daemon[787]: ts=2026-09-20T08:16:29Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04301lb: (finished: waiting for unit niks3.service, in 15.47 seconds)4302lb: waiting for TCP port 5751 on localhost4303lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4304lb: (finished: waiting for TCP port 5751 on localhost, in 0.06 seconds)4305lb: waiting for unit envoy.service4306lb: (finished: waiting for unit envoy.service, in 0.05 seconds)4307lb: waiting for TCP port 50051 on localhost4308lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4309lb # [ 27.890319] envoy[988]: conn peer=[::1]:42520 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24310lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4311lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4312lb: must succeed: curl -sf localhost:9901/clusters4313lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4314lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds)4315subtest: one node schedules and both builders hold a WorkerSession on it4316lb: must succeed: curl -sf localhost:9901/clusters4317lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4318worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4319worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)4320lb: must succeed: curl -sf localhost:9901/clusters4321lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4322lb: must succeed: curl -sf localhost:9901/clusters4323lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4324worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true4325worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true, in 0.06 seconds)4326lb: must succeed: curl -sf localhost:9901/clusters4327lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4328lb: must succeed: curl -sf localhost:9901/clusters4329lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4330worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true4331worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true, in 0.08 seconds)4332worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="slots"' || true4333worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="slots"' || true, in 0.07 seconds)4334worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="free"' || true4335worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="free"' || true, in 0.04 seconds)4336worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="queued"' || true4337worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="queued"' || true, in 0.04 seconds)4338(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.58 seconds)4339subtest: balancer auth: client cert, bearer token, nothing, unknown CN4340worker1 # [ 28.950219] nix-grpc-daemon[787]: ts=2026-09-20T08:16:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:459744341worker1 # [ 28.961847] systemd[1]: Started Nix Daemon.4342worker1 # [ 29.161802] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4343worker1 # [ 29.211132] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 1/5)4344worker1 # [ 29.230601] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 104 ms (attempt 2/5)4345worker1 # [ 29.337270] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 334 ms (attempt 3/5)4346worker1 # [ 29.672060] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 4/5)4347worker1 # [ 29.866234] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4348worker1 # [ 29.888601] nix-grpc-daemon[787]: ts=2026-09-20T08:16:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:459744349worker1 # [ 29.901119] nix-grpc-daemon[787]: ts=2026-09-20T08:16:31Z level=debug event=path_info_miss path=vpijc9l8bpbyqvlpg5fvx0ch6lm9zivm-nixos-system-client-test error="error: path '/nix/store/vpijc9l8bpbyqvlpg5fvx0ch6lm9zivm-nixos-system-client-test' is required, but there is no substituter that can build it"4350worker2 # [ 29.942291] nix-grpc-daemon[784]: ts=2026-09-20T08:16:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:477624351worker2 # [ 29.954304] systemd[1]: Started Nix Daemon.4352worker2 # [ 30.176885] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4353worker2 # [ 30.206269] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 25 ms (attempt 1/5)4354worker2 # [ 30.233787] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 121 ms (attempt 2/5)4355worker2 # [ 30.357695] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 182 ms (attempt 3/5)4356worker2 # [ 30.545592] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 315 ms (attempt 4/5)4357worker2 # [ 30.866789] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4358worker2 # [ 30.887228] nix-grpc-daemon[784]: ts=2026-09-20T08:16:32Z level=debug event=path_info_miss path=vpijc9l8bpbyqvlpg5fvx0ch6lm9zivm-nixos-system-client-test error="error: path '/nix/store/vpijc9l8bpbyqvlpg5fvx0ch6lm9zivm-nixos-system-client-test' is required, but there is no substituter that can build it"4359client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4360client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.09 seconds)4361client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4362client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4363worker1 # [ 31.264510] nix-grpc-daemon[787]: ts=2026-09-20T08:16:33Z level=info event=oidc_jwks provider=mock keys=14364worker1 # [ 31.267559] nix-grpc-daemon[787]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:459744365worker2 # [ 31.302794] nix-grpc-daemon[784]: ts=2026-09-20T08:16:33Z level=info event=oidc_jwks provider=mock keys=14366worker2 # [ 31.306823] nix-grpc-daemon[784]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:477624367worker2 # [ 31.315309] nix-grpc-daemon[784]: ts=2026-09-20T08:16:33Z level=debug event=path_info_miss path=vpijc9l8bpbyqvlpg5fvx0ch6lm9zivm-nixos-system-client-test error="error: path '/nix/store/vpijc9l8bpbyqvlpg5fvx0ch6lm9zivm-nixos-system-client-test' is required, but there is no substituter that can build it"4368worker2 # [ 31.324317] nix-grpc-daemon[784]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:477624369worker2 # [ 31.333739] nix-grpc-daemon[784]: ts=2026-09-20T08:16:33Z level=debug event=path_info_miss path=vpijc9l8bpbyqvlpg5fvx0ch6lm9zivm-nixos-system-client-test error="error: path '/nix/store/vpijc9l8bpbyqvlpg5fvx0ch6lm9zivm-nixos-system-client-test' is required, but there is no substituter that can build it"4370client: must succeed: rm -r /var/lib/nix-grpc-store4371client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4372worker2 # [ 31.570379] nix-grpc-daemon[784]: ts=2026-09-20T08:16:33Z level=info event=denied method=QueryMissing cn=- role=none4373worker2 # [ 31.783197] nix-grpc-daemon[784]: ts=2026-09-20T08:16:33Z level=info event=denied method=QueryMissing cn=stranger role=none4374(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.12 seconds)4375subtest: DAG build is scheduled across workers and lands in the cache4376client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24377worker1 # [ 31.997271] nix-grpc-daemon[787]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:459744378client # don't know how to build these paths:4379client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4380worker1 # [ 32.024910] nix-grpc-daemon[787]: ts=2026-09-20T08:16:33Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04381worker1 # [ 32.029704] nix-grpc-daemon[787]: ts=2026-09-20T08:16:33Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=14382worker1 # [ 32.078131] nix-grpc-daemon[787]: ts=2026-09-20T08:16:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:459744383worker1 # [ 32.101234] nix-grpc-daemon[787]: ts=2026-09-20T08:16:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:459744384client # copying 1 paths to 'lb:50051'...4385worker1 # [ 32.115077] nix-grpc-daemon[787]: ts=2026-09-20T08:16:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:459744386client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4387worker1 # [ 32.142594] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4388worker1 # [ 32.170218] nix-grpc-daemon[787]: ts=2026-09-20T08:16:34Z level=info event=niks3_push_started pid=8844389worker1 # [ 32.630121] nix-daemon[872]: accepted connection from pid 895, user nix-grpc-daemon (trusted)4390worker1 # [ 32.645863] nix-daemon[872]: reaped child process 899, status = succeeded4391worker1 # [ 32.787515] nix-daemon[872]: accepted connection from pid 901, user nix-grpc-daemon (trusted)4392worker1 # [ 32.801749] nix-daemon[872]: reaped child process 904, status = succeeded4393lb # [ 32.808974] niks3-server[1088]: 2026/09/20 08:16:34 INFO Received uploads request method=POST path=/api/pending_closures4394worker1 # [ 32.840884] nix-grpc-daemon[884]: time=2026-09-20T08:16:34.759Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4395worker1 # [ 32.843450] nix-grpc-daemon[884]: time=2026-09-20T08:16:34.762Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4396lb # [ 32.883827] niks3-server[1088]: 2026/09/20 08:16:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4397lb # [ 32.886331] niks3-server[1088]: 2026/09/20 08:16:34 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4398lb # [ 32.904223] niks3-server[1088]: 2026/09/20 08:16:34 INFO Signed narinfos id=1 count=14399worker1 # [ 32.908812] nix-grpc-daemon[884]: time=2026-09-20T08:16:34.828Z level=INFO msg="Uploading 1 narinfos"4400lb # [ 32.914080] niks3-server[1088]: 2026/09/20 08:16:34 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4401lb # [ 32.918575] niks3-server[1088]: 2026/09/20 08:16:34 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4402lb # [ 32.929422] niks3-server[1088]: 2026/09/20 08:16:34 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4403lb # [ 32.933911] niks3-server[1088]: 2026/09/20 08:16:34 INFO Completed upload id=14404worker1 # [ 32.936859] nix-grpc-daemon[884]: time=2026-09-20T08:16:34.856Z level=INFO msg="Upload complete. (478ms)"4405worker1 # [ 32.943142] nix-grpc-daemon[787]: ts=2026-09-20T08:16:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=0 paths=1 nar_bytes_in=5044406worker1 # [ 32.949697] nix-grpc-daemon[787]: ts=2026-09-20T08:16:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:459744407worker1 # [ 32.962160] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4408worker1 # [ 32.968438] nix-daemon[872]: reaped child process 882, status = succeeded4409worker1 # [ 32.976923] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4410client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4411client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4412client # farm-a> LOG-farm-a-t14413worker1 # [ 34.202976] nix-daemon[872]: reaped child process 908, status = succeeded4414worker1 # [ 34.344805] nix-daemon[872]: accepted connection from pid 924, user nix-grpc-daemon (trusted)4415worker1 # [ 34.360351] nix-daemon[872]: reaped child process 927, status = succeeded4416lb # [ 34.370946] niks3-server[1088]: 2026/09/20 08:16:36 INFO Received uploads request method=POST path=/api/pending_closures4417worker1 # [ 34.380057] nix-grpc-daemon[884]: time=2026-09-20T08:16:36.299Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4418worker1 # [ 34.381580] nix-grpc-daemon[884]: time=2026-09-20T08:16:36.301Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4419lb # [ 34.405539] niks3-server[1088]: 2026/09/20 08:16:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4420worker1 # [ 34.411479] nix-grpc-daemon[884]: time=2026-09-20T08:16:36.330Z level=INFO msg="Uploading 1 narinfos"4421lb # [ 34.408678] niks3-server[1088]: 2026/09/20 08:16:36 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4422lb # [ 34.410975] niks3-server[1088]: 2026/09/20 08:16:36 INFO Signed narinfos id=2 count=14423lb # [ 34.414244] niks3-server[1088]: 2026/09/20 08:16:36 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4424lb # [ 34.420643] niks3-server[1088]: 2026/09/20 08:16:36 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4425lb # [ 34.425022] niks3-server[1088]: 2026/09/20 08:16:36 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4426lb # [ 34.428408] niks3-server[1088]: 2026/09/20 08:16:36 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4427lb # [ 34.432509] niks3-server[1088]: 2026/09/20 08:16:36 INFO Completed upload id=24428worker1 # [ 34.435104] nix-grpc-daemon[884]: time=2026-09-20T08:16:36.354Z level=INFO msg="Upload complete. (249ms)"4429worker1 # [ 34.439424] nix-grpc-daemon[787]: ts=2026-09-20T08:16:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14430worker1 # [ 34.451200] nix-daemon[872]: reaped child process 906, status = succeeded4431worker1 # [ 34.453709] nix-grpc-daemon[787]: ts=2026-09-20T08:16:36Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04432worker1 # [ 34.455652] nix-grpc-daemon[787]: ts=2026-09-20T08:16:36Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=14433worker1 # [ 34.497665] nix-grpc-daemon[787]: ts=2026-09-20T08:16:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:459744434worker1 # [ 34.509780] nix-grpc-daemon[787]: ts=2026-09-20T08:16:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:459744435worker1 # [ 34.516115] nix-grpc-daemon[884]: time=2026-09-20T08:16:36.435Z level=INFO msg="All 1 paths already cached"4436client # copying 1 paths to 'lb:50051'...4437worker1 # [ 34.521070] nix-grpc-daemon[787]: ts=2026-09-20T08:16:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:459744438client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4439worker1 # [ 34.537328] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4440worker1 # [ 34.693177] nix-daemon[872]: accepted connection from pid 934, user nix-grpc-daemon (trusted)4441worker1 # [ 34.708352] nix-daemon[872]: reaped child process 937, status = succeeded4442worker1 # [ 34.853262] nix-daemon[872]: accepted connection from pid 939, user nix-grpc-daemon (trusted)4443worker1 # [ 34.867524] nix-daemon[872]: reaped child process 942, status = succeeded4444lb # [ 34.878852] niks3-server[1088]: 2026/09/20 08:16:36 INFO Received uploads request method=POST path=/api/pending_closures4445worker1 # [ 34.890481] nix-grpc-daemon[884]: time=2026-09-20T08:16:36.809Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4446worker1 # [ 34.892445] nix-grpc-daemon[884]: time=2026-09-20T08:16:36.811Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4447lb # [ 34.906668] niks3-server[1088]: 2026/09/20 08:16:36 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4448lb # [ 34.920271] niks3-server[1088]: 2026/09/20 08:16:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4449worker1 # [ 34.930202] nix-grpc-daemon[884]: time=2026-09-20T08:16:36.849Z level=INFO msg="Uploading 1 narinfos"4450lb # [ 34.927537] niks3-server[1088]: 2026/09/20 08:16:36 INFO Signed narinfos id=3 count=14451lb # [ 34.931591] niks3-server[1088]: 2026/09/20 08:16:36 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4452lb # [ 34.943250] niks3-server[1088]: 2026/09/20 08:16:36 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4453lb # [ 34.949733] niks3-server[1088]: 2026/09/20 08:16:36 INFO Completed upload id=34454worker1 # [ 34.954638] nix-grpc-daemon[884]: time=2026-09-20T08:16:36.874Z level=INFO msg="Upload complete. (409ms)"4455lb # [ 34.953130] niks3-server[1088]: 2026/09/20 08:16:36 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4456worker1 # [ 34.958203] nix-grpc-daemon[787]: ts=2026-09-20T08:16:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=0 paths=1 nar_bytes_in=6244457worker1 # [ 34.963366] nix-grpc-daemon[787]: ts=2026-09-20T08:16:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:459744458worker1 # [ 34.972457] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4459worker1 # [ 34.978788] nix-daemon[872]: reaped child process 931, status = succeeded4460client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4461worker1 # [ 34.983583] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4462client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4463client # farm-b> LOG-farm-b-t14464worker1 # [ 36.413500] nix-daemon[872]: reaped child process 946, status = succeeded4465worker1 # [ 36.571153] nix-daemon[872]: accepted connection from pid 961, user nix-grpc-daemon (trusted)4466worker1 # [ 36.584937] nix-daemon[872]: reaped child process 964, status = succeeded4467lb # [ 36.599318] niks3-server[1088]: 2026/09/20 08:16:38 INFO Received uploads request method=POST path=/api/pending_closures4468worker1 # [ 36.612854] nix-grpc-daemon[884]: time=2026-09-20T08:16:38.532Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4469worker1 # [ 36.614496] nix-grpc-daemon[884]: time=2026-09-20T08:16:38.533Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4470lb # [ 36.642197] niks3-server[1088]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4471lb # [ 36.650538] niks3-server[1088]: 2026/09/20 08:16:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4472lb # [ 36.654485] niks3-server[1088]: 2026/09/20 08:16:38 INFO Signed narinfos id=4 count=14473worker1 # [ 36.660098] nix-grpc-daemon[884]: time=2026-09-20T08:16:38.579Z level=INFO msg="Uploading 1 narinfos"4474lb # [ 36.657806] niks3-server[1088]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4475lb # [ 36.672636] niks3-server[1088]: 2026/09/20 08:16:38 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4476lb # [ 36.675985] niks3-server[1088]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4477lb # [ 36.679723] niks3-server[1088]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4478lb # [ 36.682713] niks3-server[1088]: 2026/09/20 08:16:38 INFO Completed upload id=44479worker1 # [ 36.685541] nix-grpc-daemon[884]: time=2026-09-20T08:16:38.604Z level=INFO msg="Upload complete. (292ms)"4480worker1 # [ 36.691578] nix-grpc-daemon[787]: ts=2026-09-20T08:16:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14481worker1 # [ 36.703416] nix-grpc-daemon[787]: ts=2026-09-20T08:16:38Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04482worker1 # [ 36.706921] nix-grpc-daemon[787]: ts=2026-09-20T08:16:38Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=14483worker1 # [ 36.716639] nix-daemon[872]: reaped child process 944, status = succeeded4484worker1 # [ 36.747185] nix-grpc-daemon[787]: ts=2026-09-20T08:16:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:459744485worker1 # [ 36.759684] nix-grpc-daemon[787]: ts=2026-09-20T08:16:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:459744486worker1 # [ 36.772277] nix-grpc-daemon[884]: time=2026-09-20T08:16:38.691Z level=INFO msg="All 2 paths already cached"4487client # copying 1 paths to 'lb:50051'...4488client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4489worker1 # [ 36.779088] nix-grpc-daemon[787]: ts=2026-09-20T08:16:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:459744490worker1 # [ 36.788356] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4491worker1 # [ 36.958349] nix-daemon[872]: accepted connection from pid 970, user nix-grpc-daemon (trusted)4492worker1 # [ 36.977561] nix-daemon[872]: reaped child process 973, status = succeeded4493worker1 # [ 37.151183] nix-daemon[872]: accepted connection from pid 975, user nix-grpc-daemon (trusted)4494worker1 # [ 37.165395] nix-daemon[872]: reaped child process 979, status = succeeded4495lb # [ 37.175155] niks3-server[1088]: 2026/09/20 08:16:38 INFO Received uploads request method=POST path=/api/pending_closures4496worker1 # [ 37.190562] nix-grpc-daemon[884]: time=2026-09-20T08:16:39.109Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4497worker1 # [ 37.192123] nix-grpc-daemon[884]: time=2026-09-20T08:16:39.111Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4498lb # [ 37.217118] niks3-server[1088]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4499lb # [ 37.230890] niks3-server[1088]: 2026/09/20 08:16:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4500lb # [ 37.233990] niks3-server[1088]: 2026/09/20 08:16:38 INFO Signed narinfos id=5 count=14501worker1 # [ 37.236246] nix-grpc-daemon[884]: time=2026-09-20T08:16:39.155Z level=INFO msg="Uploading 1 narinfos"4502lb # [ 37.239266] niks3-server[1088]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4503lb # [ 37.249157] niks3-server[1088]: 2026/09/20 08:16:38 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4504lb # [ 37.254134] niks3-server[1088]: 2026/09/20 08:16:38 INFO Completed upload id=54505worker1 # [ 37.256139] nix-grpc-daemon[884]: time=2026-09-20T08:16:39.175Z level=INFO msg="Upload complete. (454ms)"4506lb # [ 37.256646] niks3-server[1088]: 2026/09/20 08:16:38 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4507worker1 # [ 37.259932] nix-grpc-daemon[787]: ts=2026-09-20T08:16:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=0 paths=1 nar_bytes_in=7524508worker1 # [ 37.265256] nix-grpc-daemon[787]: ts=2026-09-20T08:16:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:459744509worker1 # [ 37.272940] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4510worker1 # [ 37.279332] nix-daemon[872]: reaped child process 968, status = succeeded4511client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4512client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4513worker1 # [ 37.285432] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4514client # farm-top> LOG-farm-top-t14515worker1 # [ 38.512451] nix-daemon[872]: reaped child process 983, status = succeeded4516worker1 # [ 38.674105] nix-daemon[872]: accepted connection from pid 998, user nix-grpc-daemon (trusted)4517worker1 # [ 38.687290] nix-daemon[872]: reaped child process 1001, status = succeeded4518lb # [ 38.700842] niks3-server[1088]: 2026/09/20 08:16:40 INFO Received uploads request method=POST path=/api/pending_closures4519worker1 # [ 38.712427] nix-grpc-daemon[884]: time=2026-09-20T08:16:40.631Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4520worker1 # [ 38.715198] nix-grpc-daemon[884]: time=2026-09-20T08:16:40.633Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4521lb # [ 38.740645] niks3-server[1088]: 2026/09/20 08:16:40 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4522lb # [ 38.747935] niks3-server[1088]: 2026/09/20 08:16:40 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4523lb # [ 38.757475] niks3-server[1088]: 2026/09/20 08:16:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4524worker1 # [ 38.765873] nix-grpc-daemon[884]: time=2026-09-20T08:16:40.685Z level=INFO msg="Uploading 1 narinfos"4525lb # [ 38.763573] niks3-server[1088]: 2026/09/20 08:16:40 INFO Signed narinfos id=6 count=14526lb # [ 38.768852] niks3-server[1088]: 2026/09/20 08:16:40 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4527lb # [ 38.777664] niks3-server[1088]: 2026/09/20 08:16:40 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4528lb # [ 38.780760] niks3-server[1088]: 2026/09/20 08:16:40 INFO Completed upload id=64529worker1 # [ 38.783467] nix-grpc-daemon[884]: time=2026-09-20T08:16:40.702Z level=INFO msg="Upload complete. (291ms)"4530lb # [ 38.783259] niks3-server[1088]: 2026/09/20 08:16:40 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4531worker1 # [ 38.791886] nix-grpc-daemon[787]: ts=2026-09-20T08:16:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14532worker1 # [ 38.804834] nix-daemon[872]: reaped child process 981, status = succeeded4533client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 7.02 seconds)4534client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4535client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.18 seconds)4536client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4537client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4538client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4539lb # [ 39.104349] envoy[988]: conn peer=[2001:db8:1::1]:53414 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=19864540lb # [ 39.108258] envoy[988]: conn peer=[2001:db8:1::1]:53430 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=954541lb # [ 39.111616] envoy[988]: conn peer=[2001:db8:1::1]:53436 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=134542lb # [ 39.115073] envoy[988]: conn peer=[2001:db8:1::1]:53450 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=74543lb # [ 39.118656] envoy[988]: conn peer=[2001:db8:1::1]:53458 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9355 tx=3776 ms=68344544client # copying 3 paths...4545client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4546client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4547client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4548client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.27 seconds)4549(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.56 seconds)4550subtest: repeat is answered Cached by the scheduler without building4551worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4552worker1 # finding garbage collector roots...4553worker1 # deleting specified paths...4554worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4555worker1 # deleting unused links...4556worker1 # note: hard linking is currently saving 0.0 KiB4557worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.24 seconds)4558worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4559worker2 # finding garbage collector roots...4560worker2 # deleting specified paths...4561worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4562worker2 # deleting unused links...4563worker2 # note: hard linking is currently saving 0.0 KiB4564worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.28 seconds)4565client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24566worker2 # [ 40.140987] nix-grpc-daemon[784]: ts=2026-09-20T08:16:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:477624567client # don't know how to build these paths:4568client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4569worker1 # [ 40.171825] nix-grpc-daemon[787]: ts=2026-09-20T08:16:42Z level=debug event=want client=2 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=14570worker1 # [ 40.184253] nix-grpc-daemon[787]: ts=2026-09-20T08:16:42Z level=debug event=want client=2 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=14571worker1 # [ 40.198085] nix-grpc-daemon[787]: ts=2026-09-20T08:16:42Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14572client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 0.36 seconds)4573client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4574client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.19 seconds)4575lb: must succeed: curl -sf localhost:9901/clusters4576lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4577lb: must succeed: curl -sf localhost:9901/clusters4578lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4579worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4580worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.05 seconds)4581(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.26 seconds)4582subtest: two clients wanting the same drv build it once4583client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4584client # [ 40.669819] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4585client # Running as unit: dedup1.service; invocation ID: d5adde7fe7704bb8870e86a5004c66f84586client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.07 seconds)4587client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4588worker2 # [ 40.880180] nix-grpc-daemon[784]: ts=2026-09-20T08:16:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:477624589client # [ 40.881897] nix[869]: don't know how to build these paths:4590client # [ 40.883358] nix[869]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4591worker1 # [ 40.886582] nix-grpc-daemon[787]: ts=2026-09-20T08:16:42Z level=debug event=want client=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04592worker1 # [ 40.890827] nix-grpc-daemon[787]: ts=2026-09-20T08:16:42Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14593worker2 # [ 40.939856] nix-grpc-daemon[784]: ts=2026-09-20T08:16:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:477624594worker2 # [ 40.957591] nix-grpc-daemon[784]: ts=2026-09-20T08:16:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:477624595client # [ 40.963332] nix[869]: copying 1 paths to 'lb:50051'...4596worker2 # [ 40.969183] nix-grpc-daemon[784]: ts=2026-09-20T08:16:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:477624597client # [ 40.966153] nix[869]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4598worker2 # [ 40.983581] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4599worker2 # [ 41.007873] nix-grpc-daemon[784]: ts=2026-09-20T08:16:42Z level=info event=niks3_push_started pid=8724600worker2 # [ 41.451436] nix-daemon[847]: accepted connection from pid 883, user nix-grpc-daemon (trusted)4601worker2 # [ 41.468914] nix-daemon[847]: reaped child process 887, status = succeeded4602worker2 # [ 41.627419] nix-daemon[847]: accepted connection from pid 889, user nix-grpc-daemon (trusted)4603worker2 # [ 41.640227] nix-daemon[847]: reaped child process 892, status = succeeded4604lb # [ 41.645626] niks3-server[1088]: 2026/09/20 08:16:43 INFO Received uploads request method=POST path=/api/pending_closures4605worker2 # [ 41.668366] nix-grpc-daemon[872]: time=2026-09-20T08:16:43.437Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4606worker2 # [ 41.671256] nix-grpc-daemon[872]: time=2026-09-20T08:16:43.440Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4607lb # [ 41.686192] niks3-server[1088]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4608lb # [ 41.694699] niks3-server[1088]: 2026/09/20 08:16:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4609lb # [ 41.699401] niks3-server[1088]: 2026/09/20 08:16:43 INFO Signed narinfos id=7 count=14610worker2 # [ 41.712667] nix-grpc-daemon[872]: time=2026-09-20T08:16:43.483Z level=INFO msg="Uploading 1 narinfos"4611lb # [ 41.712807] niks3-server[1088]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4612lb # [ 41.719232] niks3-server[1088]: 2026/09/20 08:16:43 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4613lb # [ 41.724202] niks3-server[1088]: 2026/09/20 08:16:43 INFO Completed upload id=74614worker2 # [ 41.736676] nix-grpc-daemon[872]: time=2026-09-20T08:16:43.507Z level=INFO msg="Upload complete. (467ms)"4615worker2 # [ 41.739246] nix-grpc-daemon[784]: ts=2026-09-20T08:16:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47762 duration_s=0 paths=1 nar_bytes_in=4324616lb # [ 41.728427] niks3-server[1088]: 2026/09/20 08:16:43 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4617worker2 # [ 41.746153] nix-grpc-daemon[784]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:477624618worker2 # [ 41.747918] nix-daemon[847]: reaped child process 870, status = succeeded4619worker2 # [ 41.751170] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4620worker2 # [ 41.758450] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4621client # [ 41.749590] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4622client # [ 41.761750] nix[869]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4623client # Running as unit: dedup2.service; invocation ID: 0bd27ebaf72844d4996bbf1e162298e94624client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.09 seconds)4625client # [ 42.015646] nix[885]: don't know how to build these paths:4626client # [ 42.016564] nix[885]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4627worker1 # [ 42.012174] nix-grpc-daemon[787]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:459744628worker1 # [ 42.022372] nix-grpc-daemon[787]: ts=2026-09-20T08:16:43Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04629worker2 # [ 42.035147] nix-grpc-daemon[784]: ts=2026-09-20T08:16:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:477624630client # [ 42.035939] nix[885]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4631client: must succeed: sleep 24632client: (finished: must succeed: sleep 2, in 2.05 seconds)4633client: waiting for success: ! systemctl is-active dedup1 dedup24634worker2 # [ 45.386842] nix-daemon[847]: reaped child process 896, status = succeeded4635worker2 # [ 45.551823] nix-daemon[847]: accepted connection from pid 928, user nix-grpc-daemon (trusted)4636worker2 # [ 45.564068] nix-daemon[847]: reaped child process 931, status = succeeded4637lb # [ 45.571489] niks3-server[1088]: 2026/09/20 08:16:47 INFO Received uploads request method=POST path=/api/pending_closures4638worker2 # [ 45.589936] nix-grpc-daemon[872]: time=2026-09-20T08:16:47.360Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4639worker2 # [ 45.591541] nix-grpc-daemon[872]: time=2026-09-20T08:16:47.362Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4640lb # [ 45.611474] niks3-server[1088]: 2026/09/20 08:16:47 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4641lb # [ 45.637401] niks3-server[1088]: 2026/09/20 08:16:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4642worker2 # [ 45.652135] nix-grpc-daemon[872]: time=2026-09-20T08:16:47.422Z level=INFO msg="Uploading 1 narinfos"4643lb # [ 45.642315] niks3-server[1088]: 2026/09/20 08:16:47 INFO Signed narinfos id=8 count=14644lb # [ 45.648872] niks3-server[1088]: 2026/09/20 08:16:47 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4645lb # [ 45.655985] niks3-server[1088]: 2026/09/20 08:16:47 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4646lb # [ 45.660262] niks3-server[1088]: 2026/09/20 08:16:47 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4647lb # [ 45.663384] niks3-server[1088]: 2026/09/20 08:16:47 INFO Completed upload id=84648lb # [ 45.664913] niks3-server[1088]: 2026/09/20 08:16:47 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4649worker2 # [ 45.674946] nix-grpc-daemon[872]: time=2026-09-20T08:16:47.445Z level=INFO msg="Upload complete. (301ms)"4650worker2 # [ 45.681631] nix-grpc-daemon[784]: ts=2026-09-20T08:16:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47762 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14651worker2 # [ 45.688321] nix-grpc-daemon[784]: ts=2026-09-20T08:16:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47762 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14652worker2 # [ 45.699272] nix-daemon[847]: reaped child process 894, status = succeeded4653client # [ 45.728662] systemd[1]: dedup1.service: Deactivated successfully.4654client # [ 45.731800] systemd[1]: dedup1.service: Consumed 114ms CPU time over 5.062s wall clock time, 37.4M memory peak, 8.6K incoming IP traffic, 9.1K outgoing IP traffic.4655client # [ 45.737166] systemd[1]: dedup2.service: Deactivated successfully.4656client # [ 45.740413] systemd[1]: dedup2.service: Consumed 126ms CPU time over 3.990s wall clock time, 31.1M memory peak, 7.5K incoming IP traffic, 6.4K outgoing IP traffic.4657client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.12 seconds)4658client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4659client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.05 seconds)4660worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4661worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds)4662worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4663worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4664worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4665worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.07 seconds)4666worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4667worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.06 seconds)4668(finished: subtest: two clients wanting the same drv build it once, in 5.99 seconds)4669subtest: build hook: nix-daemon with builders = grpc://lb4670client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log4671client # [ 46.795718] systemd[1]: Started Nix Daemon.4672client # [ 46.972413] nix-daemon[928]: accepted connection from pid 925, user root (trusted)4673worker2 # [ 47.173682] nix-grpc-daemon[784]: ts=2026-09-20T08:16:48Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:477624674worker2 # [ 47.183626] nix-grpc-daemon[784]: ts=2026-09-20T08:16:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:477624675worker1 # [ 47.195516] nix-grpc-daemon[787]: ts=2026-09-20T08:16:49Z level=debug event=want client=5 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04676worker1 # [ 47.200723] nix-grpc-daemon[787]: ts=2026-09-20T08:16:49Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=14677worker1 # [ 47.207865] nix-grpc-daemon[787]: ts=2026-09-20T08:16:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:459744678worker1 # [ 47.220443] nix-grpc-daemon[787]: ts=2026-09-20T08:16:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:459744679worker1 # [ 47.232325] nix-grpc-daemon[787]: ts=2026-09-20T08:16:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:459744680worker1 # [ 47.244492] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4681worker1 # [ 47.421763] nix-daemon[872]: accepted connection from pid 1060, user nix-grpc-daemon (trusted)4682worker1 # [ 47.437133] nix-daemon[872]: reaped child process 1063, status = succeeded4683worker1 # [ 47.610220] nix-daemon[872]: accepted connection from pid 1065, user nix-grpc-daemon (trusted)4684worker1 # [ 47.625026] nix-daemon[872]: reaped child process 1068, status = succeeded4685lb # [ 47.638874] niks3-server[1088]: 2026/09/20 08:16:49 INFO Received uploads request method=POST path=/api/pending_closures4686worker1 # [ 47.650982] nix-grpc-daemon[884]: time=2026-09-20T08:16:49.570Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4687worker1 # [ 47.652768] nix-grpc-daemon[884]: time=2026-09-20T08:16:49.572Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4688lb # [ 47.668237] niks3-server[1088]: 2026/09/20 08:16:49 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4689lb # [ 47.679956] niks3-server[1088]: 2026/09/20 08:16:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4690worker1 # [ 47.687546] nix-grpc-daemon[884]: time=2026-09-20T08:16:49.606Z level=INFO msg="Uploading 1 narinfos"4691lb # [ 47.684804] niks3-server[1088]: 2026/09/20 08:16:49 INFO Signed narinfos id=9 count=14692lb # [ 47.691346] niks3-server[1088]: 2026/09/20 08:16:49 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4693lb # [ 47.705114] niks3-server[1088]: 2026/09/20 08:16:49 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4694lb # [ 47.717446] niks3-server[1088]: 2026/09/20 08:16:49 INFO Completed upload id=94695worker1 # [ 47.722486] nix-grpc-daemon[884]: time=2026-09-20T08:16:49.641Z level=INFO msg="Upload complete. (465ms)"4696lb # [ 47.720681] niks3-server[1088]: 2026/09/20 08:16:49 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4697worker1 # [ 47.727505] nix-grpc-daemon[787]: ts=2026-09-20T08:16:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=0 paths=1 nar_bytes_in=5124698worker1 # [ 47.733533] nix-grpc-daemon[787]: ts=2026-09-20T08:16:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:459744699worker1 # [ 47.745123] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4700worker1 # [ 47.757132] nix-daemon[872]: reaped child process 1058, status = succeeded4701worker1 # [ 47.760339] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4702worker1 # [ 48.374808] nix-daemon[872]: reaped child process 1072, status = succeeded4703worker1 # [ 48.506823] nix-daemon[872]: accepted connection from pid 1087, user nix-grpc-daemon (trusted)4704worker1 # [ 48.520417] nix-daemon[872]: reaped child process 1090, status = succeeded4705lb # [ 48.530283] niks3-server[1088]: 2026/09/20 08:16:50 INFO Received uploads request method=POST path=/api/pending_closures4706worker1 # [ 48.541320] nix-grpc-daemon[884]: time=2026-09-20T08:16:50.460Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4707worker1 # [ 48.542871] nix-grpc-daemon[884]: time=2026-09-20T08:16:50.462Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4708lb # [ 48.569877] niks3-server[1088]: 2026/09/20 08:16:50 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4709lb # [ 48.577327] niks3-server[1088]: 2026/09/20 08:16:50 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4710lb # [ 48.588335] niks3-server[1088]: 2026/09/20 08:16:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4711lb # [ 48.593726] niks3-server[1088]: 2026/09/20 08:16:50 INFO Signed narinfos id=10 count=14712worker1 # [ 48.598869] nix-grpc-daemon[884]: time=2026-09-20T08:16:50.518Z level=INFO msg="Uploading 1 narinfos"4713lb # [ 48.598297] niks3-server[1088]: 2026/09/20 08:16:50 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4714lb # [ 48.609202] niks3-server[1088]: 2026/09/20 08:16:50 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4715lb # [ 48.613753] niks3-server[1088]: 2026/09/20 08:16:50 INFO Completed upload id=104716worker1 # [ 48.617683] nix-grpc-daemon[884]: time=2026-09-20T08:16:50.537Z level=INFO msg="Upload complete. (251ms)"4717lb # [ 48.616117] niks3-server[1088]: 2026/09/20 08:16:50 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4718worker2 # [ 48.634958] nix-grpc-daemon[784]: ts=2026-09-20T08:16:50Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:477624719worker1 # [ 48.622980] nix-grpc-daemon[787]: ts=2026-09-20T08:16:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=0 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=5 outputs=14720worker2 # [ 48.641752] nix-grpc-daemon[784]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4721worker1 # [ 48.636469] nix-daemon[872]: reaped child process 1070, status = succeeded4722worker1 # [ 48.659554] nix-grpc-daemon[787]: ts=2026-09-20T08:16:50Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:459744723worker1 # [ 48.665982] nix-grpc-daemon[787]: ts=2026-09-20T08:16:50Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=0 paths=1 nar_bytes_out=1284724worker2 # [ 48.935172] nix-grpc-daemon[784]: ts=2026-09-20T08:16:50Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:477624725worker1 # [ 48.935732] nix-grpc-daemon[787]: ts=2026-09-20T08:16:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:459744726worker1 # [ 48.946482] nix-grpc-daemon[884]: time=2026-09-20T08:16:50.865Z level=INFO msg="All 1 paths already cached"4727worker1 # [ 48.960827] nix-grpc-daemon[787]: ts=2026-09-20T08:16:50Z level=debug event=want client=6 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04728worker1 # [ 48.966306] nix-grpc-daemon[787]: ts=2026-09-20T08:16:50Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=14729worker1 # [ 48.971627] nix-grpc-daemon[787]: ts=2026-09-20T08:16:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:459744730worker1 # [ 48.983477] nix-grpc-daemon[787]: ts=2026-09-20T08:16:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:459744731worker1 # [ 48.994976] nix-grpc-daemon[884]: time=2026-09-20T08:16:50.914Z level=INFO msg="All 1 paths already cached"4732worker1 # [ 49.002078] nix-grpc-daemon[787]: ts=2026-09-20T08:16:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:459744733worker1 # [ 49.010964] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4734lb # [ 49.105527] envoy[988]: conn peer=[2001:db8:1::1]:40214 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1158 tx=482 ms=814735lb # [ 49.109274] envoy[988]: conn peer=[2001:db8:1::1]:40224 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1085 ms=36844736lb # [ 49.112869] envoy[988]: conn peer=[2001:db8:1::1]:40216 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2972 tx=1372 ms=48174737lb # [ 49.116466] envoy[988]: conn peer=[2001:db8:1::1]:51538 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=594738lb # [ 49.119946] envoy[988]: conn peer=[2001:db8:1::1]:51530 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3382 tx=1774 ms=15564739worker1 # [ 49.192352] nix-daemon[872]: accepted connection from pid 1096, user nix-grpc-daemon (trusted)4740worker1 # [ 49.209259] nix-daemon[872]: reaped child process 1099, status = succeeded4741worker1 # [ 49.384804] nix-daemon[872]: accepted connection from pid 1101, user nix-grpc-daemon (trusted)4742worker1 # [ 49.400691] nix-daemon[872]: reaped child process 1104, status = succeeded4743lb # [ 49.417130] niks3-server[1088]: 2026/09/20 08:16:51 INFO Received uploads request method=POST path=/api/pending_closures4744worker1 # [ 49.427093] nix-grpc-daemon[884]: time=2026-09-20T08:16:51.346Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4745worker1 # [ 49.428540] nix-grpc-daemon[884]: time=2026-09-20T08:16:51.346Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4746lb # [ 49.440750] niks3-server[1088]: 2026/09/20 08:16:51 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4747lb # [ 49.452673] niks3-server[1088]: 2026/09/20 08:16:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4748worker1 # [ 49.459530] nix-grpc-daemon[884]: time=2026-09-20T08:16:51.378Z level=INFO msg="Uploading 1 narinfos"4749lb # [ 49.456903] niks3-server[1088]: 2026/09/20 08:16:51 INFO Signed narinfos id=11 count=14750lb # [ 49.464704] niks3-server[1088]: 2026/09/20 08:16:51 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4751lb # [ 49.475240] niks3-server[1088]: 2026/09/20 08:16:51 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4752lb # [ 49.480116] niks3-server[1088]: 2026/09/20 08:16:51 INFO Completed upload id=114753worker1 # [ 49.484988] nix-grpc-daemon[884]: time=2026-09-20T08:16:51.404Z level=INFO msg="Upload complete. (460ms)"4754lb # [ 49.484636] niks3-server[1088]: 2026/09/20 08:16:51 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4755worker1 # [ 49.488412] nix-grpc-daemon[787]: ts=2026-09-20T08:16:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=0 paths=1 nar_bytes_in=6244756worker1 # [ 49.494088] nix-grpc-daemon[787]: ts=2026-09-20T08:16:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:459744757worker1 # [ 49.505562] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4758worker1 # [ 49.510127] nix-daemon[872]: reaped child process 1094, status = succeeded4759worker1 # [ 49.513455] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4760worker1 # [ 50.934846] nix-daemon[872]: reaped child process 1108, status = succeeded4761worker1 # [ 51.085743] nix-daemon[872]: accepted connection from pid 1123, user nix-grpc-daemon (trusted)4762worker1 # [ 51.099425] nix-daemon[872]: reaped child process 1126, status = succeeded4763lb # [ 51.107754] niks3-server[1088]: 2026/09/20 08:16:52 INFO Received uploads request method=POST path=/api/pending_closures4764worker1 # [ 51.124986] nix-grpc-daemon[884]: time=2026-09-20T08:16:53.044Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4765worker1 # [ 51.126581] nix-grpc-daemon[884]: time=2026-09-20T08:16:53.046Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4766lb # [ 51.150865] niks3-server[1088]: 2026/09/20 08:16:52 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4767lb # [ 51.165518] niks3-server[1088]: 2026/09/20 08:16:52 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4768lb # [ 51.169983] niks3-server[1088]: 2026/09/20 08:16:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4769lb # [ 51.174475] niks3-server[1088]: 2026/09/20 08:16:52 INFO Signed narinfos id=12 count=14770worker1 # [ 51.179821] nix-grpc-daemon[884]: time=2026-09-20T08:16:53.098Z level=INFO msg="Uploading 1 narinfos"4771lb # [ 51.181095] niks3-server[1088]: 2026/09/20 08:16:52 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4772lb # [ 51.189230] niks3-server[1088]: 2026/09/20 08:16:52 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4773lb # [ 51.192492] niks3-server[1088]: 2026/09/20 08:16:52 INFO Completed upload id=124774worker1 # [ 51.195409] nix-grpc-daemon[884]: time=2026-09-20T08:16:53.114Z level=INFO msg="Upload complete. (274ms)"4775lb # [ 51.194641] niks3-server[1088]: 2026/09/20 08:16:52 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4776worker1 # [ 51.203191] nix-grpc-daemon[787]: ts=2026-09-20T08:16:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=6 outputs=14777worker1 # [ 51.208527] nix-grpc-daemon[787]: ts=2026-09-20T08:16:53Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:459744778worker1 # [ 51.218967] nix-daemon[872]: reaped child process 1106, status = succeeded4779worker1 # [ 51.226789] nix-grpc-daemon[787]: ts=2026-09-20T08:16:53Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:459744780worker1 # [ 51.228958] nix-grpc-daemon[787]: ts=2026-09-20T08:16:53Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=0 paths=1 nar_bytes_out=1764781worker2 # [ 51.518275] nix-grpc-daemon[784]: ts=2026-09-20T08:16:53Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:477624782worker2 # [ 51.524440] nix-grpc-daemon[784]: ts=2026-09-20T08:16:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:477624783worker2 # [ 51.535473] nix-grpc-daemon[872]: time=2026-09-20T08:16:53.305Z level=INFO msg="All 1 paths already cached"4784worker1 # [ 51.542215] nix-grpc-daemon[787]: ts=2026-09-20T08:16:53Z level=debug event=want client=7 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04785worker1 # [ 51.547708] nix-grpc-daemon[787]: ts=2026-09-20T08:16:53Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=14786worker1 # [ 51.586281] nix-grpc-daemon[787]: ts=2026-09-20T08:16:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:459744787worker1 # [ 51.599830] nix-grpc-daemon[787]: ts=2026-09-20T08:16:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:459744788worker1 # [ 51.611917] nix-grpc-daemon[884]: time=2026-09-20T08:16:53.531Z level=INFO msg="All 2 paths already cached"4789worker1 # [ 51.618964] nix-grpc-daemon[787]: ts=2026-09-20T08:16:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:459744790worker1 # [ 51.627724] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4791worker1 # [ 51.793250] nix-daemon[872]: accepted connection from pid 1132, user nix-grpc-daemon (trusted)4792worker1 # [ 51.808558] nix-daemon[872]: reaped child process 1135, status = succeeded4793worker1 # [ 51.975618] nix-daemon[872]: accepted connection from pid 1137, user nix-grpc-daemon (trusted)4794worker1 # [ 51.989520] nix-daemon[872]: reaped child process 1140, status = succeeded4795lb # [ 52.001816] niks3-server[1088]: 2026/09/20 08:16:53 INFO Received uploads request method=POST path=/api/pending_closures4796worker1 # [ 52.012442] nix-grpc-daemon[884]: time=2026-09-20T08:16:53.931Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4797worker1 # [ 52.014040] nix-grpc-daemon[884]: time=2026-09-20T08:16:53.931Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4798lb # [ 52.027070] niks3-server[1088]: 2026/09/20 08:16:53 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4799lb # [ 52.037573] niks3-server[1088]: 2026/09/20 08:16:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4800worker1 # [ 52.045225] nix-grpc-daemon[884]: time=2026-09-20T08:16:53.964Z level=INFO msg="Uploading 1 narinfos"4801lb # [ 52.043162] niks3-server[1088]: 2026/09/20 08:16:53 INFO Signed narinfos id=13 count=14802lb # [ 52.050789] niks3-server[1088]: 2026/09/20 08:16:53 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4803lb # [ 52.060120] niks3-server[1088]: 2026/09/20 08:16:53 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4804worker1 # [ 52.068808] nix-grpc-daemon[884]: time=2026-09-20T08:16:53.988Z level=INFO msg="Upload complete. (424ms)"4805lb # [ 52.066211] niks3-server[1088]: 2026/09/20 08:16:53 INFO Completed upload id=134806worker1 # [ 52.072132] nix-grpc-daemon[787]: ts=2026-09-20T08:16:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=0 paths=1 nar_bytes_in=7524807lb # [ 52.070141] niks3-server[1088]: 2026/09/20 08:16:53 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4808worker1 # [ 52.077662] nix-grpc-daemon[787]: ts=2026-09-20T08:16:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:459744809worker1 # [ 52.086664] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4810worker1 # [ 52.089532] nix-daemon[872]: reaped child process 1130, status = succeeded4811worker1 # [ 52.096027] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4812worker1 # [ 53.323664] nix-daemon[872]: reaped child process 1144, status = succeeded4813worker1 # [ 53.477608] nix-daemon[872]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)4814worker1 # [ 53.491539] nix-daemon[872]: reaped child process 1162, status = succeeded4815lb # [ 53.505878] niks3-server[1088]: 2026/09/20 08:16:55 INFO Received uploads request method=POST path=/api/pending_closures4816worker1 # [ 53.517164] nix-grpc-daemon[884]: time=2026-09-20T08:16:55.436Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4817worker1 # [ 53.519239] nix-grpc-daemon[884]: time=2026-09-20T08:16:55.438Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4818lb # [ 53.543588] niks3-server[1088]: 2026/09/20 08:16:55 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4819lb # [ 53.557497] niks3-server[1088]: 2026/09/20 08:16:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4820lb # [ 53.562890] niks3-server[1088]: 2026/09/20 08:16:55 INFO Signed narinfos id=14 count=14821worker1 # [ 53.568695] nix-grpc-daemon[884]: time=2026-09-20T08:16:55.487Z level=INFO msg="Uploading 1 narinfos"4822lb # [ 53.571470] niks3-server[1088]: 2026/09/20 08:16:55 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4823lb # [ 53.579079] niks3-server[1088]: 2026/09/20 08:16:55 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4824lb # [ 53.585646] niks3-server[1088]: 2026/09/20 08:16:55 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4825lb # [ 53.591483] niks3-server[1088]: 2026/09/20 08:16:55 INFO Completed upload id=144826worker1 # [ 53.594391] nix-grpc-daemon[884]: time=2026-09-20T08:16:55.513Z level=INFO msg="Upload complete. (291ms)"4827lb # [ 53.593851] niks3-server[1088]: 2026/09/20 08:16:55 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4828worker1 # [ 53.603158] nix-grpc-daemon[787]: ts=2026-09-20T08:16:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=7 outputs=14829worker1 # [ 53.609910] nix-grpc-daemon[787]: ts=2026-09-20T08:16:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:459744830worker1 # [ 53.619944] nix-daemon[872]: reaped child process 1142, status = succeeded4831worker2 # [ 53.635376] nix-grpc-daemon[784]: ts=2026-09-20T08:16:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:477624832worker2 # [ 53.645947] nix-grpc-daemon[784]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4833worker2 # [ 53.659923] nix-grpc-daemon[784]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4834worker2 # [ 53.673619] nix-grpc-daemon[784]: ts=2026-09-20T08:16:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47762 duration_s=0 paths=1 nar_bytes_out=2324835client # [ 53.782809] nix-daemon[928]: reaped child process 930, status = succeeded4836client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.19 seconds)4837client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4838client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)4839client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4840client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4841client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4842client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4843(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.29 seconds)4844subtest: an input only one worker has still reaches the builder4845client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4846client # this derivation will be built:4847client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4848client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4849client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.38 seconds)4850client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4851client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.19 seconds)4852worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4853worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.19 seconds)4854worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4855worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)4856client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24857client # [ 54.841855] nix-daemon[928]: accepted connection from pid 1011, user root (trusted)4858client # this derivation will be built:4859client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4860worker2 # [ 55.026247] nix-grpc-daemon[784]: ts=2026-09-20T08:16:56Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:477624861client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4862worker1 # [ 55.022534] nix-grpc-daemon[787]: ts=2026-09-20T08:16:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:459744863worker1 # [ 55.215179] nix-daemon[872]: accepted connection from pid 1169, user nix-grpc-daemon (trusted)4864worker1 # [ 55.227653] nix-daemon[872]: reaped child process 1172, status = succeeded4865lb # [ 55.243405] niks3-server[1088]: 2026/09/20 08:16:56 INFO Received uploads request method=POST path=/api/pending_closures4866worker1 # [ 55.254075] nix-grpc-daemon[884]: time=2026-09-20T08:16:57.173Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4867worker1 # [ 55.255897] nix-grpc-daemon[884]: time=2026-09-20T08:16:57.175Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4868lb # [ 55.273703] niks3-server[1088]: 2026/09/20 08:16:56 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4869lb # [ 55.283862] niks3-server[1088]: 2026/09/20 08:16:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4870worker1 # [ 55.291492] nix-grpc-daemon[884]: time=2026-09-20T08:16:57.210Z level=INFO msg="Uploading 1 narinfos"4871lb # [ 55.289237] niks3-server[1088]: 2026/09/20 08:16:56 INFO Signed narinfos id=15 count=14872lb # [ 55.295604] niks3-server[1088]: 2026/09/20 08:16:56 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4873lb # [ 55.306880] niks3-server[1088]: 2026/09/20 08:16:56 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4874lb # [ 55.312733] niks3-server[1088]: 2026/09/20 08:16:56 INFO Completed upload id=154875worker1 # [ 55.317648] nix-grpc-daemon[884]: time=2026-09-20T08:16:57.236Z level=INFO msg="Upload complete. (290ms)"4876lb # [ 55.315679] niks3-server[1088]: 2026/09/20 08:16:56 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4877worker1 # [ 55.337197] nix-grpc-daemon[787]: ts=2026-09-20T08:16:57Z level=debug event=want client=8 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04878worker1 # [ 55.341197] nix-grpc-daemon[787]: ts=2026-09-20T08:16:57Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14879worker2 # [ 55.388936] nix-grpc-daemon[784]: ts=2026-09-20T08:16:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:477624880worker2 # [ 55.398595] nix-grpc-daemon[784]: ts=2026-09-20T08:16:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:477624881client # copying 2 paths to 'lb:50051'...4882worker2 # [ 55.415455] nix-grpc-daemon[784]: ts=2026-09-20T08:16:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:477624883client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4884client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4885worker2 # [ 55.429882] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4886worker2 # [ 55.601050] nix-daemon[847]: accepted connection from pid 952, user nix-grpc-daemon (trusted)4887worker2 # [ 55.614066] nix-daemon[847]: reaped child process 955, status = succeeded4888worker2 # [ 55.772326] nix-daemon[847]: accepted connection from pid 957, user nix-grpc-daemon (trusted)4889worker2 # [ 55.785087] nix-daemon[847]: reaped child process 960, status = succeeded4890lb # [ 55.790165] niks3-server[1088]: 2026/09/20 08:16:57 INFO Received uploads request method=POST path=/api/pending_closures4891lb # [ 55.799060] niks3-server[1088]: 2026/09/20 08:16:57 INFO Received uploads request method=POST path=/api/pending_closures4892worker2 # [ 55.816714] nix-grpc-daemon[872]: time=2026-09-20T08:16:57.587Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4893worker2 # [ 55.818980] nix-grpc-daemon[872]: time=2026-09-20T08:16:57.588Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4894worker2 # [ 55.820721] nix-grpc-daemon[872]: time=2026-09-20T08:16:57.588Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4895lb # [ 55.840861] niks3-server[1088]: 2026/09/20 08:16:57 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4896lb # [ 55.846073] niks3-server[1088]: 2026/09/20 08:16:57 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4897lb # [ 55.854786] niks3-server[1088]: 2026/09/20 08:16:57 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4898lb # [ 55.859871] niks3-server[1088]: 2026/09/20 08:16:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4899lb # [ 55.863313] niks3-server[1088]: 2026/09/20 08:16:57 INFO Signed narinfos id=17 count=24900lb # [ 55.866787] niks3-server[1088]: 2026/09/20 08:16:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4901lb # [ 55.868463] niks3-server[1088]: 2026/09/20 08:16:57 INFO Signed narinfos id=16 count=14902worker2 # [ 55.879807] nix-grpc-daemon[872]: time=2026-09-20T08:16:57.649Z level=INFO msg="Uploading 3 narinfos"4903lb # [ 55.872198] niks3-server[1088]: 2026/09/20 08:16:57 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4904lb # [ 55.883448] niks3-server[1088]: 2026/09/20 08:16:57 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4905lb # [ 55.889220] niks3-server[1088]: 2026/09/20 08:16:57 INFO Completed upload id=164906lb # [ 55.890818] niks3-server[1088]: 2026/09/20 08:16:57 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4907lb # [ 55.892612] niks3-server[1088]: 2026/09/20 08:16:57 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4908lb # [ 55.894057] niks3-server[1088]: 2026/09/20 08:16:57 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4909lb # [ 55.896696] niks3-server[1088]: 2026/09/20 08:16:57 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4910lb # [ 55.898750] niks3-server[1088]: 2026/09/20 08:16:57 INFO Completed upload id=174911worker2 # [ 55.910340] nix-grpc-daemon[872]: time=2026-09-20T08:16:57.680Z level=INFO msg="Upload complete. (473ms)"4912worker2 # [ 55.916178] nix-grpc-daemon[784]: ts=2026-09-20T08:16:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47762 duration_s=0 paths=2 nar_bytes_in=9764913worker2 # [ 55.922438] nix-grpc-daemon[784]: ts=2026-09-20T08:16:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:477624914worker2 # [ 55.933812] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4915worker2 # [ 55.941932] nix-daemon[847]: reaped child process 950, status = succeeded4916worker2 # [ 55.951724] nix-grpc-daemon[784]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...4917worker2 # [ 55.960584] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4918client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...4919client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4920worker2 # [ 56.586336] nix-daemon[847]: reaped child process 965, status = succeeded4921worker2 # [ 56.757100] nix-daemon[847]: accepted connection from pid 980, user nix-grpc-daemon (trusted)4922worker2 # [ 56.768194] nix-daemon[847]: reaped child process 983, status = succeeded4923lb # [ 56.776602] niks3-server[1088]: 2026/09/20 08:16:58 INFO Received uploads request method=POST path=/api/pending_closures4924worker2 # [ 56.791031] nix-grpc-daemon[872]: time=2026-09-20T08:16:58.561Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4925lb # [ 56.792540] niks3-server[1088]: 2026/09/20 08:16:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4926worker2 # [ 56.806515] nix-grpc-daemon[872]: time=2026-09-20T08:16:58.577Z level=INFO msg="Uploading 1 narinfos"4927lb # [ 56.796165] niks3-server[1088]: 2026/09/20 08:16:58 INFO Signed narinfos id=18 count=14928lb # [ 56.798703] niks3-server[1088]: 2026/09/20 08:16:58 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls4929lb # [ 56.801380] niks3-server[1088]: 2026/09/20 08:16:58 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4930lb # [ 56.806938] niks3-server[1088]: 2026/09/20 08:16:58 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4931lb # [ 56.810058] niks3-server[1088]: 2026/09/20 08:16:58 INFO Completed upload id=184932worker2 # [ 56.820590] nix-grpc-daemon[872]: time=2026-09-20T08:16:58.590Z level=INFO msg="Upload complete. (251ms)"4933lb # [ 56.812790] niks3-server[1088]: 2026/09/20 08:16:58 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo4934worker2 # [ 56.824212] nix-grpc-daemon[784]: ts=2026-09-20T08:16:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47762 duration_s=0 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=8 outputs=14935worker2 # [ 56.829323] nix-daemon[847]: reaped child process 962, status = succeeded4936client # copying 1 paths...4937worker1 # [ 56.862878] nix-grpc-daemon[787]: ts=2026-09-20T08:16:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:459744938worker1 # [ 56.877164] nix-grpc-daemon[787]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...4939client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...4940worker1 # [ 56.908679] nix-grpc-daemon[787]: ts=2026-09-20T08:16:58Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:459744941worker1 # [ 56.914222] nix-grpc-daemon[787]: ts=2026-09-20T08:16:58Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=0 paths=1 nar_bytes_out=1204942client # [ 57.023985] nix-daemon[928]: reaped child process 1014, status = succeeded4943client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.36 seconds)4944client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&24945client # [ 57.211109] nix-daemon[928]: accepted connection from pid 1033, user root (trusted)4946client # this derivation will be built:4947client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4948worker2 # [ 57.376528] nix-grpc-daemon[784]: ts=2026-09-20T08:16:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:477624949client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4950worker1 # [ 57.371973] nix-grpc-daemon[787]: ts=2026-09-20T08:16:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:459744951worker1 # [ 57.381817] nix-grpc-daemon[884]: time=2026-09-20T08:16:59.300Z level=INFO msg="All 1 paths already cached"4952worker1 # [ 57.396239] nix-grpc-daemon[787]: ts=2026-09-20T08:16:59Z level=debug event=want client=9 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=04953worker1 # [ 57.402913] nix-grpc-daemon[787]: ts=2026-09-20T08:16:59Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14954worker1 # [ 57.407659] nix-grpc-daemon[787]: ts=2026-09-20T08:16:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:459744955worker1 # [ 57.418875] nix-grpc-daemon[787]: ts=2026-09-20T08:16:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:459744956client # copying 1 paths to 'lb:50051'...4957client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...4958worker1 # [ 57.436070] nix-grpc-daemon[787]: ts=2026-09-20T08:16:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:459744959worker1 # [ 57.447375] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4960worker1 # [ 57.462859] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 1/5)4961worker1 # [ 57.528857] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 200 ms (attempt 2/5)4962worker1 # [ 57.734994] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 278 ms (attempt 3/5)4963worker1 # [ 58.020463] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 110 ms (attempt 4/5)4964worker1 # [ 58.137227] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4965worker1 # [ 58.142390] nix-grpc-daemon[787]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...4966worker1 # [ 58.352156] nix-daemon[872]: accepted connection from pid 1185, user nix-grpc-daemon (trusted)4967worker1 # [ 58.365955] nix-daemon[872]: reaped child process 1188, status = succeeded4968worker1 # [ 58.543680] nix-daemon[872]: accepted connection from pid 1190, user nix-grpc-daemon (trusted)4969worker1 # [ 58.557725] nix-daemon[872]: reaped child process 1193, status = succeeded4970lb # [ 58.571597] niks3-server[1088]: 2026/09/20 08:17:00 INFO Received uploads request method=POST path=/api/pending_closures4971worker1 # [ 58.675748] nix-grpc-daemon[884]: time=2026-09-20T08:17:00.594Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4972worker1 # [ 58.680816] nix-grpc-daemon[884]: time=2026-09-20T08:17:00.594Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"4973lb # [ 58.698420] niks3-server[1088]: 2026/09/20 08:17:00 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst4974lb # [ 58.705933] niks3-server[1088]: 2026/09/20 08:17:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4975lb # [ 58.710647] niks3-server[1088]: 2026/09/20 08:17:00 INFO Signed narinfos id=19 count=14976worker1 # [ 58.716626] nix-grpc-daemon[884]: time=2026-09-20T08:17:00.635Z level=INFO msg="Uploading 1 narinfos"4977lb # [ 58.721339] niks3-server[1088]: 2026/09/20 08:17:00 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls4978lb # [ 58.728140] niks3-server[1088]: 2026/09/20 08:17:00 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4979lb # [ 58.736238] niks3-server[1088]: 2026/09/20 08:17:00 INFO Completed upload id=194980worker1 # [ 58.738777] nix-grpc-daemon[884]: time=2026-09-20T08:17:00.658Z level=INFO msg="Upload complete. (576ms)"4981lb # [ 58.739581] niks3-server[1088]: 2026/09/20 08:17:00 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo4982worker1 # [ 58.743576] nix-grpc-daemon[787]: ts=2026-09-20T08:17:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=1 paths=1 nar_bytes_in=5604983worker1 # [ 58.750569] nix-grpc-daemon[787]: ts=2026-09-20T08:17:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:459744984worker1 # [ 58.762139] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4985worker1 # [ 58.777457] nix-daemon[872]: reaped child process 1179, status = succeeded4986client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...4987worker1 # [ 58.783729] nix-daemon[872]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4988client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4989lb # [ 59.105734] envoy[988]: conn peer=[2001:db8:1::1]:51540 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3854 tx=1851 ms=23544990lb # [ 59.107313] envoy[988]: conn peer=[2001:db8:1::1]:51544 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=554991lb # [ 59.108692] envoy[988]: conn peer=[2001:db8:1::1]:50548 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=411 ms=944992lb # [ 59.110086] envoy[988]: conn peer=[2001:db8:1::1]:51550 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4313 tx=2109 ms=22114993lb # [ 59.111502] envoy[988]: conn peer=[2001:db8:1::1]:50568 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=554994lb # [ 59.112865] envoy[988]: conn peer=[2001:db8:1::1]:50552 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3835 tx=1877 ms=19484995worker1 # [ 60.213864] nix-daemon[872]: reaped child process 1197, status = succeeded4996worker1 # [ 60.376303] nix-daemon[872]: accepted connection from pid 1212, user nix-grpc-daemon (trusted)4997worker1 # [ 60.389251] nix-daemon[872]: reaped child process 1215, status = succeeded4998lb # [ 60.403590] niks3-server[1088]: 2026/09/20 08:17:02 INFO Received uploads request method=POST path=/api/pending_closures4999worker1 # [ 60.414543] nix-grpc-daemon[884]: time=2026-09-20T08:17:02.333Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5000lb # [ 60.433074] niks3-server[1088]: 2026/09/20 08:17:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5001lb # [ 60.440568] niks3-server[1088]: 2026/09/20 08:17:02 INFO Signed narinfos id=20 count=15002worker1 # [ 60.446524] nix-grpc-daemon[884]: time=2026-09-20T08:17:02.365Z level=INFO msg="Uploading 1 narinfos"5003lb # [ 60.447811] niks3-server[1088]: 2026/09/20 08:17:02 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5004lb # [ 60.455088] niks3-server[1088]: 2026/09/20 08:17:02 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5005lb # [ 60.468904] niks3-server[1088]: 2026/09/20 08:17:02 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5006lb # [ 60.473809] niks3-server[1088]: 2026/09/20 08:17:02 INFO Completed upload id=205007worker1 # [ 60.476207] nix-grpc-daemon[884]: time=2026-09-20T08:17:02.395Z level=INFO msg="Upload complete. (277ms)"5008lb # [ 60.477150] niks3-server[1088]: 2026/09/20 08:17:02 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5009worker1 # [ 60.482129] nix-grpc-daemon[787]: ts=2026-09-20T08:17:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45974 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=9 outputs=15010client # copying 1 paths...5011client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5012worker1 # [ 60.491706] nix-grpc-daemon[787]: ts=2026-09-20T08:17:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:459745013worker1 # [ 60.496724] nix-daemon[872]: reaped child process 1195, status = succeeded5014worker2 # [ 60.511925] nix-grpc-daemon[784]: ts=2026-09-20T08:17:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:477625015worker2 # [ 60.522774] nix-grpc-daemon[784]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5016worker2 # [ 60.535783] nix-grpc-daemon[784]: ts=2026-09-20T08:17:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47762 duration_s=0 paths=1 nar_bytes_out=1205017client # [ 60.637458] nix-daemon[928]: reaped child process 1036, status = succeeded5018client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.61 seconds)5019client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25020client # [ 60.820950] nix-daemon[928]: accepted connection from pid 1055, user root (trusted)5021client # this derivation will be built:5022client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5023worker2 # [ 61.308812] nix-grpc-daemon[784]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:477625024client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5025worker1 # [ 61.304611] nix-grpc-daemon[787]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:459745026worker1 # [ 61.313323] nix-grpc-daemon[884]: time=2026-09-20T08:17:03.232Z level=INFO msg="All 1 paths already cached"5027worker1 # [ 61.326990] nix-grpc-daemon[787]: ts=2026-09-20T08:17:03Z level=debug event=want client=10 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05028worker1 # [ 61.331820] nix-grpc-daemon[787]: ts=2026-09-20T08:17:03Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15029worker2 # [ 61.341834] nix-grpc-daemon[784]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:477625030worker2 # [ 61.354471] nix-grpc-daemon[784]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:477625031worker2 # [ 61.367773] nix-grpc-daemon[872]: time=2026-09-20T08:17:03.137Z level=INFO msg="All 1 paths already cached"5032client # copying 1 paths to 'lb:50051'...5033client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5034worker2 # [ 61.374855] nix-grpc-daemon[784]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:477625035worker2 # [ 61.386316] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5036worker2 # [ 61.582551] nix-daemon[847]: accepted connection from pid 988, user nix-grpc-daemon (trusted)5037worker2 # [ 61.596858] nix-daemon[847]: reaped child process 991, status = succeeded5038worker2 # [ 61.780474] nix-daemon[847]: accepted connection from pid 993, user nix-grpc-daemon (trusted)5039worker2 # [ 61.792929] nix-daemon[847]: reaped child process 996, status = succeeded5040lb # [ 61.798884] niks3-server[1088]: 2026/09/20 08:17:03 INFO Received uploads request method=POST path=/api/pending_closures5041worker2 # [ 61.819606] nix-grpc-daemon[872]: time=2026-09-20T08:17:03.590Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5042worker2 # [ 61.821035] nix-grpc-daemon[872]: time=2026-09-20T08:17:03.590Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5043lb # [ 61.823277] niks3-server[1088]: 2026/09/20 08:17:03 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5044lb # [ 61.830361] niks3-server[1088]: 2026/09/20 08:17:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5045lb # [ 61.832417] niks3-server[1088]: 2026/09/20 08:17:03 INFO Signed narinfos id=21 count=15046worker2 # [ 61.843102] nix-grpc-daemon[872]: time=2026-09-20T08:17:03.613Z level=INFO msg="Uploading 1 narinfos"5047lb # [ 61.837118] niks3-server[1088]: 2026/09/20 08:17:03 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5048lb # [ 61.840791] niks3-server[1088]: 2026/09/20 08:17:03 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5049lb # [ 61.844590] niks3-server[1088]: 2026/09/20 08:17:03 INFO Completed upload id=215050worker2 # [ 61.856112] nix-grpc-daemon[872]: time=2026-09-20T08:17:03.626Z level=INFO msg="Upload complete. (457ms)"5051lb # [ 61.846143] niks3-server[1088]: 2026/09/20 08:17:03 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5052worker2 # [ 61.859282] nix-grpc-daemon[784]: ts=2026-09-20T08:17:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47762 duration_s=0 paths=1 nar_bytes_in=5605053worker2 # [ 61.861682] nix-grpc-daemon[784]: ts=2026-09-20T08:17:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:477625054worker2 # [ 61.868126] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5055worker2 # [ 61.870616] nix-daemon[847]: reaped child process 986, status = succeeded5056client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5057worker2 # [ 61.876722] nix-daemon[847]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5058client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5059worker2 # [ 62.889869] nix-daemon[847]: reaped child process 1000, status = succeeded5060worker2 # [ 63.021308] nix-daemon[847]: accepted connection from pid 1015, user nix-grpc-daemon (trusted)5061worker2 # [ 63.032646] nix-daemon[847]: reaped child process 1018, status = succeeded5062lb # [ 63.034586] niks3-server[1088]: 2026/09/20 08:17:04 INFO Received uploads request method=POST path=/api/pending_closures5063worker2 # [ 63.053255] nix-grpc-daemon[872]: time=2026-09-20T08:17:04.823Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5064lb # [ 63.066878] niks3-server[1088]: 2026/09/20 08:17:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5065lb # [ 63.071219] niks3-server[1088]: 2026/09/20 08:17:04 INFO Signed narinfos id=22 count=15066worker2 # [ 63.084554] nix-grpc-daemon[872]: time=2026-09-20T08:17:04.855Z level=INFO msg="Uploading 1 narinfos"5067lb # [ 63.079536] niks3-server[1088]: 2026/09/20 08:17:04 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5068lb # [ 63.085102] niks3-server[1088]: 2026/09/20 08:17:04 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5069lb # [ 63.096975] niks3-server[1088]: 2026/09/20 08:17:04 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5070lb # [ 63.103467] niks3-server[1088]: 2026/09/20 08:17:04 INFO Completed upload id=225071worker2 # [ 63.113763] nix-grpc-daemon[872]: time=2026-09-20T08:17:04.884Z level=INFO msg="Upload complete. (231ms)"5072lb # [ 63.106768] niks3-server[1088]: 2026/09/20 08:17:04 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5073worker2 # [ 63.119341] nix-grpc-daemon[784]: ts=2026-09-20T08:17:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47762 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=10 outputs=15074worker2 # [ 63.129969] nix-daemon[847]: reaped child process 998, status = succeeded5075client # copying 1 paths...5076worker2 # [ 63.168133] nix-grpc-daemon[784]: ts=2026-09-20T08:17:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:477625077client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5078worker2 # [ 63.187580] nix-grpc-daemon[784]: ts=2026-09-20T08:17:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:477625079worker2 # [ 63.191995] nix-grpc-daemon[784]: ts=2026-09-20T08:17:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47762 duration_s=0 paths=1 nar_bytes_out=1205080client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.65 seconds)5081(finished: subtest: an input only one worker has still reaches the builder, in 9.40 seconds)5082subtest: upload whose reference the worker lacks is completed from the cache5083client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5084client # [ 63.570104] nix-daemon[928]: reaped child process 1058, status = succeeded5085client # this derivation will be built:5086client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5087client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5088client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.55 seconds)5089client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5090client # this derivation will be built:5091client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5092client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5093client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.41 seconds)5094client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5095client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds)5096worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5097worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.20 seconds)5098worker2 # [ 64.712595] systemd[1]: Stopping Nix worker-protocol over gRPC...5099worker2 # [ 65.348369] nix-grpc-daemon[784]: ts=2026-09-20T08:17:07Z level=info event=signal_exit5100worker2 # [ 66.592833] nix-grpc-daemon[784]: ts=2026-09-20T08:17:08Z level=info event=scheduler_restarting5101worker1 # [ 66.594997] nix-grpc-daemon[787]: ts=2026-09-20T08:17:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:401885102worker1 # [ 66.598807] nix-grpc-daemon[787]: ts=2026-09-20T08:17:08Z level=info event=worker_gone addr=192.168.1.4:500515103worker2 # [ 66.614408] nix-grpc-daemon[784]: ts=2026-09-20T08:17:08Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5104worker2 # [ 66.644573] nix-daemon[847]: reaped child process 849, status = succeeded5105worker2 # [ 66.659426] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5106worker2 # [ 66.662758] systemd[1]: Stopped Nix worker-protocol over gRPC.5107worker2 # [ 66.665665] systemd[1]: nix-grpc-daemon.service: Consumed 1.290s CPU time over 47.549s wall clock time, 50.6M memory peak, 43.2K incoming IP traffic, 78.7K outgoing IP traffic.5108worker2 # [ 66.672926] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5109worker2 # [ 66.674767] systemd[1]: Closed Nix worker-protocol over gRPC.5110worker2 # [ 66.675984] systemd[1]: nix-grpc-daemon.socket: Consumed 296us CPU time over 57.026s wall clock time, 256K memory peak, 72.3K incoming IP traffic, 63.5K outgoing IP traffic.5111lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5112lb: must succeed: curl -sf localhost:9901/clusters5113lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5114lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.08 seconds)5115client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25116worker1 # [ 66.964335] nix-grpc-daemon[787]: ts=2026-09-20T08:17:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:459745117client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5118worker1 # [ 66.969653] nix-grpc-daemon[787]: ts=2026-09-20T08:17:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:459745119client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.24 seconds)5120worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5121worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5122worker2 # [ 67.069749] systemd[1]: Listening on Nix worker-protocol over gRPC.5123worker1 # [ 67.124406] systemd[1]: Stopping Nix worker-protocol over gRPC...5124worker1 # [ 67.370606] nix-grpc-daemon[787]: ts=2026-09-20T08:17:09Z level=info event=signal_exit5125worker2 # [ 67.468940] systemd[1]: Starting Nix worker-protocol over gRPC...5126worker1 # [ 67.613634] nix-grpc-daemon[787]: ts=2026-09-20T08:17:09Z level=info event=scheduler_yield5127worker1 # [ 67.617920] nix-grpc-daemon[787]: ts=2026-09-20T08:17:09Z level=info event=scheduler_restarting addr=lb:500515128lb # [ 67.615752] niks3-server[1088]: 2026/09/20 08:17:09 INFO lead: released remote=192.168.1.3:581705129worker1 # [ 67.622246] nix-grpc-daemon[787]: ts=2026-09-20T08:17:09Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:401885130worker1 # [ 67.626331] nix-grpc-daemon[787]: ts=2026-09-20T08:17:09Z level=info event=worker_gone addr=192.168.1.3:500515131worker2 # [ 67.655724] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5132worker2 # [ 67.659714] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15133worker2 # [ 67.666069] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:09Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5134worker2 # [ 67.670317] systemd[1]: Started Nix worker-protocol over gRPC.5135lb # [ 67.668372] niks3-server[1088]: 2026/09/20 08:17:09 INFO lead: acquired remote=192.168.1.4:362245136worker2 # [ 67.682179] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:09Z level=info event=scheduler_take_over5137worker2 # [ 67.699493] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:09Z level=info event=scheduler_connected addr=lb:500515138worker2 # [ 67.709801] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5139worker1 # [ 67.818944] nix-grpc-daemon[787]: ts=2026-09-20T08:17:09Z level=info event=scheduler_connected addr=lb:500515140worker2 # [ 67.835662] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:09Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05141worker2 # [ 67.910794] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:09Z level=info event=scheduler_connected addr=lb:500515142worker2 # [ 67.915593] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5143worker2 # [ 68.116457] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:09Z level=info event=scheduler_connected addr=lb:500515144worker2 # [ 68.121389] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:09Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05145worker2 # [ 68.632555] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:525165146worker1 # [ 68.622992] nix-grpc-daemon[787]: ts=2026-09-20T08:17:10Z level=info event=scheduler_restarting5147worker2 # [ 68.636475] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:10Z level=info event=worker_gone addr=192.168.1.3:500515148worker1 # [ 68.644884] nix-grpc-daemon[787]: ts=2026-09-20T08:17:10Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5149worker1 # [ 68.661810] nix-daemon[872]: reaped child process 874, status = succeeded5150lb # [ 69.106421] envoy[988]: conn peer=[2001:db8:1::1]:50572 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3698 tx=1802 ms=32115151lb # [ 69.110347] envoy[988]: conn peer=[2001:db8:1::1]:50584 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=755152lb # [ 69.114208] envoy[988]: conn peer=[2001:db8:1::1]:50590 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=1800 ms=19355153lb # [ 69.117770] envoy[988]: conn peer=[2001:db8:1::1]:60920 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=585154lb # [ 69.121225] envoy[988]: conn peer=192.168.1.4:36112 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=7534 tx=1551 ms=462795155lb # [ 69.124798] envoy[988]: conn peer=[2001:db8:1::1]:60930 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=155156lb # [ 69.128355] envoy[988]: conn peer=[2001:db8:1::3]:59974 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9894 tx=2116 ms=492285157worker1 # [ 69.506331] nix-grpc-daemon[787]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5158worker1 # [ 69.509719] nix-grpc-daemon[787]: E0000 00:00:1789892231.425056 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5159worker1 # [ 69.514283] nix-grpc-daemon[787]: E0000 00:00:1789892231.425676 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5160worker1 # [ 70.596486] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5161worker1 # [ 70.600917] systemd[1]: Stopped Nix worker-protocol over gRPC.5162worker1 # [ 70.604479] systemd[1]: nix-grpc-daemon.service: Consumed 2.606s CPU time over 51.498s wall clock time, 63.9M memory peak, 85.5K incoming IP traffic, 194.3K outgoing IP traffic.5163worker1 # [ 70.615661] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5164worker1 # [ 70.619965] systemd[1]: Closed Nix worker-protocol over gRPC.5165worker1 # [ 70.623540] systemd[1]: nix-grpc-daemon.socket: Consumed 322us CPU time over 1min 13ms wall clock time, 256K memory peak, 101.3K incoming IP traffic, 79.4K outgoing IP traffic.5166lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5167lb: must succeed: curl -sf localhost:9901/clusters5168lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5169lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.08 seconds)5170client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25171worker2 # [ 70.943876] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:525225172worker2 # [ 70.955342] nix-daemon[847]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)5173worker2 # [ 70.972466] nix-grpc-daemon[1039]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 1/5)5174worker2 # [ 71.061436] nix-grpc-daemon[1039]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 2/5)5175worker2 # [ 71.148529] nix-grpc-daemon[1039]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 3/5)5176worker2 # [ 71.206809] nix-grpc-daemon[1039]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 421 ms (attempt 4/5)5177worker2 # [ 71.634661] nix-grpc-daemon[1039]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5178client # copying 2 paths...5179client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5180client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5181worker2 # [ 71.656455] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:525225182worker2 # [ 71.667266] nix-daemon[847]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)5183worker2 # [ 71.686506] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:13Z level=info event=niks3_push_started pid=10955184worker2 # [ 72.046778] nix-daemon[847]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)5185worker2 # [ 72.059726] nix-daemon[847]: reaped child process 1111, status = succeeded5186lb # [ 72.064107] niks3-server[1088]: 2026/09/20 08:17:13 INFO Received uploads request method=POST path=/api/pending_closures5187lb # [ 72.069964] niks3-server[1088]: 2026/09/20 08:17:13 INFO Received uploads request method=POST path=/api/pending_closures5188worker2 # [ 72.083481] nix-grpc-daemon[1095]: time=2026-09-20T08:17:13.853Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5189worker2 # [ 72.086070] nix-grpc-daemon[1095]: time=2026-09-20T08:17:13.855Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5190worker2 # [ 72.087677] nix-grpc-daemon[1095]: time=2026-09-20T08:17:13.855Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5191lb # [ 72.112276] niks3-server[1088]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5192lb # [ 72.123242] niks3-server[1088]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5193lb # [ 72.131733] niks3-server[1088]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5194lb # [ 72.137454] niks3-server[1088]: 2026/09/20 08:17:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5195lb # [ 72.139839] niks3-server[1088]: 2026/09/20 08:17:13 INFO Signed narinfos id=23 count=15196lb # [ 72.141682] niks3-server[1088]: 2026/09/20 08:17:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5197lb # [ 72.144206] niks3-server[1088]: 2026/09/20 08:17:13 INFO Signed narinfos id=24 count=25198lb # [ 72.145346] niks3-server[1088]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5199worker2 # [ 72.155148] nix-grpc-daemon[1095]: time=2026-09-20T08:17:13.925Z level=INFO msg="Uploading 3 narinfos"5200lb # [ 72.159621] niks3-server[1088]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5201lb # [ 72.161881] niks3-server[1088]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5202lb # [ 72.166607] niks3-server[1088]: 2026/09/20 08:17:13 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5203lb # [ 72.169175] niks3-server[1088]: 2026/09/20 08:17:13 INFO Completed upload id=235204lb # [ 72.170489] niks3-server[1088]: 2026/09/20 08:17:13 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5205lb # [ 72.173629] niks3-server[1088]: 2026/09/20 08:17:13 INFO Completed upload id=245206lb # [ 72.175096] niks3-server[1088]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5207worker2 # [ 72.185480] nix-grpc-daemon[1095]: time=2026-09-20T08:17:13.956Z level=INFO msg="Upload complete. (293ms)"5208worker2 # [ 72.192492] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52522 duration_s=0 paths=2 nar_bytes_in=3125209worker2 # [ 72.204560] nix-daemon[847]: reaped child process 1093, status = succeeded5210client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.51 seconds)5211worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5212worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.03 seconds)5213worker1 # [ 72.308487] systemd[1]: Listening on Nix worker-protocol over gRPC.5214worker1 # [ 72.315657] systemd[1]: Starting Nix worker-protocol over gRPC...5215worker1 # [ 72.479465] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5216worker1 # [ 72.483542] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15217worker1 # [ 72.489989] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5218worker1 # [ 72.493710] systemd[1]: Started Nix worker-protocol over gRPC.5219lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5220lb: must succeed: curl -sf localhost:9901/clusters5221worker1 # [ 72.523726] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:14Z level=info event=scheduler_connected addr=lb:500515222worker2 # [ 72.534051] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05223lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5224lb: must succeed: curl -sf localhost:9901/clusters5225lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5226lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.14 seconds)5227(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.35 seconds)5228subtest: scheduler down: the other node takes the lock and keeps it5229lb: must succeed: curl -sf localhost:9901/clusters5230lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5231lb: must succeed: curl -sf localhost:9901/clusters5232lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5233lb: must succeed: curl -sf localhost:9901/clusters5234lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5235lb: must succeed: curl -sf localhost:9901/clusters5236lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5237worker2 # [ 73.888319] systemd[1]: Stopping Nix worker-protocol over gRPC...5238worker2 # [ 74.675873] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:16Z level=info event=signal_exit5239worker2 # [ 74.882328] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:16Z level=info event=scheduler_yield5240lb # [ 74.873337] niks3-server[1088]: 2026/09/20 08:17:16 INFO lead: released remote=192.168.1.4:362245241worker1 # [ 74.881862] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:16Z level=info event=scheduler_restarting addr=lb:500515242worker2 # [ 74.889377] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:525165243worker2 # [ 74.895912] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:16Z level=info event=worker_gone addr=192.168.1.3:500515244worker2 # [ 74.899479] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:16Z level=info event=scheduler_restarting addr=lb:500515245worker2 # [ 74.902468] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:525165246worker2 # [ 74.905707] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:16Z level=info event=worker_gone addr=192.168.1.4:500515247worker1 # [ 75.081799] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500515248worker1 # [ 75.090066] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5249worker2 # [ 75.096608] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:16Z level=info event=scheduler_connected addr=lb:500515250worker2 # [ 75.109277] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5251worker1 # [ 75.290914] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500515252worker1 # [ 75.293921] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5253worker2 # [ 75.310346] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500515254worker2 # [ 75.316367] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5255worker1 # [ 75.494646] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500515256worker1 # [ 75.497286] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5257worker2 # [ 75.517536] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500515258worker2 # [ 75.522708] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5259worker1 # [ 75.698639] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500515260worker1 # [ 75.703646] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5261worker2 # [ 75.725917] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500515262worker2 # [ 75.729210] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5263worker2 # [ 75.886954] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:17Z level=info event=scheduler_restarting5264worker2 # [ 75.908690] nix-daemon[847]: reaped child process 1088, status = succeeded5265worker1 # [ 75.907244] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500515266worker1 # [ 75.910494] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5267worker2 # [ 75.936548] nix-grpc-daemon[1039]: ts=2026-09-20T08:17:17Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5268worker1 # [ 76.108072] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:18Z level=info event=scheduler_connected addr=lb:500515269worker2 # [ 76.118326] nix-grpc-daemon[1039]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5270worker2 # [ 76.121898] nix-grpc-daemon[1039]: E0000 00:00:1789892237.888409 1082 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5271worker2 # [ 76.704457] nix-grpc-daemon[1039]: E0000 00:00:1789892238.475024 1082 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5272worker2 # [ 76.708702] nix-grpc-daemon[1039]: E0000 00:00:1789892238.479056 1082 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5273worker1 # [ 77.502752] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:19Z level=info event=scheduler_take_over5274lb # [ 77.500611] niks3-server[1088]: 2026/09/20 08:17:19 INFO lead: acquired remote=192.168.1.3:449325275worker1 # [ 77.671469] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:19Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5276worker2 # [ 77.699959] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5277worker2 # [ 77.704660] systemd[1]: Stopped Nix worker-protocol over gRPC.5278worker2 # [ 77.707598] systemd[1]: nix-grpc-daemon.service: Consumed 379ms CPU time over 10.230s wall clock time, 32.6M memory peak, 17.3K incoming IP traffic, 22.5K outgoing IP traffic.5279worker2 # [ 77.717821] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5280worker2 # [ 77.722411] systemd[1]: Closed Nix worker-protocol over gRPC.5281worker2 # [ 77.725820] systemd[1]: nix-grpc-daemon.socket: Consumed 287us CPU time over 10.655s wall clock time, 256K memory peak, 28K incoming IP traffic, 23.9K outgoing IP traffic.5282worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5283worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.05 seconds)5284worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5285worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5286worker1 # [ 77.872255] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:19Z level=info event=scheduler_connected addr=lb:500515287worker1 # [ 77.874698] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:19Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05288worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5289worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.05 seconds)5290client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&25291worker1 # [ 79.082367] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:560825292worker1 # [ 79.094112] nix-daemon[872]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)5293client # don't know how to build these paths:5294client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5295lb # [ 79.107393] envoy[988]: conn peer=[2001:db8:1::1]:60938 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1006 tx=305 ms=12615296lb # [ 79.113373] envoy[988]: conn peer=[2001:db8:1::4]:51298 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1711 tx=441 ms=82325297worker1 # [ 79.122227] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:21Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05298worker1 # [ 79.127227] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:21Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15299worker1 # [ 79.171874] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:560825300worker1 # [ 79.183862] nix-grpc-daemon[1240]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 1/5)5301worker1 # [ 79.233299] nix-grpc-daemon[1240]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 120 ms (attempt 2/5)5302worker1 # [ 79.359158] nix-grpc-daemon[1240]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 204 ms (attempt 3/5)5303worker1 # [ 79.568845] nix-grpc-daemon[1240]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 29 ms (attempt 4/5)5304worker1 # [ 79.598249] nix-grpc-daemon[1240]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5305worker1 # [ 79.611722] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:560825306client # copying 1 paths to 'lb:50051'...5307client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5308worker1 # [ 79.619790] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:560825309worker1 # [ 79.625073] nix-daemon[872]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)5310worker1 # [ 79.636467] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:21Z level=info event=niks3_push_started pid=13145311worker1 # [ 79.990361] nix-daemon[872]: accepted connection from pid 1327, user nix-grpc-daemon (trusted)5312worker1 # [ 80.003134] nix-daemon[872]: reaped child process 1330, status = succeeded5313worker1 # [ 80.177540] nix-daemon[872]: accepted connection from pid 1332, user nix-grpc-daemon (trusted)5314worker1 # [ 80.190240] nix-daemon[872]: reaped child process 1335, status = succeeded5315lb # [ 80.204618] niks3-server[1088]: 2026/09/20 08:17:21 INFO Received uploads request method=POST path=/api/pending_closures5316worker1 # [ 80.216323] nix-grpc-daemon[1314]: time=2026-09-20T08:17:22.134Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5317worker1 # [ 80.217723] nix-grpc-daemon[1314]: time=2026-09-20T08:17:22.134Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5318lb # [ 80.237351] niks3-server[1088]: 2026/09/20 08:17:21 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5319lb # [ 80.247137] niks3-server[1088]: 2026/09/20 08:17:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5320lb # [ 80.252855] niks3-server[1088]: 2026/09/20 08:17:21 INFO Signed narinfos id=25 count=15321worker1 # [ 80.260554] nix-grpc-daemon[1314]: time=2026-09-20T08:17:22.179Z level=INFO msg="Uploading 1 narinfos"5322lb # [ 80.264341] niks3-server[1088]: 2026/09/20 08:17:21 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5323lb # [ 80.272050] niks3-server[1088]: 2026/09/20 08:17:21 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5324lb # [ 80.277788] niks3-server[1088]: 2026/09/20 08:17:21 INFO Completed upload id=255325worker1 # [ 80.280406] nix-grpc-daemon[1314]: time=2026-09-20T08:17:22.199Z level=INFO msg="Upload complete. (457ms)"5326worker1 # [ 80.285184] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56082 duration_s=0 paths=1 nar_bytes_in=5205327worker1 # [ 80.290700] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:560825328worker1 # [ 80.293759] nix-grpc-daemon[1314]: time=2026-09-20T08:17:22.209Z level=WARN msg="Failed to register uploaded object" key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo error="server returned 404: object is not pending upload\n"5329worker1 # [ 80.302843] nix-daemon[872]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)5330worker1 # [ 80.305191] nix-daemon[872]: reaped child process 1312, status = succeeded5331client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5332client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5333worker1 # [ 80.310555] nix-daemon[872]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)5334client # farm-a> LOG-farm-a-on-standby5335worker1 # [ 80.923477] nix-daemon[872]: reaped child process 1339, status = succeeded5336worker1 # [ 81.074653] nix-daemon[872]: accepted connection from pid 1354, user nix-grpc-daemon (trusted)5337worker1 # [ 81.087426] nix-daemon[872]: reaped child process 1357, status = succeeded5338lb # [ 81.101592] niks3-server[1088]: 2026/09/20 08:17:22 INFO Received uploads request method=POST path=/api/pending_closures5339worker1 # [ 81.115526] nix-grpc-daemon[1314]: time=2026-09-20T08:17:23.034Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5340worker1 # [ 81.117182] nix-grpc-daemon[1314]: time=2026-09-20T08:17:23.036Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5341lb # [ 81.151285] niks3-server[1088]: 2026/09/20 08:17:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5342worker1 # [ 81.162347] nix-grpc-daemon[1314]: time=2026-09-20T08:17:23.081Z level=INFO msg="Uploading 1 narinfos"5343lb # [ 81.159606] niks3-server[1088]: 2026/09/20 08:17:22 INFO Signed narinfos id=26 count=15344lb # [ 81.168720] niks3-server[1088]: 2026/09/20 08:17:22 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5345lb # [ 81.177761] niks3-server[1088]: 2026/09/20 08:17:22 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5346lb # [ 81.183712] niks3-server[1088]: 2026/09/20 08:17:22 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5347lb # [ 81.189383] niks3-server[1088]: 2026/09/20 08:17:22 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5348lb # [ 81.192500] niks3-server[1088]: 2026/09/20 08:17:22 INFO Completed upload id=265349worker1 # [ 81.195153] nix-grpc-daemon[1314]: time=2026-09-20T08:17:23.114Z level=INFO msg="Upload complete. (278ms)"5350lb # [ 81.193738] niks3-server[1088]: 2026/09/20 08:17:22 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5351worker1 # [ 81.199452] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56082 duration_s=0 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15352worker1 # [ 81.205974] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:23Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05353worker1 # [ 81.207977] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:23Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15354worker1 # [ 81.212813] nix-daemon[872]: reaped child process 1337, status = succeeded5355worker1 # [ 81.250114] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:560825356worker1 # [ 81.262700] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:560825357worker1 # [ 81.275423] nix-grpc-daemon[1314]: time=2026-09-20T08:17:23.194Z level=INFO msg="All 1 paths already cached"5358client # copying 1 paths to 'lb:50051'...5359client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5360worker1 # [ 81.283375] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:560825361worker1 # [ 81.291658] nix-daemon[872]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)5362worker1 # [ 81.459704] nix-daemon[872]: accepted connection from pid 1363, user nix-grpc-daemon (trusted)5363worker1 # [ 81.472599] nix-daemon[872]: reaped child process 1366, status = succeeded5364worker1 # [ 81.637573] nix-daemon[872]: accepted connection from pid 1368, user nix-grpc-daemon (trusted)5365worker1 # [ 81.650286] nix-daemon[872]: reaped child process 1371, status = succeeded5366lb # [ 81.665533] niks3-server[1088]: 2026/09/20 08:17:23 INFO Received uploads request method=POST path=/api/pending_closures5367worker1 # [ 81.675978] nix-grpc-daemon[1314]: time=2026-09-20T08:17:23.595Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5368worker1 # [ 81.678095] nix-grpc-daemon[1314]: time=2026-09-20T08:17:23.597Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5369lb # [ 81.695154] niks3-server[1088]: 2026/09/20 08:17:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5370lb # [ 81.701116] niks3-server[1088]: 2026/09/20 08:17:23 INFO Signed narinfos id=27 count=15371worker1 # [ 81.707075] nix-grpc-daemon[1314]: time=2026-09-20T08:17:23.626Z level=INFO msg="Uploading 1 narinfos"5372lb # [ 81.707071] niks3-server[1088]: 2026/09/20 08:17:23 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5373lb # [ 81.719316] niks3-server[1088]: 2026/09/20 08:17:23 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5374lb # [ 81.725864] niks3-server[1088]: 2026/09/20 08:17:23 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5375worker1 # [ 81.734057] nix-grpc-daemon[1314]: time=2026-09-20T08:17:23.653Z level=INFO msg="Upload complete. (430ms)"5376lb # [ 81.731859] niks3-server[1088]: 2026/09/20 08:17:23 INFO Completed upload id=275377worker1 # [ 81.736507] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56082 duration_s=0 paths=1 nar_bytes_in=6405378lb # [ 81.736930] niks3-server[1088]: 2026/09/20 08:17:23 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5379worker1 # [ 81.742273] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:560825380worker1 # [ 81.751059] nix-daemon[872]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)5381worker1 # [ 81.754740] nix-daemon[872]: reaped child process 1361, status = succeeded5382client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5383worker1 # [ 81.759834] nix-daemon[872]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)5384client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5385client # farm-b> LOG-farm-b-on-standby5386worker1 # [ 82.985233] nix-daemon[872]: reaped child process 1375, status = succeeded5387worker1 # [ 83.143457] nix-daemon[872]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5388worker1 # [ 83.154994] nix-daemon[872]: reaped child process 1393, status = succeeded5389lb # [ 83.172397] niks3-server[1088]: 2026/09/20 08:17:24 INFO Received uploads request method=POST path=/api/pending_closures5390worker1 # [ 83.183955] nix-grpc-daemon[1314]: time=2026-09-20T08:17:25.103Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5391worker1 # [ 83.185598] nix-grpc-daemon[1314]: time=2026-09-20T08:17:25.104Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5392lb # [ 83.210717] niks3-server[1088]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5393lb # [ 83.218643] niks3-server[1088]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5394lb # [ 83.230111] niks3-server[1088]: 2026/09/20 08:17:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5395worker1 # [ 83.239269] nix-grpc-daemon[1314]: time=2026-09-20T08:17:25.158Z level=INFO msg="Uploading 1 narinfos"5396lb # [ 83.236480] niks3-server[1088]: 2026/09/20 08:17:24 INFO Signed narinfos id=28 count=15397lb # [ 83.241871] niks3-server[1088]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5398lb # [ 83.249855] niks3-server[1088]: 2026/09/20 08:17:24 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5399lb # [ 83.255886] niks3-server[1088]: 2026/09/20 08:17:24 INFO Completed upload id=285400worker1 # [ 83.259749] nix-grpc-daemon[1314]: time=2026-09-20T08:17:25.179Z level=INFO msg="Upload complete. (293ms)"5401lb # [ 83.257349] niks3-server[1088]: 2026/09/20 08:17:24 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5402worker1 # [ 83.264118] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56082 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15403worker1 # [ 83.269619] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:25Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05404worker1 # [ 83.271572] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:25Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15405worker1 # [ 83.276249] nix-daemon[872]: reaped child process 1373, status = succeeded5406worker1 # [ 83.314273] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:560825407worker1 # [ 83.323257] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:560825408worker1 # [ 83.332470] nix-grpc-daemon[1314]: time=2026-09-20T08:17:25.251Z level=INFO msg="All 2 paths already cached"5409client # copying 1 paths to 'lb:50051'...5410worker1 # [ 83.338363] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:560825411client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5412worker1 # [ 83.343644] nix-daemon[872]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)5413worker1 # [ 83.491795] nix-daemon[872]: accepted connection from pid 1399, user nix-grpc-daemon (trusted)5414worker1 # [ 83.505266] nix-daemon[872]: reaped child process 1402, status = succeeded5415worker1 # [ 83.674758] nix-daemon[872]: accepted connection from pid 1404, user nix-grpc-daemon (trusted)5416worker1 # [ 83.688745] nix-daemon[872]: reaped child process 1407, status = succeeded5417lb # [ 83.702122] niks3-server[1088]: 2026/09/20 08:17:25 INFO Received uploads request method=POST path=/api/pending_closures5418worker1 # [ 83.712413] nix-grpc-daemon[1314]: time=2026-09-20T08:17:25.631Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5419worker1 # [ 83.713933] nix-grpc-daemon[1314]: time=2026-09-20T08:17:25.633Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5420lb # [ 83.732901] niks3-server[1088]: 2026/09/20 08:17:25 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5421lb # [ 83.742842] niks3-server[1088]: 2026/09/20 08:17:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5422lb # [ 83.747899] niks3-server[1088]: 2026/09/20 08:17:25 INFO Signed narinfos id=29 count=15423worker1 # [ 83.753259] nix-grpc-daemon[1314]: time=2026-09-20T08:17:25.672Z level=INFO msg="Uploading 1 narinfos"5424lb # [ 83.754223] niks3-server[1088]: 2026/09/20 08:17:25 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5425lb # [ 83.766617] niks3-server[1088]: 2026/09/20 08:17:25 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5426worker1 # [ 83.776402] nix-grpc-daemon[1314]: time=2026-09-20T08:17:25.695Z level=INFO msg="Upload complete. (426ms)"5427lb # [ 83.773788] niks3-server[1088]: 2026/09/20 08:17:25 INFO Completed upload id=295428worker1 # [ 83.778489] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56082 duration_s=0 paths=1 nar_bytes_in=7685429lb # [ 83.777308] niks3-server[1088]: 2026/09/20 08:17:25 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5430worker1 # [ 83.784137] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:560825431worker1 # [ 83.794805] nix-daemon[872]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)5432worker1 # [ 83.799546] nix-daemon[872]: reaped child process 1397, status = succeeded5433worker1 # [ 83.803923] nix-daemon[872]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)5434client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5435client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5436client # farm-top> LOG-farm-top-on-standby5437worker1 # [ 85.019285] nix-daemon[872]: reaped child process 1411, status = succeeded5438worker1 # [ 85.144156] nix-daemon[872]: accepted connection from pid 1426, user nix-grpc-daemon (trusted)5439worker1 # [ 85.157072] nix-daemon[872]: reaped child process 1429, status = succeeded5440lb # [ 85.166861] niks3-server[1088]: 2026/09/20 08:17:26 INFO Received uploads request method=POST path=/api/pending_closures5441worker1 # [ 85.178176] nix-grpc-daemon[1314]: time=2026-09-20T08:17:27.097Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5442worker1 # [ 85.179675] nix-grpc-daemon[1314]: time=2026-09-20T08:17:27.099Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5443lb # [ 85.205490] niks3-server[1088]: 2026/09/20 08:17:26 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5444lb # [ 85.218599] niks3-server[1088]: 2026/09/20 08:17:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5445lb # [ 85.223871] niks3-server[1088]: 2026/09/20 08:17:26 INFO Signed narinfos id=30 count=15446worker1 # [ 85.229668] nix-grpc-daemon[1314]: time=2026-09-20T08:17:27.148Z level=INFO msg="Uploading 1 narinfos"5447lb # [ 85.230130] niks3-server[1088]: 2026/09/20 08:17:26 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5448lb # [ 85.235086] niks3-server[1088]: 2026/09/20 08:17:26 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5449lb # [ 85.244284] niks3-server[1088]: 2026/09/20 08:17:26 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5450lb # [ 85.250949] niks3-server[1088]: 2026/09/20 08:17:26 INFO Completed upload id=305451lb # [ 85.252291] niks3-server[1088]: 2026/09/20 08:17:26 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5452worker1 # [ 85.253769] nix-grpc-daemon[1314]: time=2026-09-20T08:17:27.173Z level=INFO msg="Upload complete. (243ms)"5453worker1 # [ 85.262125] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56082 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15454worker1 # [ 85.274846] nix-daemon[872]: reaped child process 1409, status = succeeded5455client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&2, in 6.43 seconds)5456client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath5457client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath, in 0.19 seconds)5458worker2 # [ 85.535328] systemd[1]: Listening on Nix worker-protocol over gRPC.5459worker2 # [ 85.537222] systemd[1]: Starting Nix worker-protocol over gRPC...5460worker2 # [ 85.700976] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5461worker2 # [ 85.704884] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15462worker2 # [ 85.711140] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5463worker2 # [ 85.716446] systemd[1]: Started Nix worker-protocol over gRPC.5464lb: must succeed: curl -sf localhost:9901/clusters5465worker2 # [ 85.747748] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:27Z level=info event=scheduler_connected addr=lb:500515466worker1 # [ 85.743070] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:27Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05467lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5468worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5469worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5470lb: must succeed: curl -sf localhost:9901/clusters5471lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5472lb: must succeed: curl -sf localhost:9901/clusters5473lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5474worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5475worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5476(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.40 seconds)5477subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5478client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5479client # [ 86.088415] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5480client # Running as unit: rs.service; invocation ID: 9978e1a86b8b49bcb5944ec4642a89bd5481client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.04 seconds)5482worker2 # [ 86.306110] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:500305483worker2 # [ 86.318365] nix-daemon[847]: accepted connection from pid 1132, user nix-grpc-daemon (trusted)5484client # [ 86.326175] nix[1159]: don't know how to build these paths:5485client # [ 86.327217] nix[1159]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5486worker1 # [ 86.333268] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:28Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05487worker1 # [ 86.338763] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:28Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15488worker1 # [ 86.344532] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:560825489worker1 # [ 86.355922] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:560825490client # [ 86.369220] nix[1159]: copying 1 paths to 'lb:50051'...5491client # [ 86.370735] nix[1159]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5492worker1 # [ 86.367103] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:560825493worker1 # [ 86.378974] nix-daemon[872]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)5494worker1 # [ 86.555583] nix-daemon[872]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5495worker1 # [ 86.568398] nix-daemon[872]: reaped child process 1447, status = succeeded5496worker1 # [ 86.740150] nix-daemon[872]: accepted connection from pid 1449, user nix-grpc-daemon (trusted)5497worker1 # [ 86.752899] nix-daemon[872]: reaped child process 1452, status = succeeded5498lb # [ 86.768556] niks3-server[1088]: 2026/09/20 08:17:28 INFO Received uploads request method=POST path=/api/pending_closures5499worker1 # [ 86.777678] nix-grpc-daemon[1314]: time=2026-09-20T08:17:28.696Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5500worker1 # [ 86.779287] nix-grpc-daemon[1314]: time=2026-09-20T08:17:28.698Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5501lb # [ 86.802622] niks3-server[1088]: 2026/09/20 08:17:28 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5502lb # [ 86.813361] niks3-server[1088]: 2026/09/20 08:17:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5503worker1 # [ 86.821830] nix-grpc-daemon[1314]: time=2026-09-20T08:17:28.741Z level=INFO msg="Uploading 1 narinfos"5504lb # [ 86.818992] niks3-server[1088]: 2026/09/20 08:17:28 INFO Signed narinfos id=31 count=15505lb # [ 86.833453] niks3-server[1088]: 2026/09/20 08:17:28 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5506lb # [ 86.903937] niks3-server[1088]: 2026/09/20 08:17:28 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5507lb # [ 86.909312] niks3-server[1088]: 2026/09/20 08:17:28 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5508lb # [ 86.917996] niks3-server[1088]: 2026/09/20 08:17:28 INFO Completed upload id=315509worker1 # [ 86.920755] nix-grpc-daemon[1314]: time=2026-09-20T08:17:28.840Z level=INFO msg="Upload complete. (530ms)"5510worker1 # [ 86.925584] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56082 duration_s=0 paths=1 nar_bytes_in=4165511worker1 # [ 86.931299] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:560825512worker1 # [ 86.944132] nix-daemon[872]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)5513worker1 # [ 86.954593] nix-daemon[872]: reaped child process 1442, status = succeeded5514client # [ 86.965052] nix[1159]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5515worker1 # [ 86.964221] nix-daemon[872]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)5516lb: must succeed: curl -sf localhost:9901/clusters5517lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5518lb: must succeed: curl -sf localhost:9901/clusters5519lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5520lb: must succeed: curl -sf localhost:9901/clusters5521lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5522lb: must succeed: curl -sf localhost:9901/clusters5523lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5524worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5525worker2 # [ 89.010693] systemd-journald[287]: Received client request to rotate journal, rotating.5526lb # [ 89.108604] envoy[988]: conn peer=[2001:db8:1::1]:52142 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9421 tx=3805 ms=61935527worker2 # [ 89.293091] systemd-journald[287]: Vacuuming done, freed 0B of archived journals from /var/log/journal/4557d49f2e0e4407adfcdf0d132aa1cd.5528worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.33 seconds)5529worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5530worker1 # [ 89.204819] systemd[1]: Stopping Nix worker-protocol over gRPC...5531worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5532client: must succeed: sleep 5.05533worker1 # [ 89.498635] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:31Z level=info event=draining5534client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5535worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5536worker1 # [ 94.602580] nix-daemon[872]: reaped child process 1456, status = succeeded5537worker1 # [ 94.771091] nix-daemon[872]: accepted connection from pid 1496, user nix-grpc-daemon (trusted)5538worker1 # [ 94.784080] nix-daemon[872]: reaped child process 1499, status = succeeded5539lb # [ 94.799402] niks3-server[1088]: 2026/09/20 08:17:36 INFO Received uploads request method=POST path=/api/pending_closures5540worker1 # [ 94.810402] nix-grpc-daemon[1314]: time=2026-09-20T08:17:36.729Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5541worker1 # [ 94.811872] nix-grpc-daemon[1314]: time=2026-09-20T08:17:36.731Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5542lb # [ 94.842600] niks3-server[1088]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5543lb # [ 94.852138] niks3-server[1088]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5544lb # [ 94.863474] niks3-server[1088]: 2026/09/20 08:17:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5545lb # [ 94.868852] niks3-server[1088]: 2026/09/20 08:17:36 INFO Signed narinfos id=32 count=15546worker1 # [ 94.871766] nix-grpc-daemon[1314]: time=2026-09-20T08:17:36.790Z level=INFO msg="Uploading 1 narinfos"5547lb # [ 94.874213] niks3-server[1088]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5548lb # [ 94.882825] niks3-server[1088]: 2026/09/20 08:17:36 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5549lb # [ 94.886337] niks3-server[1088]: 2026/09/20 08:17:36 INFO Completed upload id=325550lb # [ 94.888906] niks3-server[1088]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5551worker1 # [ 94.890457] nix-grpc-daemon[1314]: time=2026-09-20T08:17:36.809Z level=INFO msg="Upload complete. (306ms)"5552worker1 # [ 94.899635] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56082 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15553worker1 # [ 94.912259] nix-daemon[872]: reaped child process 1454, status = succeeded5554client # [ 94.936923] systemd[1]: rs.service: Deactivated successfully.5555client # [ 94.940908] systemd[1]: rs.service: Consumed 112ms CPU time over 8.850s wall clock time, 39.3M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic.5556worker1 # [ 95.499797] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:37Z level=info event=signal_exit5557worker1 # [ 95.721394] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:37Z level=info event=scheduler_yield5558lb # [ 95.720167] niks3-server[1088]: 2026/09/20 08:17:37 INFO lead: released remote=192.168.1.3:449325559worker2 # [ 95.735311] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:37Z level=info event=scheduler_restarting addr=lb:500515560worker1 # [ 95.727747] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:37Z level=info event=scheduler_restarting addr=lb:500515561worker1 # [ 95.733597] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:37Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:560725562worker1 # [ 95.736976] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:37Z level=info event=worker_gone addr=192.168.1.4:500515563worker1 # [ 95.740426] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:37Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:560725564worker1 # [ 95.743773] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:37Z level=info event=worker_gone addr=192.168.1.3:500515565worker2 # [ 95.935506] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:37Z level=info event=scheduler_connected addr=lb:500515566worker1 # [ 95.933124] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:37Z level=info event=scheduler_connected addr=lb:500515567worker2 # [ 95.948452] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5568worker1 # [ 95.940183] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5569worker1 # [ 96.140349] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:38Z level=info event=scheduler_connected addr=lb:500515570worker2 # [ 96.149504] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:37Z level=info event=scheduler_connected addr=lb:500515571worker2 # [ 96.155114] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:37Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5572worker1 # [ 96.146482] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5573worker1 # [ 96.346994] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:38Z level=info event=scheduler_connected addr=lb:500515574worker2 # [ 96.355432] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:38Z level=info event=scheduler_connected addr=lb:500515575worker1 # [ 96.350194] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5576worker2 # [ 96.357965] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5577worker1 # [ 96.550988] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:38Z level=info event=scheduler_connected addr=lb:500515578worker2 # [ 96.559435] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:38Z level=info event=scheduler_connected addr=lb:500515579worker1 # [ 96.554136] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5580worker2 # [ 96.564698] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:38Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5581worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.16 seconds)5582client: waiting for success: ! systemctl is-active rs5583client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds)5584client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5585worker1 # [ 96.725148] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:38Z level=info event=scheduler_restarting5586worker1 # [ 96.746901] nix-daemon[872]: reaped child process 1305, status = succeeded5587worker2 # [ 96.766457] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:38Z level=info event=scheduler_connected addr=lb:500515588worker1 # [ 96.759350] nix-grpc-daemon[1240]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5589client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5590client: must fail: journalctl -u rs | grep -q 'reconnecting'5591worker1 # [ 96.766268] nix-grpc-daemon[1240]: E0000 00:00:1789892258.678681 1283 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5592worker1 # [ 96.775661] nix-grpc-daemon[1240]: ts=2026-09-20T08:17:38Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5593client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds)5594lb: must succeed: curl -sf localhost:9901/clusters5595lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5596worker1 # [ 97.635878] nix-grpc-daemon[1240]: E0000 00:00:1789892259.553951 1283 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5597worker1 # [ 97.640951] nix-grpc-daemon[1240]: E0000 00:00:1789892259.554663 1283 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5598lb: must succeed: curl -sf localhost:9901/clusters5599worker2 # [ 97.910190] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:39Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5600lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5601worker1 # [ 97.921686] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5602worker1 # [ 97.924333] systemd[1]: Stopped Nix worker-protocol over gRPC.5603worker1 # [ 97.927425] systemd[1]: nix-grpc-daemon.service: Consumed 1.320s CPU time over 25.604s wall clock time, 35.3M memory peak, 45.7K incoming IP traffic, 91.4K outgoing IP traffic.5604worker1 # [ 97.942709] systemd[1]: Starting Nix worker-protocol over gRPC...5605worker2 # [ 98.110203] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:39Z level=info event=scheduler_connected addr=lb:500515606worker1 # [ 98.108070] nix-grpc-daemon[1506]: ts=2026-09-20T08:17:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5607worker2 # [ 98.115855] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5608worker1 # [ 98.110812] nix-grpc-daemon[1506]: ts=2026-09-20T08:17:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15609worker1 # [ 98.116822] nix-grpc-daemon[1506]: ts=2026-09-20T08:17:40Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5610worker1 # [ 98.119468] systemd[1]: Started Nix worker-protocol over gRPC.5611worker1 # [ 98.127175] nix-grpc-daemon[1506]: ts=2026-09-20T08:17:40Z level=info event=scheduler_take_over5612lb # [ 98.124714] niks3-server[1088]: 2026/09/20 08:17:39 INFO lead: acquired remote=192.168.1.3:402965613worker1 # [ 98.145717] nix-grpc-daemon[1506]: ts=2026-09-20T08:17:40Z level=info event=scheduler_connected addr=lb:500515614worker1 # [ 98.152557] nix-grpc-daemon[1506]: ts=2026-09-20T08:17:40Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05615worker2 # [ 98.317140] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:40Z level=info event=scheduler_connected addr=lb:500515616worker2 # [ 98.322385] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5617worker2 # [ 98.523414] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:40Z level=info event=scheduler_connected addr=lb:500515618worker1 # [ 98.517886] nix-grpc-daemon[1506]: ts=2026-09-20T08:17:40Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05619lb: must succeed: curl -sf localhost:9901/clusters5620lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5621worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5622worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5623(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.00 seconds)5624subtest: scheduler restart mid-build: build finishes, no double build5625client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5626client # [ 99.093221] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5627client # Running as unit: mid.service; invocation ID: 4aa52b1550704b0398ab99cd213565695628client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.04 seconds)5629lb # [ 99.108183] envoy[988]: conn peer=[2001:db8:1::1]:42400 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2934 tx=1349 ms=86135630lb # [ 99.112082] envoy[988]: conn peer=[2001:db8:1::3]:55506 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3578 tx=1049 ms=242405631worker1 # [ 99.307244] nix-grpc-daemon[1506]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:504025632worker1 # [ 99.317506] nix-daemon[872]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)5633client # [ 99.333240] nix[1195]: don't know how to build these paths:5634client # [ 99.334195] nix[1195]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5635worker1 # [ 99.338746] nix-grpc-daemon[1506]: ts=2026-09-20T08:17:41Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05636worker1 # [ 99.343061] nix-grpc-daemon[1506]: ts=2026-09-20T08:17:41Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=15637worker1 # [ 99.386910] nix-grpc-daemon[1506]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504025638worker1 # [ 99.398613] nix-grpc-daemon[1506]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 1/5)5639worker1 # [ 99.476445] nix-grpc-daemon[1506]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 139 ms (attempt 2/5)5640worker1 # [ 99.621328] nix-grpc-daemon[1506]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 161 ms (attempt 3/5)5641worker1 # [ 99.782534] nix-grpc-daemon[1506]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 139 ms (attempt 4/5)5642worker1 # [ 99.922068] nix-grpc-daemon[1506]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5643worker1 # [ 99.934610] nix-grpc-daemon[1506]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504025644client # [ 99.943992] nix[1195]: copying 1 paths to 'lb:50051'...5645worker1 # [ 99.944851] nix-grpc-daemon[1506]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504025646client # [ 99.948174] nix[1195]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5647worker1 # [ 99.948787] nix-daemon[872]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)5648worker1 # [ 99.961165] nix-grpc-daemon[1506]: ts=2026-09-20T08:17:41Z level=info event=niks3_push_started pid=15735649worker1 # [ 100.293087] nix-daemon[872]: accepted connection from pid 1586, user nix-grpc-daemon (trusted)5650worker1 # [ 100.312974] nix-daemon[872]: reaped child process 1593, status = succeeded5651worker1 # [ 100.476687] nix-daemon[872]: accepted connection from pid 1595, user nix-grpc-daemon (trusted)5652worker1 # [ 100.489857] nix-daemon[872]: reaped child process 1598, status = succeeded5653lb # [ 100.503837] niks3-server[1088]: 2026/09/20 08:17:42 INFO Received uploads request method=POST path=/api/pending_closures5654worker1 # [ 100.518128] nix-grpc-daemon[1573]: time=2026-09-20T08:17:42.437Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5655worker1 # [ 100.521351] nix-grpc-daemon[1573]: time=2026-09-20T08:17:42.439Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5656lb # [ 100.547797] niks3-server[1088]: 2026/09/20 08:17:42 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5657lb # [ 100.552578] niks3-server[1088]: 2026/09/20 08:17:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5658lb # [ 100.558652] niks3-server[1088]: 2026/09/20 08:17:42 INFO Signed narinfos id=33 count=15659worker1 # [ 100.564283] nix-grpc-daemon[1573]: time=2026-09-20T08:17:42.483Z level=INFO msg="Uploading 1 narinfos"5660lb # [ 100.567965] niks3-server[1088]: 2026/09/20 08:17:42 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5661lb # [ 100.572314] niks3-server[1088]: 2026/09/20 08:17:42 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5662lb # [ 100.576333] niks3-server[1088]: 2026/09/20 08:17:42 INFO Completed upload id=335663worker1 # [ 100.579219] nix-grpc-daemon[1573]: time=2026-09-20T08:17:42.498Z level=INFO msg="Upload complete. (441ms)"5664lb # [ 100.577943] niks3-server[1088]: 2026/09/20 08:17:42 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5665worker1 # [ 100.583656] nix-grpc-daemon[1506]: ts=2026-09-20T08:17:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50402 duration_s=0 paths=1 nar_bytes_in=4245666worker1 # [ 100.590261] nix-grpc-daemon[1506]: ts=2026-09-20T08:17:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504025667worker1 # [ 100.597066] nix-daemon[872]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)5668worker1 # [ 100.604710] nix-daemon[872]: reaped child process 1571, status = succeeded5669worker1 # [ 100.607869] nix-daemon[872]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)5670client # [ 100.611233] nix[1195]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5671lb: must succeed: curl -sf localhost:9901/clusters5672lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5673lb: must succeed: curl -sf localhost:9901/clusters5674lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5675worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5676worker1 # [ 102.898420] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1506 (nix-grpc-daemon) on client request.5677worker1 # [ 102.901225] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5678lb # [ 102.909952] niks3-server[1088]: 2026/09/20 08:17:44 INFO lead: released remote=192.168.1.3:402965679worker2 # [ 102.918573] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:44Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5680client # [ 102.915691] nix[1195]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5681client # [ 102.920733] nix[1195]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5682worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.07 seconds)5683client: must succeed: sleep 5.05684worker1 # [ 102.939958] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5685worker1 # [ 102.941733] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5686worker1 # [ 102.944261] systemd[1]: nix-grpc-daemon.service: Consumed 363ms CPU time over 4.996s wall clock time, 32.9M memory peak, 11.5K incoming IP traffic, 18K outgoing IP traffic.5687worker1 # [ 102.948389] nix-daemon[872]: reaped child process 1600, status = succeeded5688worker1 # [ 102.949817] nix-daemon[872]: reaped child process 1564, status = succeeded5689worker1 # [ 102.959283] nix-daemon[1602]: unexpected Nix daemon error: error: interrupted by the user5690worker1 # [ 102.963881] nix-daemon[872]: reaped child process 1602, status = failed with exit code 15691worker2 # [ 103.125151] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:44Z level=info event=scheduler_connected addr=lb:500515692worker1 # [ 103.200069] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5693worker1 # [ 103.210372] systemd[1]: Starting Nix worker-protocol over gRPC...5694worker1 # [ 103.381760] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:45Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5695worker1 # [ 103.384074] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:45Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15696worker1 # [ 103.391278] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:45Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5697worker1 # [ 103.394138] systemd[1]: Started Nix worker-protocol over gRPC.5698lb # [ 103.400078] niks3-server[1088]: 2026/09/20 08:17:45 INFO lead: acquired remote=192.168.1.3:457945699worker1 # [ 103.402458] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:45Z level=info event=scheduler_take_over5700worker1 # [ 103.409769] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:45Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05701worker1 # [ 103.425819] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:45Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05702worker1 # [ 103.428995] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:45Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15703worker1 # [ 103.431449] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:45Z level=info event=scheduler_connected addr=lb:500515704worker1 # [ 103.433067] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:45Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05705worker2 # [ 103.443928] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500305706worker2 # [ 103.450657] nix-grpc-daemon[1132]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 24 ms (attempt 1/5)5707worker2 # [ 103.477141] nix-grpc-daemon[1132]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 2/5)5708worker2 # [ 103.501044] nix-grpc-daemon[1132]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 346 ms (attempt 3/5)5709worker2 # [ 103.850387] nix-grpc-daemon[1132]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 4/5)5710worker2 # [ 103.855645] nix-grpc-daemon[1132]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5711worker2 # [ 103.867046] nix-grpc-daemon[1132]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' from 'http://lb:5751'...5712worker2 # [ 103.880818] nix-daemon[847]: accepted connection from pid 1132, user nix-grpc-daemon (trusted)5713worker2 # [ 103.888607] nix-daemon[847]: accepted connection from pid 1132, user nix-grpc-daemon (trusted)5714client # [ 103.884077] nix[1195]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5715client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5716client: waiting for success: ! systemctl is-active mid5717worker2 # [ 108.302989] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:50Z level=info event=niks3_push_started pid=12855718worker2 # [ 108.316243] nix-daemon[847]: reaped child process 1261, status = succeeded5719worker2 # [ 108.642390] nix-daemon[847]: accepted connection from pid 1298, user nix-grpc-daemon (trusted)5720worker2 # [ 108.653849] nix-daemon[847]: reaped child process 1301, status = succeeded5721lb # [ 108.661976] niks3-server[1088]: 2026/09/20 08:17:50 INFO Received uploads request method=POST path=/api/pending_closures5722worker2 # [ 108.685121] nix-grpc-daemon[1285]: time=2026-09-20T08:17:50.455Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5723worker2 # [ 108.687720] nix-grpc-daemon[1285]: time=2026-09-20T08:17:50.457Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5724lb # [ 108.705133] niks3-server[1088]: 2026/09/20 08:17:50 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5725lb # [ 108.715465] niks3-server[1088]: 2026/09/20 08:17:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5726lb # [ 108.719282] niks3-server[1088]: 2026/09/20 08:17:50 INFO Signed narinfos id=34 count=15727worker2 # [ 108.732239] nix-grpc-daemon[1285]: time=2026-09-20T08:17:50.502Z level=INFO msg="Uploading 1 narinfos"5728lb # [ 108.725942] niks3-server[1088]: 2026/09/20 08:17:50 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5729lb # [ 108.734123] niks3-server[1088]: 2026/09/20 08:17:50 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5730lb # [ 108.739750] niks3-server[1088]: 2026/09/20 08:17:50 INFO Completed upload id=345731worker2 # [ 108.749793] nix-grpc-daemon[1285]: time=2026-09-20T08:17:50.520Z level=INFO msg="Upload complete. (268ms)"5732lb # [ 108.741375] niks3-server[1088]: 2026/09/20 08:17:50 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5733worker2 # [ 108.752325] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50030 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15734worker2 # [ 108.756460] nix-grpc-daemon[1285]: time=2026-09-20T08:17:50.527Z level=WARN msg="Failed to register uploaded object" key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo error="server returned 404: object is not pending upload\n"5735worker2 # [ 108.761744] nix-daemon[847]: reaped child process 1259, status = succeeded5736client # [ 108.788453] systemd[1]: mid.service: Deactivated successfully.5737client # [ 108.792190] systemd[1]: mid.service: Consumed 122ms CPU time over 9.697s wall clock time, 39.4M memory peak, 9.7K incoming IP traffic, 10.6K outgoing IP traffic.5738lb # [ 109.109170] envoy[988]: conn peer=[2001:db8:1::3]:49080 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=539 tx=226 ms=47695739lb # [ 109.113291] envoy[988]: conn peer=[2001:db8:1::1]:45758 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3848 tx=1660 ms=94575740client: (finished: waiting for success: ! systemctl is-active mid, in 1.11 seconds)5741client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5742client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)5743(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.31 seconds)5744subtest: interrupting the client stops the build on the worker5745client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5746client # [ 109.392244] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5747client # Running as unit: intr.service; invocation ID: e837b6fe8e0a47dba0f9d4eec44636225748client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)5749worker2 # [ 109.599622] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:500305750client # [ 109.596424] nix[1231]: don't know how to build these paths:5751client # [ 109.597318] nix[1231]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5752worker1 # [ 109.606396] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:51Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05753worker1 # [ 109.610694] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:51Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15754worker1 # [ 109.652090] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432625755worker1 # [ 109.664194] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)5756worker1 # [ 109.680914] nix-grpc-daemon[1638]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5)5757worker1 # [ 109.738936] nix-grpc-daemon[1638]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 2/5)5758worker1 # [ 109.824118] nix-grpc-daemon[1638]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 373 ms (attempt 3/5)5759worker1 # [ 110.203231] nix-grpc-daemon[1638]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 315 ms (attempt 4/5)5760worker1 # [ 110.525346] nix-grpc-daemon[1638]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5761worker1 # [ 110.544900] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:432625762client # [ 110.557357] nix[1231]: copying 1 paths to 'lb:50051'...5763worker1 # [ 110.558132] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:432625764client # [ 110.560940] nix[1231]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5765worker1 # [ 110.564677] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)5766worker1 # [ 110.575698] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:52Z level=info event=niks3_push_started pid=17145767worker1 # [ 110.910841] nix-daemon[872]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5768worker1 # [ 110.926584] nix-daemon[872]: reaped child process 1730, status = succeeded5769worker1 # [ 111.107878] nix-daemon[872]: accepted connection from pid 1732, user nix-grpc-daemon (trusted)5770worker1 # [ 111.123558] nix-daemon[872]: reaped child process 1735, status = succeeded5771lb # [ 111.136813] niks3-server[1088]: 2026/09/20 08:17:52 INFO Received uploads request method=POST path=/api/pending_closures5772worker1 # [ 111.151694] nix-grpc-daemon[1714]: time=2026-09-20T08:17:53.070Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5773worker1 # [ 111.154883] nix-grpc-daemon[1714]: time=2026-09-20T08:17:53.072Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5774lb # [ 111.184739] niks3-server[1088]: 2026/09/20 08:17:52 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5775lb # [ 111.189846] niks3-server[1088]: 2026/09/20 08:17:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5776worker1 # [ 111.197637] nix-grpc-daemon[1714]: time=2026-09-20T08:17:53.116Z level=INFO msg="Uploading 1 narinfos"5777lb # [ 111.195371] niks3-server[1088]: 2026/09/20 08:17:52 INFO Signed narinfos id=35 count=15778lb # [ 111.203770] niks3-server[1088]: 2026/09/20 08:17:52 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5779lb # [ 111.212768] niks3-server[1088]: 2026/09/20 08:17:52 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5780lb # [ 111.217632] niks3-server[1088]: 2026/09/20 08:17:52 INFO Completed upload id=355781lb # [ 111.218960] niks3-server[1088]: 2026/09/20 08:17:52 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5782worker1 # [ 111.220481] nix-grpc-daemon[1714]: time=2026-09-20T08:17:53.139Z level=INFO msg="Upload complete. (468ms)"5783worker1 # [ 111.225469] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=0 paths=1 nar_bytes_in=4245784worker1 # [ 111.231424] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432625785worker1 # [ 111.241483] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)5786worker1 # [ 111.247622] nix-daemon[872]: reaped child process 1712, status = succeeded5787worker1 # [ 111.253401] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)5788client # [ 111.256639] nix[1231]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5789client: must succeed: systemctl kill -s INT intr5790client # [ 112.884387] systemd[1]: intr.service: Sent signal SIGINT to main process 1231 (nix) on client request.5791client # [ 112.888184] nix[1231]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5792client: (finished: must succeed: systemctl kill -s INT intr, in 0.03 seconds)5793worker1 # [ 112.886517] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:54Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5794client # [ 112.891483] nix[1231]: error: interrupted by the user5795client # [ 112.913586] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5796client # [ 112.915109] systemd[1]: intr.service: Failed with result 'exit-code'.5797client # [ 112.917112] systemd[1]: intr.service: Consumed 103ms CPU time over 3.524s wall clock time, 39.1M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5798worker1 # [ 113.076440] nix-daemon[1739]: unexpected Nix daemon error: error: interrupted by the user5799worker1 # [ 113.078319] nix-daemon[872]: reaped child process 1737, status = succeeded5800worker1 # [ 113.081812] nix-daemon[872]: reaped child process 1739, status = failed with exit code 15801(finished: subtest: interrupting the client stops the build on the worker, in 4.73 seconds)5802subtest: a deploy mid-build drains: the build finishes, the new generation takes over5803client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5804client # [ 114.129058] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5805client # Running as unit: sw.service; invocation ID: b88c41f03f714affbecca462aec209d65806client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.04 seconds)5807client # [ 114.306470] nix[1251]: don't know how to build these paths:5808client # [ 114.308026] nix[1251]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5809worker2 # [ 114.310435] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:500305810worker1 # [ 114.314929] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:56Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05811worker1 # [ 114.319606] nix-grpc-daemon[1638]: ts=2026-09-20T08:17:56Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15812worker2 # [ 114.370880] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500305813worker2 # [ 114.384273] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:500305814client # [ 114.390190] nix[1251]: copying 1 paths to 'lb:50051'...5815client # [ 114.391151] nix[1251]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5816worker2 # [ 114.395853] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:500305817worker2 # [ 114.407683] nix-daemon[847]: accepted connection from pid 1132, user nix-grpc-daemon (trusted)5818worker2 # [ 114.569875] nix-daemon[847]: accepted connection from pid 1333, user nix-grpc-daemon (trusted)5819worker2 # [ 114.583711] nix-daemon[847]: reaped child process 1336, status = succeeded5820worker2 # [ 114.740179] nix-daemon[847]: accepted connection from pid 1338, user nix-grpc-daemon (trusted)5821worker2 # [ 114.752599] nix-daemon[847]: reaped child process 1341, status = succeeded5822lb # [ 114.757487] niks3-server[1088]: 2026/09/20 08:17:56 INFO Received uploads request method=POST path=/api/pending_closures5823worker2 # [ 114.777322] nix-grpc-daemon[1285]: time=2026-09-20T08:17:56.547Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5824worker2 # [ 114.778795] nix-grpc-daemon[1285]: time=2026-09-20T08:17:56.549Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5825lb # [ 114.789090] niks3-server[1088]: 2026/09/20 08:17:56 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5826lb # [ 114.800893] niks3-server[1088]: 2026/09/20 08:17:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5827worker2 # [ 114.816884] nix-grpc-daemon[1285]: time=2026-09-20T08:17:56.587Z level=INFO msg="Uploading 1 narinfos"5828lb # [ 114.806643] niks3-server[1088]: 2026/09/20 08:17:56 INFO Signed narinfos id=36 count=15829lb # [ 114.811843] niks3-server[1088]: 2026/09/20 08:17:56 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5830lb # [ 114.823088] niks3-server[1088]: 2026/09/20 08:17:56 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5831lb # [ 114.828620] niks3-server[1088]: 2026/09/20 08:17:56 INFO Completed upload id=365832worker2 # [ 114.839070] nix-grpc-daemon[1285]: time=2026-09-20T08:17:56.609Z level=INFO msg="Upload complete. (419ms)"5833worker2 # [ 114.841382] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50030 duration_s=0 paths=1 nar_bytes_in=4165834lb # [ 114.834107] niks3-server[1088]: 2026/09/20 08:17:56 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5835worker2 # [ 114.846448] nix-grpc-daemon[1132]: ts=2026-09-20T08:17:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:500305836worker2 # [ 114.857767] nix-daemon[847]: accepted connection from pid 1132, user nix-grpc-daemon (trusted)5837worker2 # [ 114.861306] nix-daemon[847]: reaped child process 1331, status = succeeded5838worker2 # [ 114.866274] nix-daemon[847]: accepted connection from pid 1132, user nix-grpc-daemon (trusted)5839client # [ 114.861230] nix[1251]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5840worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25841worker2 # Checking switch inhibitors... done5842worker2 # activating the configuration...5843worker2 # [ 117.309110] nixos[1376]: switching to system configuration /nix/store/3z6bqznjn0dbgp0xqminq5s5cndsg6rm-nixos-system-worker2-test5844worker2 # [ 117.310828] systemd[1]: Stopped target Local File Systems.5845worker2 # [ 117.311970] systemd[1]: Stopped target Remote File Systems.5846worker2 # setting up /etc...5847worker2 # [ 117.961355] systemd[1]: Reload requested from client PID 1376 ('.switch-to-conf') (unit backdoor.service)...5848worker2 # [ 117.962967] systemd[1]: Reloading...5849worker2 # [ 118.654495] systemd[1]: Reloading finished in 688 ms.5850worker2 # restarting sysinit-reactivation.target5851worker2 # [ 118.712443] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5852worker2 # [ 118.848797] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5853worker2 # [ 118.850589] systemd[1]: Reached target Reactivate sysinit units.5854worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5855worker2 # [ 118.856547] systemd[1]: Reloading D-Bus System Message Bus...5856worker2 # [ 118.857747] dbus-broker-launch[534]: Caught SIGHUP, trigger reload.5857worker2 # [ 118.861505] systemd[1]: Reloading Nix worker-protocol over gRPC...5858worker2 # [ 118.885982] dbus-broker-launch[534]: Looking up NSS user entry for 'systemd-timesync'...5859worker2 # [ 118.894282] dbus-broker-launch[534]: NSS returned no entry for 'systemd-timesync'5860worker2 # [ 118.895277] dbus-broker-launch[534]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5861worker2 # [ 118.908083] systemd[1]: Reloaded Nix worker-protocol over gRPC.5862worker2 # [ 118.930721] systemd[1]: Reloaded D-Bus System Message Bus.5863worker2 # [ 118.935356] systemd[1]: Reached target Remote File Systems.5864worker2 # [ 118.937578] systemd[1]: Reached target Local File Systems.5865worker2 # [ 118.944096] systemd[1]: Starting linger-users.service...5866worker2 # [ 118.948130] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5867worker2 # [ 118.955610] systemd[1]: Starting Create SUID/SGID Wrappers...5868worker2 # [ 118.956779] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5869worker2 # [ 118.958308] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675870worker2 # [ 118.963107] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5871worker2 # [ 118.964582] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5872worker2 # [ 118.968204] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5873worker2 # [ 118.973083] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5874worker2 # [ 118.974300] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5875worker2 # [ 119.013975] systemd[1]: linger-users.service: Deactivated successfully.5876worker2 # [ 119.014987] systemd[1]: Finished linger-users.service.5877lb # [ 119.109878] envoy[988]: conn peer=[2001:db8:1::1]:59812 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=755 ms=33075878worker2 # [ 119.387409] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5879worker2 # [ 119.388720] systemd[1]: Finished Create SUID/SGID Wrappers.5880worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5881worker2 # [ 119.644105] nixos[1376]: finished switching to system configuration /nix/store/3z6bqznjn0dbgp0xqminq5s5cndsg6rm-nixos-system-worker2-test5882worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.03 seconds)5883worker2: must succeed: pgrep -f 'read -t [9]0 x'5884worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)5885client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&25886worker2 # [ 119.724302] nix-grpc-daemon[1132]: ts=2026-09-20T08:18:01Z level=info event=draining5887worker1 # [ 119.902607] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:432625888client # don't know how to build these paths:5889client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5890worker1 # [ 119.917730] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:01Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05891worker1 # [ 119.922887] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:01Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=15892worker1 # [ 119.964340] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432625893worker1 # [ 119.976642] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:432625894client # copying 1 paths to 'lb:50051'...5895worker1 # [ 119.988980] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:432625896client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5897worker1 # [ 120.009892] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)5898worker1 # [ 120.184326] nix-daemon[872]: accepted connection from pid 1793, user nix-grpc-daemon (trusted)5899worker1 # [ 120.197574] nix-daemon[872]: reaped child process 1796, status = succeeded5900worker1 # [ 120.356074] nix-daemon[872]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5901worker1 # [ 120.367719] nix-daemon[872]: reaped child process 1801, status = succeeded5902lb # [ 120.381557] niks3-server[1088]: 2026/09/20 08:18:02 INFO Received uploads request method=POST path=/api/pending_closures5903worker1 # [ 120.393562] nix-grpc-daemon[1714]: time=2026-09-20T08:18:02.312Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5904worker1 # [ 120.395163] nix-grpc-daemon[1714]: time=2026-09-20T08:18:02.314Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"5905lb # [ 120.411173] niks3-server[1088]: 2026/09/20 08:18:02 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst5906lb # [ 120.422499] niks3-server[1088]: 2026/09/20 08:18:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5907worker1 # [ 120.430476] nix-grpc-daemon[1714]: time=2026-09-20T08:18:02.349Z level=INFO msg="Uploading 1 narinfos"5908lb # [ 120.428174] niks3-server[1088]: 2026/09/20 08:18:02 INFO Signed narinfos id=37 count=15909lb # [ 120.433835] niks3-server[1088]: 2026/09/20 08:18:02 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls5910lb # [ 120.443374] niks3-server[1088]: 2026/09/20 08:18:02 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5911lb # [ 120.451428] niks3-server[1088]: 2026/09/20 08:18:02 INFO Completed upload id=375912worker1 # [ 120.453939] nix-grpc-daemon[1714]: time=2026-09-20T08:18:02.373Z level=INFO msg="Upload complete. (432ms)"5913lb # [ 120.455521] niks3-server[1088]: 2026/09/20 08:18:02 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo5914worker1 # [ 120.457710] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=0 paths=1 nar_bytes_in=5285915worker1 # [ 120.463300] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432625916worker1 # [ 120.471165] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)5917worker1 # [ 120.476785] nix-daemon[872]: reaped child process 1791, status = succeeded5918client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...5919client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5920worker1 # [ 120.482093] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)5921worker1 # [ 121.496403] nix-daemon[872]: reaped child process 1805, status = succeeded5922client # farm-a> LOG-farm-a-during-drain5923worker1 # [ 121.641162] nix-daemon[872]: accepted connection from pid 1820, user nix-grpc-daemon (trusted)5924worker1 # [ 121.654728] nix-daemon[872]: reaped child process 1823, status = succeeded5925lb # [ 121.669727] niks3-server[1088]: 2026/09/20 08:18:03 INFO Received uploads request method=POST path=/api/pending_closures5926worker1 # [ 121.680570] nix-grpc-daemon[1714]: time=2026-09-20T08:18:03.599Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5927worker1 # [ 121.684692] nix-grpc-daemon[1714]: time=2026-09-20T08:18:03.601Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"5928lb # [ 121.706148] niks3-server[1088]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5929lb # [ 121.713839] niks3-server[1088]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5930lb # [ 121.725365] niks3-server[1088]: 2026/09/20 08:18:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5931worker1 # [ 121.733632] nix-grpc-daemon[1714]: time=2026-09-20T08:18:03.652Z level=INFO msg="Uploading 1 narinfos"5932lb # [ 121.730396] niks3-server[1088]: 2026/09/20 08:18:03 INFO Signed narinfos id=38 count=15933lb # [ 121.737078] niks3-server[1088]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls5934lb # [ 121.748043] niks3-server[1088]: 2026/09/20 08:18:03 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5935lb # [ 121.752432] niks3-server[1088]: 2026/09/20 08:18:03 INFO Completed upload id=385936worker1 # [ 121.757327] nix-grpc-daemon[1714]: time=2026-09-20T08:18:03.676Z level=INFO msg="Upload complete. (268ms)"5937lb # [ 121.755342] niks3-server[1088]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo5938worker1 # [ 121.761890] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=15939worker1 # [ 121.766404] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:03Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=05940worker1 # [ 121.768729] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:03Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=15941worker1 # [ 121.773989] nix-daemon[872]: reaped child process 1803, status = succeeded5942worker1 # [ 121.810989] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432625943worker1 # [ 121.823255] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:432625944worker1 # [ 121.835878] nix-grpc-daemon[1714]: time=2026-09-20T08:18:03.755Z level=INFO msg="All 1 paths already cached"5945client # copying 1 paths to 'lb:50051'...5946client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...5947worker1 # [ 121.842748] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:432625948worker1 # [ 121.852389] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)5949worker1 # [ 122.033191] nix-daemon[872]: accepted connection from pid 1829, user nix-grpc-daemon (trusted)5950worker1 # [ 122.046813] nix-daemon[872]: reaped child process 1832, status = succeeded5951worker1 # [ 122.212683] nix-daemon[872]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)5952worker1 # [ 122.226083] nix-daemon[872]: reaped child process 1837, status = succeeded5953lb # [ 122.239147] niks3-server[1088]: 2026/09/20 08:18:03 INFO Received uploads request method=POST path=/api/pending_closures5954worker1 # [ 122.249461] nix-grpc-daemon[1714]: time=2026-09-20T08:18:04.168Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5955worker1 # [ 122.251019] nix-grpc-daemon[1714]: time=2026-09-20T08:18:04.170Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"5956lb # [ 122.266285] niks3-server[1088]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst5957lb # [ 122.277882] niks3-server[1088]: 2026/09/20 08:18:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5958lb # [ 122.282387] niks3-server[1088]: 2026/09/20 08:18:03 INFO Signed narinfos id=39 count=15959worker1 # [ 122.287884] nix-grpc-daemon[1714]: time=2026-09-20T08:18:04.207Z level=INFO msg="Uploading 1 narinfos"5960lb # [ 122.288670] niks3-server[1088]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls5961lb # [ 122.300222] niks3-server[1088]: 2026/09/20 08:18:03 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5962worker1 # [ 122.309389] nix-grpc-daemon[1714]: time=2026-09-20T08:18:04.228Z level=INFO msg="Upload complete. (444ms)"5963lb # [ 122.306972] niks3-server[1088]: 2026/09/20 08:18:03 INFO Completed upload id=395964worker1 # [ 122.311542] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=0 paths=1 nar_bytes_in=6405965lb # [ 122.310054] niks3-server[1088]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo5966worker1 # [ 122.317063] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432625967worker1 # [ 122.322756] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)5968worker1 # [ 122.325239] nix-daemon[872]: reaped child process 1827, status = succeeded5969worker1 # [ 122.330861] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)5970client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...5971client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5972client # farm-b> LOG-farm-b-during-drain5973worker1 # [ 122.945868] nix-daemon[872]: reaped child process 1841, status = succeeded5974worker1 # [ 123.094810] nix-daemon[872]: accepted connection from pid 1856, user nix-grpc-daemon (trusted)5975worker1 # [ 123.108282] nix-daemon[872]: reaped child process 1859, status = succeeded5976lb # [ 123.118690] niks3-server[1088]: 2026/09/20 08:18:04 INFO Received uploads request method=POST path=/api/pending_closures5977worker1 # [ 123.129516] nix-grpc-daemon[1714]: time=2026-09-20T08:18:05.048Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5978worker1 # [ 123.131789] nix-grpc-daemon[1714]: time=2026-09-20T08:18:05.050Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"5979lb # [ 123.155432] niks3-server[1088]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5980lb # [ 123.160708] niks3-server[1088]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst5981lb # [ 123.172254] niks3-server[1088]: 2026/09/20 08:18:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5982lb # [ 123.178959] niks3-server[1088]: 2026/09/20 08:18:04 INFO Signed narinfos id=40 count=15983worker1 # [ 123.184461] nix-grpc-daemon[1714]: time=2026-09-20T08:18:05.103Z level=INFO msg="Uploading 1 narinfos"5984lb # [ 123.181845] niks3-server[1088]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls5985lb # [ 123.192403] niks3-server[1088]: 2026/09/20 08:18:04 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5986lb # [ 123.197451] niks3-server[1088]: 2026/09/20 08:18:04 INFO Completed upload id=405987lb # [ 123.200149] niks3-server[1088]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo5988worker1 # [ 123.201679] nix-grpc-daemon[1714]: time=2026-09-20T08:18:05.121Z level=INFO msg="Upload complete. (264ms)"5989worker1 # [ 123.211472] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=0 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=15990worker1 # [ 123.219805] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:05Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=05991worker1 # [ 123.223280] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:05Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=15992worker1 # [ 123.232794] nix-daemon[872]: reaped child process 1839, status = succeeded5993worker1 # [ 123.262983] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432625994worker1 # [ 123.275650] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:432625995worker1 # [ 123.288287] nix-grpc-daemon[1714]: time=2026-09-20T08:18:05.207Z level=INFO msg="All 2 paths already cached"5996client # copying 1 paths to 'lb:50051'...5997client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...5998worker1 # [ 123.296143] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:432625999worker1 # [ 123.311270] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6000worker1 # [ 123.481243] nix-daemon[872]: accepted connection from pid 1865, user nix-grpc-daemon (trusted)6001worker1 # [ 123.494931] nix-daemon[872]: reaped child process 1868, status = succeeded6002worker1 # [ 123.655941] nix-daemon[872]: accepted connection from pid 1870, user nix-grpc-daemon (trusted)6003worker1 # [ 123.669036] nix-daemon[872]: reaped child process 1873, status = succeeded6004lb # [ 123.682150] niks3-server[1088]: 2026/09/20 08:18:05 INFO Received uploads request method=POST path=/api/pending_closures6005worker1 # [ 123.693247] nix-grpc-daemon[1714]: time=2026-09-20T08:18:05.612Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6006worker1 # [ 123.695101] nix-grpc-daemon[1714]: time=2026-09-20T08:18:05.614Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6007lb # [ 123.723152] niks3-server[1088]: 2026/09/20 08:18:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6008lb # [ 123.728146] niks3-server[1088]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6009lb # [ 123.734593] niks3-server[1088]: 2026/09/20 08:18:05 INFO Signed narinfos id=41 count=16010worker1 # [ 123.740324] nix-grpc-daemon[1714]: time=2026-09-20T08:18:05.659Z level=INFO msg="Uploading 1 narinfos"6011lb # [ 123.741413] niks3-server[1088]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6012lb # [ 123.749473] niks3-server[1088]: 2026/09/20 08:18:05 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6013lb # [ 123.756094] niks3-server[1088]: 2026/09/20 08:18:05 INFO Completed upload id=416014worker1 # [ 123.758715] nix-grpc-daemon[1714]: time=2026-09-20T08:18:05.678Z level=INFO msg="Upload complete. (435ms)"6015lb # [ 123.760484] niks3-server[1088]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6016worker1 # [ 123.762224] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=0 paths=1 nar_bytes_in=7686017worker1 # [ 123.767240] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626018worker1 # [ 123.777985] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6019worker1 # [ 123.783896] nix-daemon[872]: reaped child process 1863, status = succeeded6020worker1 # [ 123.786981] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6021client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6022client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6023worker1 # [ 124.599970] nix-daemon[872]: reaped child process 1877, status = succeeded6024client # farm-top> LOG-farm-top-during-drain6025worker1 # [ 124.738224] nix-daemon[872]: accepted connection from pid 1892, user nix-grpc-daemon (trusted)6026worker1 # [ 124.751946] nix-daemon[872]: reaped child process 1895, status = succeeded6027lb # [ 124.766771] niks3-server[1088]: 2026/09/20 08:18:06 INFO Received uploads request method=POST path=/api/pending_closures6028worker1 # [ 124.778361] nix-grpc-daemon[1714]: time=2026-09-20T08:18:06.696Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6029worker1 # [ 124.781042] nix-grpc-daemon[1714]: time=2026-09-20T08:18:06.696Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6030lb # [ 124.803814] niks3-server[1088]: 2026/09/20 08:18:06 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6031lb # [ 124.814327] niks3-server[1088]: 2026/09/20 08:18:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6032worker1 # [ 124.826408] nix-grpc-daemon[1714]: time=2026-09-20T08:18:06.745Z level=INFO msg="Uploading 1 narinfos"6033lb # [ 124.823565] niks3-server[1088]: 2026/09/20 08:18:06 INFO Signed narinfos id=42 count=16034lb # [ 124.827362] niks3-server[1088]: 2026/09/20 08:18:06 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6035lb # [ 124.839678] niks3-server[1088]: 2026/09/20 08:18:06 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6036lb # [ 124.842922] niks3-server[1088]: 2026/09/20 08:18:06 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6037lb # [ 124.848601] niks3-server[1088]: 2026/09/20 08:18:06 INFO Completed upload id=426038lb # [ 124.850223] niks3-server[1088]: 2026/09/20 08:18:06 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6039worker1 # [ 124.851532] nix-grpc-daemon[1714]: time=2026-09-20T08:18:06.770Z level=INFO msg="Upload complete. (257ms)"6040worker1 # [ 124.858959] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16041worker1 # [ 124.872764] nix-daemon[872]: reaped child process 1875, status = succeeded6042client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&2, in 5.20 seconds)6043client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath6044client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath, in 0.19 seconds)6045worker2: must succeed: pkill -f 'read -t [9]0 x'6046worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6047client: waiting for success: ! systemctl is-active sw6048worker2 # [ 125.290795] nix-daemon[847]: reaped child process 1345, status = succeeded6049worker2 # [ 125.437397] nix-daemon[847]: accepted connection from pid 1516, user nix-grpc-daemon (trusted)6050worker2 # [ 125.448070] nix-daemon[847]: reaped child process 1519, status = succeeded6051lb # [ 125.454557] niks3-server[1088]: 2026/09/20 08:18:07 INFO Received uploads request method=POST path=/api/pending_closures6052worker2 # [ 125.474294] nix-grpc-daemon[1285]: time=2026-09-20T08:18:07.244Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6053worker2 # [ 125.475870] nix-grpc-daemon[1285]: time=2026-09-20T08:18:07.246Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6054lb # [ 125.493371] niks3-server[1088]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6055lb # [ 125.500572] niks3-server[1088]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6056lb # [ 125.512236] niks3-server[1088]: 2026/09/20 08:18:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6057lb # [ 125.517606] niks3-server[1088]: 2026/09/20 08:18:07 INFO Signed narinfos id=43 count=16058worker2 # [ 125.530844] nix-grpc-daemon[1285]: time=2026-09-20T08:18:07.301Z level=INFO msg="Uploading 1 narinfos"6059lb # [ 125.522474] niks3-server[1088]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6060lb # [ 125.533269] niks3-server[1088]: 2026/09/20 08:18:07 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6061lb # [ 125.539171] niks3-server[1088]: 2026/09/20 08:18:07 INFO Completed upload id=436062worker2 # [ 125.549723] nix-grpc-daemon[1285]: time=2026-09-20T08:18:07.320Z level=INFO msg="Upload complete. (266ms)"6063lb # [ 125.541253] niks3-server[1088]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6064worker2 # [ 125.556640] nix-grpc-daemon[1132]: ts=2026-09-20T08:18:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50030 duration_s=10 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16065worker2 # [ 125.569422] nix-daemon[847]: reaped child process 1343, status = succeeded6066client # [ 125.591378] systemd[1]: sw.service: Deactivated successfully.6067client # [ 125.596987] systemd[1]: sw.service: Consumed 111ms CPU time over 11.464s wall clock time, 39.2M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.6068worker2 # [ 125.727347] nix-grpc-daemon[1132]: ts=2026-09-20T08:18:07Z level=info event=signal_exit6069client: (finished: waiting for success: ! systemctl is-active sw, in 1.08 seconds)6070client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6071client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)6072worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6073worker1 # [ 126.961807] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:432546074worker1 # [ 126.965454] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:08Z level=info event=worker_gone addr=192.168.1.4:500516075worker2 # [ 126.969595] nix-grpc-daemon[1132]: ts=2026-09-20T08:18:08Z level=info event=scheduler_restarting6076worker2 # [ 126.983517] nix-grpc-daemon[1132]: ts=2026-09-20T08:18:08Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6077worker2 # [ 127.001571] nix-daemon[847]: reaped child process 1190, status = succeeded6078worker2 # [ 127.801119] nix-grpc-daemon[1132]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6079worker2 # [ 127.804525] nix-grpc-daemon[1132]: E0000 00:00:1789892289.571369 1175 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true6080worker2 # [ 127.809248] nix-grpc-daemon[1132]: E0000 00:00:1789892289.571653 1175 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6081worker2 # [ 128.135477] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6082worker2 # [ 128.137963] systemd[1]: nix-grpc-daemon.service: Consumed 691ms CPU time over 42.595s wall clock time, 32.8M memory peak, 23.1K incoming IP traffic, 33K outgoing IP traffic.6083worker2 # [ 128.153599] systemd[1]: Starting Nix worker-protocol over gRPC...6084worker2 # [ 128.315136] nix-grpc-daemon[1533]: ts=2026-09-20T08:18:10Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6085worker2 # [ 128.318991] nix-grpc-daemon[1533]: ts=2026-09-20T08:18:10Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16086worker2 # [ 128.325435] nix-grpc-daemon[1533]: ts=2026-09-20T08:18:10Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6087worker2 # [ 128.328090] systemd[1]: Started Nix worker-protocol over gRPC.6088worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.08 seconds)6089lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6090lb: must succeed: curl -sf localhost:9901/clusters6091worker2 # [ 128.358337] nix-grpc-daemon[1533]: ts=2026-09-20T08:18:10Z level=info event=scheduler_connected addr=lb:500516092worker1 # [ 128.352922] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:10Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06093lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6094lb # [ 129.113970] envoy[988]: conn peer=[2001:db8:1::1]:44204 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9386 tx=3746 ms=49716095lb # [ 129.119556] envoy[988]: conn peer=[2001:db8:1::1]:44200 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2932 tx=1334 ms=112576096lb # [ 129.123296] envoy[988]: conn peer=[2001:db8:1::4]:41092 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2712 tx=814 ms=412286097lb: must succeed: curl -sf localhost:9901/clusters6098lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6099lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.15 seconds)6100lb: must succeed: curl -sf localhost:9901/clusters6101lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6102worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6103worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)6104(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.51 seconds)6105subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6106client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16107worker2 # [ 129.797702] nix-grpc-daemon[1533]: ts=2026-09-20T08:18:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:343746108worker2 # [ 129.809125] nix-daemon[847]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)6109worker1 # [ 129.827114] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:11Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06110worker1 # [ 129.831218] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:11Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16111worker1 # [ 129.835497] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:11Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06112worker1 # [ 129.839551] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:11Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06113worker1 # [ 129.869081] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626114worker1 # [ 129.880518] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:432626115worker1 # [ 129.890419] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:432626116worker1 # [ 129.902305] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6117worker1 # [ 130.070721] nix-daemon[872]: accepted connection from pid 1906, user nix-grpc-daemon (trusted)6118worker1 # [ 130.084390] nix-daemon[872]: reaped child process 1909, status = succeeded6119worker1 # [ 130.239280] nix-daemon[872]: accepted connection from pid 1911, user nix-grpc-daemon (trusted)6120worker1 # [ 130.252519] nix-daemon[872]: reaped child process 1914, status = succeeded6121lb # [ 130.261890] niks3-server[1088]: 2026/09/20 08:18:11 INFO Received uploads request method=POST path=/api/pending_closures6122worker1 # [ 130.270472] nix-grpc-daemon[1714]: time=2026-09-20T08:18:12.189Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6123worker1 # [ 130.271888] nix-grpc-daemon[1714]: time=2026-09-20T08:18:12.189Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6124lb # [ 130.276746] niks3-server[1088]: 2026/09/20 08:18:11 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6125lb # [ 130.278591] niks3-server[1088]: 2026/09/20 08:18:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6126lb # [ 130.280798] niks3-server[1088]: 2026/09/20 08:18:11 INFO Signed narinfos id=44 count=16127worker1 # [ 130.283635] nix-grpc-daemon[1714]: time=2026-09-20T08:18:12.202Z level=INFO msg="Uploading 1 narinfos"6128lb # [ 130.286425] niks3-server[1088]: 2026/09/20 08:18:11 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6129lb # [ 130.289026] niks3-server[1088]: 2026/09/20 08:18:11 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6130lb # [ 130.292478] niks3-server[1088]: 2026/09/20 08:18:11 INFO Completed upload id=446131worker1 # [ 130.295065] nix-grpc-daemon[1714]: time=2026-09-20T08:18:12.214Z level=INFO msg="Upload complete. (381ms)"6132worker1 # [ 130.297028] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=0 paths=1 nar_bytes_in=5046133lb # [ 130.295124] niks3-server[1088]: 2026/09/20 08:18:11 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6134worker1 # [ 130.300054] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626135worker1 # [ 130.306062] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6136worker1 # [ 130.310898] nix-daemon[872]: reaped child process 1904, status = succeeded6137worker1 # [ 130.314928] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6138worker1 # [ 131.340380] nix-daemon[872]: reaped child process 1918, status = succeeded6139worker1 # [ 131.501411] nix-daemon[872]: accepted connection from pid 1933, user nix-grpc-daemon (trusted)6140worker1 # [ 131.514883] nix-daemon[872]: reaped child process 1936, status = succeeded6141lb # [ 131.530216] niks3-server[1088]: 2026/09/20 08:18:13 INFO Received uploads request method=POST path=/api/pending_closures6142worker1 # [ 131.540689] nix-grpc-daemon[1714]: time=2026-09-20T08:18:13.459Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6143worker1 # [ 131.542241] nix-grpc-daemon[1714]: time=2026-09-20T08:18:13.461Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6144lb # [ 131.567661] niks3-server[1088]: 2026/09/20 08:18:13 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6145lb # [ 131.572948] niks3-server[1088]: 2026/09/20 08:18:13 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6146lb # [ 131.585999] niks3-server[1088]: 2026/09/20 08:18:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6147worker1 # [ 131.594215] nix-grpc-daemon[1714]: time=2026-09-20T08:18:13.513Z level=INFO msg="Uploading 1 narinfos"6148lb # [ 131.591534] niks3-server[1088]: 2026/09/20 08:18:13 INFO Signed narinfos id=45 count=16149lb # [ 131.597079] niks3-server[1088]: 2026/09/20 08:18:13 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6150lb # [ 131.606707] niks3-server[1088]: 2026/09/20 08:18:13 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6151lb # [ 131.612623] niks3-server[1088]: 2026/09/20 08:18:13 INFO Completed upload id=456152lb # [ 131.614134] niks3-server[1088]: 2026/09/20 08:18:13 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6153worker1 # [ 131.615475] nix-grpc-daemon[1714]: time=2026-09-20T08:18:13.534Z level=INFO msg="Upload complete. (291ms)"6154worker1 # [ 131.625926] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=7 outputs=16155worker1 # [ 131.632824] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:13Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16156worker1 # [ 131.638393] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626157worker1 # [ 131.641442] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:13Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06158worker1 # [ 131.651040] nix-daemon[872]: reaped child process 1916, status = succeeded6159worker1 # [ 131.652793] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:432626160worker1 # [ 131.659798] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:432626161worker1 # [ 131.665074] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6162worker1 # [ 131.820860] nix-daemon[872]: accepted connection from pid 1942, user nix-grpc-daemon (trusted)6163worker1 # [ 131.834619] nix-daemon[872]: reaped child process 1945, status = succeeded6164worker1 # [ 132.003094] nix-daemon[872]: accepted connection from pid 1947, user nix-grpc-daemon (trusted)6165worker1 # [ 132.015373] nix-daemon[872]: reaped child process 1950, status = succeeded6166lb # [ 132.027757] niks3-server[1088]: 2026/09/20 08:18:13 INFO Received uploads request method=POST path=/api/pending_closures6167worker1 # [ 132.038255] nix-grpc-daemon[1714]: time=2026-09-20T08:18:13.957Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6168worker1 # [ 132.039837] nix-grpc-daemon[1714]: time=2026-09-20T08:18:13.959Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6169lb # [ 132.058698] niks3-server[1088]: 2026/09/20 08:18:13 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6170lb # [ 132.068809] niks3-server[1088]: 2026/09/20 08:18:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6171worker1 # [ 132.076088] nix-grpc-daemon[1714]: time=2026-09-20T08:18:13.995Z level=INFO msg="Uploading 1 narinfos"6172lb # [ 132.073967] niks3-server[1088]: 2026/09/20 08:18:13 INFO Signed narinfos id=46 count=16173lb # [ 132.080473] niks3-server[1088]: 2026/09/20 08:18:13 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6174lb # [ 132.090285] niks3-server[1088]: 2026/09/20 08:18:13 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6175lb # [ 132.096884] niks3-server[1088]: 2026/09/20 08:18:13 INFO Completed upload id=466176worker1 # [ 132.099625] nix-grpc-daemon[1714]: time=2026-09-20T08:18:14.019Z level=INFO msg="Upload complete. (429ms)"6177lb # [ 132.100239] niks3-server[1088]: 2026/09/20 08:18:13 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6178worker1 # [ 132.103492] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=0 paths=1 nar_bytes_in=5046179worker1 # [ 132.108454] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626180worker1 # [ 132.119067] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6181worker1 # [ 132.123274] nix-daemon[872]: reaped child process 1940, status = succeeded6182worker1 # [ 132.128365] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6183worker1 # [ 133.344607] nix-daemon[872]: reaped child process 1954, status = succeeded6184worker1 # [ 133.463664] nix-daemon[872]: accepted connection from pid 1969, user nix-grpc-daemon (trusted)6185worker1 # [ 133.476981] nix-daemon[872]: reaped child process 1972, status = succeeded6186lb # [ 133.486938] niks3-server[1088]: 2026/09/20 08:18:15 INFO Received uploads request method=POST path=/api/pending_closures6187worker1 # [ 133.498330] nix-grpc-daemon[1714]: time=2026-09-20T08:18:15.416Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6188worker1 # [ 133.503196] nix-grpc-daemon[1714]: time=2026-09-20T08:18:15.416Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6189lb # [ 133.524269] niks3-server[1088]: 2026/09/20 08:18:15 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6190lb # [ 133.536148] niks3-server[1088]: 2026/09/20 08:18:15 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6191lb # [ 133.543714] niks3-server[1088]: 2026/09/20 08:18:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6192lb # [ 133.549124] niks3-server[1088]: 2026/09/20 08:18:15 INFO Signed narinfos id=47 count=16193worker1 # [ 133.554346] nix-grpc-daemon[1714]: time=2026-09-20T08:18:15.473Z level=INFO msg="Uploading 1 narinfos"6194lb # [ 133.554284] niks3-server[1088]: 2026/09/20 08:18:15 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6195lb # [ 133.564522] niks3-server[1088]: 2026/09/20 08:18:15 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6196lb # [ 133.570312] niks3-server[1088]: 2026/09/20 08:18:15 INFO Completed upload id=476197worker1 # [ 133.572832] nix-grpc-daemon[1714]: time=2026-09-20T08:18:15.492Z level=INFO msg="Upload complete. (236ms)"6198lb # [ 133.571879] niks3-server[1088]: 2026/09/20 08:18:15 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6199worker1 # [ 133.575399] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=8 outputs=16200worker1 # [ 133.581519] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:15Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16201worker1 # [ 133.583429] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626202worker1 # [ 133.586181] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:15Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06203worker1 # [ 133.592292] nix-daemon[872]: reaped child process 1952, status = succeeded6204worker1 # [ 133.593565] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:432626205worker1 # [ 133.598386] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:432626206worker1 # [ 133.602289] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6207worker1 # [ 133.750609] nix-daemon[872]: accepted connection from pid 1978, user nix-grpc-daemon (trusted)6208worker1 # [ 133.763798] nix-daemon[872]: reaped child process 1981, status = succeeded6209worker1 # [ 133.927174] nix-daemon[872]: accepted connection from pid 1983, user nix-grpc-daemon (trusted)6210worker1 # [ 133.940282] nix-daemon[872]: reaped child process 1986, status = succeeded6211lb # [ 133.953699] niks3-server[1088]: 2026/09/20 08:18:15 INFO Received uploads request method=POST path=/api/pending_closures6212worker1 # [ 133.964059] nix-grpc-daemon[1714]: time=2026-09-20T08:18:15.883Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6213worker1 # [ 133.965435] nix-grpc-daemon[1714]: time=2026-09-20T08:18:15.883Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6214lb # [ 133.979732] niks3-server[1088]: 2026/09/20 08:18:15 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6215lb # [ 133.989074] niks3-server[1088]: 2026/09/20 08:18:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6216worker1 # [ 133.996244] nix-grpc-daemon[1714]: time=2026-09-20T08:18:15.915Z level=INFO msg="Uploading 1 narinfos"6217lb # [ 133.993877] niks3-server[1088]: 2026/09/20 08:18:15 INFO Signed narinfos id=48 count=16218lb # [ 134.000500] niks3-server[1088]: 2026/09/20 08:18:15 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6219lb # [ 134.012223] niks3-server[1088]: 2026/09/20 08:18:15 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6220lb # [ 134.017125] niks3-server[1088]: 2026/09/20 08:18:15 INFO Completed upload id=486221worker1 # [ 134.022125] nix-grpc-daemon[1714]: time=2026-09-20T08:18:15.941Z level=INFO msg="Upload complete. (414ms)"6222lb # [ 134.019885] niks3-server[1088]: 2026/09/20 08:18:15 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6223worker1 # [ 134.024359] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=0 paths=1 nar_bytes_in=5046224worker1 # [ 134.028723] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626225worker1 # [ 134.038376] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6226worker1 # [ 134.040709] nix-daemon[872]: reaped child process 1976, status = succeeded6227worker1 # [ 134.046056] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6228worker1 # [ 135.274238] nix-daemon[872]: reaped child process 1990, status = succeeded6229worker1 # [ 135.431384] nix-daemon[872]: accepted connection from pid 2005, user nix-grpc-daemon (trusted)6230worker1 # [ 135.444624] nix-daemon[872]: reaped child process 2008, status = succeeded6231lb # [ 135.459976] niks3-server[1088]: 2026/09/20 08:18:17 INFO Received uploads request method=POST path=/api/pending_closures6232worker1 # [ 135.467390] nix-grpc-daemon[1714]: time=2026-09-20T08:18:17.386Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6233worker1 # [ 135.468904] nix-grpc-daemon[1714]: time=2026-09-20T08:18:17.388Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6234lb # [ 135.478374] niks3-server[1088]: 2026/09/20 08:18:17 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6235lb # [ 135.485889] niks3-server[1088]: 2026/09/20 08:18:17 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6236lb # [ 135.489243] niks3-server[1088]: 2026/09/20 08:18:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6237lb # [ 135.491826] niks3-server[1088]: 2026/09/20 08:18:17 INFO Signed narinfos id=49 count=16238worker1 # [ 135.494437] nix-grpc-daemon[1714]: time=2026-09-20T08:18:17.413Z level=INFO msg="Uploading 1 narinfos"6239lb # [ 135.495086] niks3-server[1088]: 2026/09/20 08:18:17 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6240lb # [ 135.499609] niks3-server[1088]: 2026/09/20 08:18:17 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6241lb # [ 135.503618] niks3-server[1088]: 2026/09/20 08:18:17 INFO Completed upload id=496242worker1 # [ 135.507509] nix-grpc-daemon[1714]: time=2026-09-20T08:18:17.426Z level=INFO msg="Upload complete. (253ms)"6243lb # [ 135.505136] niks3-server[1088]: 2026/09/20 08:18:17 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6244worker1 # [ 135.511086] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=9 outputs=16245worker1 # [ 135.514713] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:17Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16246worker1 # [ 135.516573] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626247worker1 # [ 135.520380] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:17Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06248worker1 # [ 135.526363] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:432626249worker1 # [ 135.530304] nix-daemon[872]: reaped child process 1988, status = succeeded6250worker1 # [ 135.532216] nix-grpc-daemon[1714]: time=2026-09-20T08:18:17.451Z level=INFO msg="All 1 paths already cached"6251worker1 # [ 135.535885] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:432626252worker1 # [ 135.539663] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6253worker1 # [ 135.696123] nix-daemon[872]: accepted connection from pid 2014, user nix-grpc-daemon (trusted)6254worker1 # [ 135.709732] nix-daemon[872]: reaped child process 2017, status = succeeded6255worker1 # [ 135.876168] nix-daemon[872]: accepted connection from pid 2019, user nix-grpc-daemon (trusted)6256worker1 # [ 135.890095] nix-daemon[872]: reaped child process 2022, status = succeeded6257lb # [ 135.903537] niks3-server[1088]: 2026/09/20 08:18:17 INFO Received uploads request method=POST path=/api/pending_closures6258worker1 # [ 135.914280] nix-grpc-daemon[1714]: time=2026-09-20T08:18:17.833Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6259worker1 # [ 135.915712] nix-grpc-daemon[1714]: time=2026-09-20T08:18:17.833Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6260lb # [ 135.928938] niks3-server[1088]: 2026/09/20 08:18:17 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6261lb # [ 135.940245] niks3-server[1088]: 2026/09/20 08:18:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6262worker1 # [ 135.948357] nix-grpc-daemon[1714]: time=2026-09-20T08:18:17.867Z level=INFO msg="Uploading 1 narinfos"6263lb # [ 135.945546] niks3-server[1088]: 2026/09/20 08:18:17 INFO Signed narinfos id=50 count=16264lb # [ 135.952056] niks3-server[1088]: 2026/09/20 08:18:17 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6265lb # [ 135.964351] niks3-server[1088]: 2026/09/20 08:18:17 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6266worker1 # [ 135.972687] nix-grpc-daemon[1714]: time=2026-09-20T08:18:17.892Z level=INFO msg="Upload complete. (426ms)"6267lb # [ 135.970415] niks3-server[1088]: 2026/09/20 08:18:17 INFO Completed upload id=506268worker1 # [ 135.974832] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=0 paths=1 nar_bytes_in=6246269lb # [ 135.974204] niks3-server[1088]: 2026/09/20 08:18:17 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6270worker1 # [ 135.980862] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626271worker1 # [ 135.989889] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6272worker1 # [ 135.996190] nix-daemon[872]: reaped child process 2012, status = succeeded6273worker1 # [ 135.999300] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6274worker1 # [ 137.217411] nix-daemon[872]: reaped child process 2026, status = succeeded6275worker1 # [ 137.365118] nix-daemon[872]: accepted connection from pid 2041, user nix-grpc-daemon (trusted)6276worker1 # [ 137.377957] nix-daemon[872]: reaped child process 2044, status = succeeded6277lb # [ 137.394558] niks3-server[1088]: 2026/09/20 08:18:19 INFO Received uploads request method=POST path=/api/pending_closures6278worker1 # [ 137.405695] nix-grpc-daemon[1714]: time=2026-09-20T08:18:19.324Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6279worker1 # [ 137.407285] nix-grpc-daemon[1714]: time=2026-09-20T08:18:19.326Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6280lb # [ 137.437214] niks3-server[1088]: 2026/09/20 08:18:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6281lb # [ 137.445273] niks3-server[1088]: 2026/09/20 08:18:19 INFO Signed narinfos id=51 count=16282worker1 # [ 137.450632] nix-grpc-daemon[1714]: time=2026-09-20T08:18:19.370Z level=INFO msg="Uploading 1 narinfos"6283lb # [ 137.455337] niks3-server[1088]: 2026/09/20 08:18:19 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6284lb # [ 137.461940] niks3-server[1088]: 2026/09/20 08:18:19 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6285lb # [ 137.466499] niks3-server[1088]: 2026/09/20 08:18:19 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6286lb # [ 137.475353] niks3-server[1088]: 2026/09/20 08:18:19 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6287lb # [ 137.480959] niks3-server[1088]: 2026/09/20 08:18:19 INFO Completed upload id=516288lb # [ 137.482835] niks3-server[1088]: 2026/09/20 08:18:19 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6289worker1 # [ 137.483924] nix-grpc-daemon[1714]: time=2026-09-20T08:18:19.403Z level=INFO msg="Upload complete. (276ms)"6290worker1 # [ 137.493873] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=10 outputs=16291worker1 # [ 137.504455] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:19Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16292worker1 # [ 137.508256] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:19Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06293worker1 # [ 137.518235] nix-daemon[872]: reaped child process 2024, status = succeeded6294worker1 # [ 137.535937] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626295worker1 # [ 137.545521] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:432626296worker1 # [ 137.554686] nix-grpc-daemon[1714]: time=2026-09-20T08:18:19.474Z level=INFO msg="All 1 paths already cached"6297worker1 # [ 137.559353] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:432626298worker1 # [ 137.565971] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6299worker1 # [ 137.735424] nix-daemon[872]: accepted connection from pid 2050, user nix-grpc-daemon (trusted)6300worker1 # [ 137.749678] nix-daemon[872]: reaped child process 2053, status = succeeded6301worker1 # [ 137.918564] nix-daemon[872]: accepted connection from pid 2055, user nix-grpc-daemon (trusted)6302worker1 # [ 137.932485] nix-daemon[872]: reaped child process 2058, status = succeeded6303lb # [ 137.947472] niks3-server[1088]: 2026/09/20 08:18:19 INFO Received uploads request method=POST path=/api/pending_closures6304worker1 # [ 137.958504] nix-grpc-daemon[1714]: time=2026-09-20T08:18:19.877Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6305worker1 # [ 137.960361] nix-grpc-daemon[1714]: time=2026-09-20T08:18:19.879Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6306lb # [ 137.973880] niks3-server[1088]: 2026/09/20 08:18:19 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6307lb # [ 137.986833] niks3-server[1088]: 2026/09/20 08:18:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6308worker1 # [ 137.994510] nix-grpc-daemon[1714]: time=2026-09-20T08:18:19.913Z level=INFO msg="Uploading 1 narinfos"6309lb # [ 137.993123] niks3-server[1088]: 2026/09/20 08:18:19 INFO Signed narinfos id=52 count=16310lb # [ 137.998147] niks3-server[1088]: 2026/09/20 08:18:19 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6311lb # [ 138.009564] niks3-server[1088]: 2026/09/20 08:18:19 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6312lb # [ 138.015943] niks3-server[1088]: 2026/09/20 08:18:19 INFO Completed upload id=526313worker1 # [ 138.018462] nix-grpc-daemon[1714]: time=2026-09-20T08:18:19.937Z level=INFO msg="Upload complete. (446ms)"6314lb # [ 138.020216] niks3-server[1088]: 2026/09/20 08:18:19 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6315worker1 # [ 138.021863] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=0 paths=1 nar_bytes_in=6246316worker1 # [ 138.027066] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626317worker1 # [ 138.036594] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6318worker1 # [ 138.042199] nix-daemon[872]: reaped child process 2048, status = succeeded6319worker1 # [ 138.047849] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6320worker1 # [ 138.874264] nix-daemon[872]: reaped child process 2062, status = succeeded6321worker1 # [ 139.038529] nix-daemon[872]: accepted connection from pid 2077, user nix-grpc-daemon (trusted)6322worker1 # [ 139.052300] nix-daemon[872]: reaped child process 2080, status = succeeded6323lb # [ 139.068404] niks3-server[1088]: 2026/09/20 08:18:20 INFO Received uploads request method=POST path=/api/pending_closures6324worker1 # [ 139.079856] nix-grpc-daemon[1714]: time=2026-09-20T08:18:20.999Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6325worker1 # [ 139.081758] nix-grpc-daemon[1714]: time=2026-09-20T08:18:21.000Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6326lb # [ 139.109655] niks3-server[1088]: 2026/09/20 08:18:20 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6327lb # [ 139.120074] niks3-server[1088]: 2026/09/20 08:18:20 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6328lb # [ 139.127719] niks3-server[1088]: 2026/09/20 08:18:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6329lb # [ 139.133302] niks3-server[1088]: 2026/09/20 08:18:20 INFO Signed narinfos id=53 count=16330worker1 # [ 139.138528] nix-grpc-daemon[1714]: time=2026-09-20T08:18:21.057Z level=INFO msg="Uploading 1 narinfos"6331lb # [ 139.138348] niks3-server[1088]: 2026/09/20 08:18:20 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6332lb # [ 139.146998] niks3-server[1088]: 2026/09/20 08:18:20 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6333lb # [ 139.154326] niks3-server[1088]: 2026/09/20 08:18:20 INFO Completed upload id=536334lb # [ 139.156112] niks3-server[1088]: 2026/09/20 08:18:20 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6335worker1 # [ 139.157212] nix-grpc-daemon[1714]: time=2026-09-20T08:18:21.076Z level=INFO msg="Upload complete. (302ms)"6336worker1 # [ 139.166941] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=11 outputs=16337worker1 # [ 139.177178] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:21Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16338worker1 # [ 139.180722] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626339worker1 # [ 139.184072] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:21Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06340worker1 # [ 139.194315] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:432626341worker1 # [ 139.197773] nix-daemon[872]: reaped child process 2060, status = succeeded6342worker1 # [ 139.202931] nix-grpc-daemon[1714]: time=2026-09-20T08:18:21.122Z level=INFO msg="All 1 paths already cached"6343worker1 # [ 139.207302] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:432626344worker1 # [ 139.212044] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6345worker1 # [ 139.382245] nix-daemon[872]: accepted connection from pid 2086, user nix-grpc-daemon (trusted)6346worker1 # [ 139.396712] nix-daemon[872]: reaped child process 2089, status = succeeded6347worker1 # [ 139.558463] nix-daemon[872]: accepted connection from pid 2091, user nix-grpc-daemon (trusted)6348worker1 # [ 139.572785] nix-daemon[872]: reaped child process 2094, status = succeeded6349lb # [ 139.586767] niks3-server[1088]: 2026/09/20 08:18:21 INFO Received uploads request method=POST path=/api/pending_closures6350worker1 # [ 139.599889] nix-grpc-daemon[1714]: time=2026-09-20T08:18:21.519Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6351worker1 # [ 139.601294] nix-grpc-daemon[1714]: time=2026-09-20T08:18:21.519Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6352lb # [ 139.617641] niks3-server[1088]: 2026/09/20 08:18:21 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6353lb # [ 139.627086] niks3-server[1088]: 2026/09/20 08:18:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6354worker1 # [ 139.634389] nix-grpc-daemon[1714]: time=2026-09-20T08:18:21.553Z level=INFO msg="Uploading 1 narinfos"6355lb # [ 139.631683] niks3-server[1088]: 2026/09/20 08:18:21 INFO Signed narinfos id=54 count=16356lb # [ 139.638437] niks3-server[1088]: 2026/09/20 08:18:21 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6357lb # [ 139.650547] niks3-server[1088]: 2026/09/20 08:18:21 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6358lb # [ 139.655252] niks3-server[1088]: 2026/09/20 08:18:21 INFO Completed upload id=546359worker1 # [ 139.660613] nix-grpc-daemon[1714]: time=2026-09-20T08:18:21.579Z level=INFO msg="Upload complete. (442ms)"6360lb # [ 139.658630] niks3-server[1088]: 2026/09/20 08:18:21 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6361worker1 # [ 139.664444] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=0 paths=1 nar_bytes_in=6246362worker1 # [ 139.670332] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626363worker1 # [ 139.679345] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6364worker1 # [ 139.685401] nix-daemon[872]: reaped child process 2084, status = succeeded6365worker1 # [ 139.691582] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6366worker1 # [ 141.108829] nix-daemon[872]: reaped child process 2098, status = succeeded6367worker1 # [ 141.259291] nix-daemon[872]: accepted connection from pid 2113, user nix-grpc-daemon (trusted)6368worker1 # [ 141.273403] nix-daemon[872]: reaped child process 2116, status = succeeded6369lb # [ 141.288679] niks3-server[1088]: 2026/09/20 08:18:22 INFO Received uploads request method=POST path=/api/pending_closures6370worker1 # [ 141.299677] nix-grpc-daemon[1714]: time=2026-09-20T08:18:23.218Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6371worker1 # [ 141.301787] nix-grpc-daemon[1714]: time=2026-09-20T08:18:23.221Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6372lb # [ 141.322163] niks3-server[1088]: 2026/09/20 08:18:22 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6373lb # [ 141.335051] niks3-server[1088]: 2026/09/20 08:18:23 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6374lb # [ 141.344884] niks3-server[1088]: 2026/09/20 08:18:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6375lb # [ 141.349883] niks3-server[1088]: 2026/09/20 08:18:23 INFO Signed narinfos id=55 count=16376worker1 # [ 141.354917] nix-grpc-daemon[1714]: time=2026-09-20T08:18:23.274Z level=INFO msg="Uploading 1 narinfos"6377lb # [ 141.355400] niks3-server[1088]: 2026/09/20 08:18:23 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6378lb # [ 141.365244] niks3-server[1088]: 2026/09/20 08:18:23 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6379lb # [ 141.369682] niks3-server[1088]: 2026/09/20 08:18:23 INFO Completed upload id=556380worker1 # [ 141.372224] nix-grpc-daemon[1714]: time=2026-09-20T08:18:23.291Z level=WARN msg="Failed to register uploaded object" key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo error="server returned 404: object is not pending upload\n"6381worker1 # [ 141.376558] nix-grpc-daemon[1714]: time=2026-09-20T08:18:23.294Z level=INFO msg="Upload complete. (274ms)"6382worker1 # [ 141.380610] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=12 outputs=16383worker1 # [ 141.383225] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:23Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16384worker1 # [ 141.385217] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626385worker1 # [ 141.388320] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:23Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06386worker1 # [ 141.394681] nix-daemon[872]: reaped child process 2096, status = succeeded6387worker1 # [ 141.395968] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:432626388worker1 # [ 141.403188] nix-grpc-daemon[1714]: time=2026-09-20T08:18:23.322Z level=INFO msg="All 2 paths already cached"6389worker1 # [ 141.407565] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:432626390worker1 # [ 141.411666] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6391worker1 # [ 141.579268] nix-daemon[872]: accepted connection from pid 2122, user nix-grpc-daemon (trusted)6392worker1 # [ 141.593218] nix-daemon[872]: reaped child process 2125, status = succeeded6393worker1 # [ 141.768898] nix-daemon[872]: accepted connection from pid 2127, user nix-grpc-daemon (trusted)6394worker1 # [ 141.780526] nix-daemon[872]: reaped child process 2130, status = succeeded6395lb # [ 141.794485] niks3-server[1088]: 2026/09/20 08:18:23 INFO Received uploads request method=POST path=/api/pending_closures6396worker1 # [ 141.801809] nix-grpc-daemon[1714]: time=2026-09-20T08:18:23.721Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6397worker1 # [ 141.803349] nix-grpc-daemon[1714]: time=2026-09-20T08:18:23.722Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6398lb # [ 141.811762] niks3-server[1088]: 2026/09/20 08:18:23 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6399lb # [ 141.814863] niks3-server[1088]: 2026/09/20 08:18:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6400lb # [ 141.817384] niks3-server[1088]: 2026/09/20 08:18:23 INFO Signed narinfos id=56 count=16401worker1 # [ 141.820087] nix-grpc-daemon[1714]: time=2026-09-20T08:18:23.739Z level=INFO msg="Uploading 1 narinfos"6402lb # [ 141.818967] niks3-server[1088]: 2026/09/20 08:18:23 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6403lb # [ 141.824064] niks3-server[1088]: 2026/09/20 08:18:23 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6404lb # [ 141.828438] niks3-server[1088]: 2026/09/20 08:18:23 INFO Completed upload id=566405worker1 # [ 141.832179] nix-grpc-daemon[1714]: time=2026-09-20T08:18:23.751Z level=INFO msg="Upload complete. (414ms)"6406lb # [ 141.830140] niks3-server[1088]: 2026/09/20 08:18:23 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6407worker1 # [ 141.834360] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=0 paths=1 nar_bytes_in=7526408worker1 # [ 141.837130] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626409worker1 # [ 141.845244] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6410worker1 # [ 141.847237] nix-daemon[872]: reaped child process 2120, status = succeeded6411worker1 # [ 141.852893] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6412worker1 # [ 143.269104] nix-daemon[872]: reaped child process 2134, status = succeeded6413worker1 # [ 143.424960] nix-daemon[872]: accepted connection from pid 2149, user nix-grpc-daemon (trusted)6414worker1 # [ 143.438656] nix-daemon[872]: reaped child process 2152, status = succeeded6415lb # [ 143.447151] niks3-server[1088]: 2026/09/20 08:18:25 INFO Received uploads request method=POST path=/api/pending_closures6416worker1 # [ 143.454152] nix-grpc-daemon[1714]: time=2026-09-20T08:18:25.373Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6417worker1 # [ 143.455591] nix-grpc-daemon[1714]: time=2026-09-20T08:18:25.375Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6418lb # [ 143.465693] niks3-server[1088]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6419lb # [ 143.469092] niks3-server[1088]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6420lb # [ 143.472446] niks3-server[1088]: 2026/09/20 08:18:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6421lb # [ 143.474123] niks3-server[1088]: 2026/09/20 08:18:25 INFO Signed narinfos id=57 count=16422worker1 # [ 143.477919] nix-grpc-daemon[1714]: time=2026-09-20T08:18:25.397Z level=INFO msg="Uploading 1 narinfos"6423lb # [ 143.478259] niks3-server[1088]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6424lb # [ 143.482864] niks3-server[1088]: 2026/09/20 08:18:25 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6425lb # [ 143.485553] niks3-server[1088]: 2026/09/20 08:18:25 INFO Completed upload id=576426worker1 # [ 143.488134] nix-grpc-daemon[1714]: time=2026-09-20T08:18:25.407Z level=INFO msg="Upload complete. (227ms)"6427lb # [ 143.488248] niks3-server[1088]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6428worker1 # [ 143.491329] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=13 outputs=16429worker1 # [ 143.495250] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:25Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16430worker1 # [ 143.501120] nix-daemon[872]: reaped child process 2132, status = succeeded6431worker1 # [ 143.534585] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626432worker1 # [ 143.543516] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:432626433worker1 # [ 143.552443] nix-grpc-daemon[1714]: time=2026-09-20T08:18:25.471Z level=INFO msg="All 2 paths already cached"6434worker1 # [ 143.557936] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:432626435worker1 # [ 143.567851] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6436worker1 # [ 143.733769] nix-daemon[872]: accepted connection from pid 2156, user nix-grpc-daemon (trusted)6437worker1 # [ 143.747210] nix-daemon[872]: reaped child process 2159, status = succeeded6438worker1 # [ 143.903988] nix-daemon[872]: accepted connection from pid 2161, user nix-grpc-daemon (trusted)6439worker1 # [ 143.917189] nix-daemon[872]: reaped child process 2164, status = succeeded6440lb # [ 143.928744] niks3-server[1088]: 2026/09/20 08:18:25 INFO Received uploads request method=POST path=/api/pending_closures6441worker1 # [ 143.939084] nix-grpc-daemon[1714]: time=2026-09-20T08:18:25.858Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6442worker1 # [ 143.940925] nix-grpc-daemon[1714]: time=2026-09-20T08:18:25.860Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6443lb # [ 143.958656] niks3-server[1088]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6444lb # [ 143.968303] niks3-server[1088]: 2026/09/20 08:18:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6445worker1 # [ 143.976964] nix-grpc-daemon[1714]: time=2026-09-20T08:18:25.896Z level=INFO msg="Uploading 1 narinfos"6446lb # [ 143.974363] niks3-server[1088]: 2026/09/20 08:18:25 INFO Signed narinfos id=58 count=16447lb # [ 143.978593] niks3-server[1088]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6448lb # [ 143.991050] niks3-server[1088]: 2026/09/20 08:18:25 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6449lb # [ 143.997469] niks3-server[1088]: 2026/09/20 08:18:25 INFO Completed upload id=586450worker1 # [ 143.999972] nix-grpc-daemon[1714]: time=2026-09-20T08:18:25.919Z level=INFO msg="Upload complete. (423ms)"6451lb # [ 143.999795] niks3-server[1088]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6452worker1 # [ 144.003413] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=0 paths=1 nar_bytes_in=7526453worker1 # [ 144.008933] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626454worker1 # [ 144.019134] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6455worker1 # [ 144.023650] nix-daemon[872]: reaped child process 2154, status = succeeded6456worker1 # [ 144.028894] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6457worker1 # [ 145.042834] nix-daemon[872]: reaped child process 2168, status = succeeded6458worker1 # [ 145.208661] nix-daemon[872]: accepted connection from pid 2183, user nix-grpc-daemon (trusted)6459worker1 # [ 145.222096] nix-daemon[872]: reaped child process 2186, status = succeeded6460lb # [ 145.238717] niks3-server[1088]: 2026/09/20 08:18:26 INFO Received uploads request method=POST path=/api/pending_closures6461worker1 # [ 145.251635] nix-grpc-daemon[1714]: time=2026-09-20T08:18:27.170Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6462worker1 # [ 145.254062] nix-grpc-daemon[1714]: time=2026-09-20T08:18:27.172Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6463lb # [ 145.276109] niks3-server[1088]: 2026/09/20 08:18:26 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6464lb # [ 145.284611] niks3-server[1088]: 2026/09/20 08:18:26 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6465lb # [ 145.294646] niks3-server[1088]: 2026/09/20 08:18:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6466lb # [ 145.300980] niks3-server[1088]: 2026/09/20 08:18:26 INFO Signed narinfos id=59 count=16467worker1 # [ 145.303843] nix-grpc-daemon[1714]: time=2026-09-20T08:18:27.223Z level=INFO msg="Uploading 1 narinfos"6468lb # [ 145.308048] niks3-server[1088]: 2026/09/20 08:18:26 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6469lb # [ 145.316374] niks3-server[1088]: 2026/09/20 08:18:26 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6470lb # [ 145.321496] niks3-server[1088]: 2026/09/20 08:18:26 INFO Completed upload id=596471lb # [ 145.324458] niks3-server[1088]: 2026/09/20 08:18:27 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6472worker1 # [ 145.325861] nix-grpc-daemon[1714]: time=2026-09-20T08:18:27.245Z level=INFO msg="Upload complete. (289ms)"6473worker1 # [ 145.333638] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=14 outputs=16474worker1 # [ 145.340466] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:27Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16475worker1 # [ 145.352407] nix-daemon[872]: reaped child process 2166, status = succeeded6476worker1 # [ 145.376100] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626477worker1 # [ 145.388399] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:432626478worker1 # [ 145.400522] nix-grpc-daemon[1714]: time=2026-09-20T08:18:27.319Z level=INFO msg="All 2 paths already cached"6479worker1 # [ 145.406931] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:432626480worker1 # [ 145.415907] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6481worker1 # [ 145.599205] nix-daemon[872]: accepted connection from pid 2190, user nix-grpc-daemon (trusted)6482worker1 # [ 145.612678] nix-daemon[872]: reaped child process 2193, status = succeeded6483worker1 # [ 145.771786] nix-daemon[872]: accepted connection from pid 2195, user nix-grpc-daemon (trusted)6484worker1 # [ 145.785215] nix-daemon[872]: reaped child process 2198, status = succeeded6485lb # [ 145.795949] niks3-server[1088]: 2026/09/20 08:18:27 INFO Received uploads request method=POST path=/api/pending_closures6486worker1 # [ 145.806873] nix-grpc-daemon[1714]: time=2026-09-20T08:18:27.726Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6487worker1 # [ 145.808231] nix-grpc-daemon[1714]: time=2026-09-20T08:18:27.726Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6488lb # [ 145.820425] niks3-server[1088]: 2026/09/20 08:18:27 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6489lb # [ 145.832785] niks3-server[1088]: 2026/09/20 08:18:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6490lb # [ 145.838619] niks3-server[1088]: 2026/09/20 08:18:27 INFO Signed narinfos id=60 count=16491worker1 # [ 145.844325] nix-grpc-daemon[1714]: time=2026-09-20T08:18:27.763Z level=INFO msg="Uploading 1 narinfos"6492lb # [ 145.842191] niks3-server[1088]: 2026/09/20 08:18:27 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6493lb # [ 145.855349] niks3-server[1088]: 2026/09/20 08:18:27 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6494worker1 # [ 145.862513] nix-grpc-daemon[1714]: time=2026-09-20T08:18:27.781Z level=INFO msg="Upload complete. (434ms)"6495lb # [ 145.859954] niks3-server[1088]: 2026/09/20 08:18:27 INFO Completed upload id=606496worker1 # [ 145.865079] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=0 paths=1 nar_bytes_in=7526497worker1 # [ 145.867853] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:432626498lb # [ 145.865438] niks3-server[1088]: 2026/09/20 08:18:27 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6499worker1 # [ 145.875581] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6500worker1 # [ 145.878722] nix-daemon[872]: reaped child process 2188, status = succeeded6501worker1 # [ 145.884980] nix-daemon[872]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6502worker1 # [ 147.099447] nix-daemon[872]: reaped child process 2202, status = succeeded6503worker1 # [ 147.255960] nix-daemon[872]: accepted connection from pid 2217, user nix-grpc-daemon (trusted)6504worker1 # [ 147.269551] nix-daemon[872]: reaped child process 2220, status = succeeded6505lb # [ 147.284956] niks3-server[1088]: 2026/09/20 08:18:28 INFO Received uploads request method=POST path=/api/pending_closures6506worker1 # [ 147.295484] nix-grpc-daemon[1714]: time=2026-09-20T08:18:29.214Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6507worker1 # [ 147.297035] nix-grpc-daemon[1714]: time=2026-09-20T08:18:29.216Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6508lb # [ 147.326902] niks3-server[1088]: 2026/09/20 08:18:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6509lb # [ 147.331292] niks3-server[1088]: 2026/09/20 08:18:29 INFO Signed narinfos id=61 count=16510worker1 # [ 147.336932] nix-grpc-daemon[1714]: time=2026-09-20T08:18:29.256Z level=INFO msg="Uploading 1 narinfos"6511lb # [ 147.341635] niks3-server[1088]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6512lb # [ 147.344935] niks3-server[1088]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6513lb # [ 147.354694] niks3-server[1088]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6514lb # [ 147.360899] niks3-server[1088]: 2026/09/20 08:18:29 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6515lb # [ 147.365883] niks3-server[1088]: 2026/09/20 08:18:29 INFO Completed upload id=616516lb # [ 147.367342] niks3-server[1088]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6517worker1 # [ 147.369754] nix-grpc-daemon[1714]: time=2026-09-20T08:18:29.289Z level=INFO msg="Upload complete. (278ms)"6518worker1 # [ 147.377102] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43262 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=15 outputs=16519worker1 # [ 147.387588] nix-daemon[872]: reaped child process 2200, status = succeeded6520client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.81 seconds)6521worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6522worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.06 seconds)6523client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]'6524client # [ 147.534374] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features "[\"gpu\"]".6525client # Running as unit: gpu.service; invocation ID: c0ba15cf9dfe4fc69563434aa5a9ba596526client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.07 seconds)6527lb: must succeed: curl -sf localhost:9901/clusters6528lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6529lb: must succeed: curl -sf localhost:9901/clusters6530lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6531worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="x86_64-linux"} ' || true6532worker1 # [ 147.703425] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:432626533client # [ 147.712249] nix[1331]: don't know how to build these paths:6534client # [ 147.713191] nix[1331]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv6535client # [ 147.722562] nix[1331]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, waiting up to 120s for a worker6536worker1 # [ 147.719112] nix-grpc-daemon[1638]: ts=2026-09-20T08:18:29Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06537worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="x86_64-linux"} ' || true, in 0.08 seconds)6538client: waiting for success: systemctl show -p Result gpu | grep -q exit-code6539lb # [ 149.115839] envoy[988]: conn peer=[2001:db8:1::1]:33840 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26920 tx=10711 ms=176086540client # [ 267.723374] nix[1331]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}6541client # [ 267.729231] nix[1331]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed6542client # [ 267.761780] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE6543client # [ 267.764725] systemd[1]: gpu.service: Failed with result 'exit-code'.6544client # [ 267.769849] systemd[1]: gpu.service: Consumed 194ms CPU time over 2min 233ms wall clock time, 33.4M memory peak, 4K written to disk, 6.4K incoming IP traffic, 5.5K outgoing IP traffic.6545client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 120.09 seconds)6546client: must succeed: journalctl -u gpu -o cat6547client: (finished: must succeed: journalctl -u gpu -o cat, in 0.02 seconds)6548lb: must succeed: curl -sf localhost:9901/clusters6549lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6550lb: must succeed: curl -sf localhost:9901/clusters6551lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6552worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="x86_64-linux"} ' || true6553worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="x86_64-linux"} ' || true, in 0.03 seconds)6554(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 138.35 seconds)6555subtest: low disk drains a worker and builds go to the other6556worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6557worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.94 seconds)6558worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6559lb # [ 269.121814] envoy[988]: conn peer=[2001:db8:1::1]:44300 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=725 tx=455 ms=1200346560worker1 # [ 269.463263] nix-grpc-daemon[1638]: ts=2026-09-20T08:20:31Z level=info event=unhealthy reason=min_free6561worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.08 seconds)6562client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&26563worker2 # [ 270.204471] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:343746564client # don't know how to build these paths:6565client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6566worker1 # [ 270.214283] nix-grpc-daemon[1638]: ts=2026-09-20T08:20:32Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06567worker1 # [ 270.218962] nix-grpc-daemon[1638]: ts=2026-09-20T08:20:32Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16568worker2 # [ 270.266174] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343746569worker2 # [ 270.278296] nix-grpc-daemon[1533]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 14 ms (attempt 1/5)6570worker2 # [ 270.298093] nix-grpc-daemon[1533]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 94 ms (attempt 2/5)6571worker2 # [ 270.398077] nix-grpc-daemon[1533]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 264 ms (attempt 3/5)6572worker2 # [ 270.670086] nix-grpc-daemon[1533]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 257 ms (attempt 4/5)6573worker2 # [ 270.933748] nix-grpc-daemon[1533]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6574worker2 # [ 270.952539] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343746575client # copying 1 paths to 'lb:50051'...6576client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6577worker2 # [ 270.964297] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343746578worker2 # [ 270.976621] nix-daemon[847]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)6579worker2 # [ 270.995655] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:32Z level=info event=niks3_push_started pid=15896580worker2 # [ 271.346395] nix-daemon[847]: accepted connection from pid 1602, user nix-grpc-daemon (trusted)6581worker2 # [ 271.361512] nix-daemon[847]: reaped child process 1605, status = succeeded6582worker2 # [ 271.512541] nix-daemon[847]: accepted connection from pid 1607, user nix-grpc-daemon (trusted)6583worker2 # [ 271.526400] nix-daemon[847]: reaped child process 1610, status = succeeded6584lb # [ 271.530570] niks3-server[1088]: 2026/09/20 08:20:33 INFO Received uploads request method=POST path=/api/pending_closures6585worker2 # [ 271.546379] nix-grpc-daemon[1589]: time=2026-09-20T08:20:33.316Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6586worker2 # [ 271.548906] nix-grpc-daemon[1589]: time=2026-09-20T08:20:33.318Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6587lb # [ 271.554488] niks3-server[1088]: 2026/09/20 08:20:33 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6588lb # [ 271.562122] niks3-server[1088]: 2026/09/20 08:20:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6589lb # [ 271.569052] niks3-server[1088]: 2026/09/20 08:20:33 INFO Signed narinfos id=62 count=16590worker2 # [ 271.582494] nix-grpc-daemon[1589]: time=2026-09-20T08:20:33.352Z level=INFO msg="Uploading 1 narinfos"6591lb # [ 271.578529] niks3-server[1088]: 2026/09/20 08:20:33 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6592lb # [ 271.582593] niks3-server[1088]: 2026/09/20 08:20:33 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6593lb # [ 271.586628] niks3-server[1088]: 2026/09/20 08:20:33 INFO Completed upload id=626594worker2 # [ 271.597052] nix-grpc-daemon[1589]: time=2026-09-20T08:20:33.367Z level=INFO msg="Upload complete. (405ms)"6595lb # [ 271.588275] niks3-server[1088]: 2026/09/20 08:20:33 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6596worker2 # [ 271.599721] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34374 duration_s=0 paths=1 nar_bytes_in=5126597worker2 # [ 271.602661] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343746598worker2 # [ 271.610623] nix-daemon[847]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)6599worker2 # [ 271.613778] nix-daemon[847]: reaped child process 1587, status = succeeded6600client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6601client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6602worker2 # [ 271.618951] nix-daemon[847]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)6603client # farm-a> LOG-farm-a-drain6604worker2 # [ 272.842524] nix-daemon[847]: reaped child process 1614, status = succeeded6605worker2 # [ 272.995456] nix-daemon[847]: accepted connection from pid 1629, user nix-grpc-daemon (trusted)6606worker2 # [ 273.009568] nix-daemon[847]: reaped child process 1632, status = succeeded6607lb # [ 273.012639] niks3-server[1088]: 2026/09/20 08:20:34 INFO Received uploads request method=POST path=/api/pending_closures6608worker2 # [ 273.029428] nix-grpc-daemon[1589]: time=2026-09-20T08:20:34.799Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6609worker2 # [ 273.031090] nix-grpc-daemon[1589]: time=2026-09-20T08:20:34.801Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6610lb # [ 273.048647] niks3-server[1088]: 2026/09/20 08:20:34 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6611lb # [ 273.060328] niks3-server[1088]: 2026/09/20 08:20:34 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6612lb # [ 273.070750] niks3-server[1088]: 2026/09/20 08:20:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6613lb # [ 273.075079] niks3-server[1088]: 2026/09/20 08:20:34 INFO Signed narinfos id=63 count=16614worker2 # [ 273.086035] nix-grpc-daemon[1589]: time=2026-09-20T08:20:34.856Z level=INFO msg="Uploading 1 narinfos"6615lb # [ 273.081136] niks3-server[1088]: 2026/09/20 08:20:34 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6616lb # [ 273.090038] niks3-server[1088]: 2026/09/20 08:20:34 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6617lb # [ 273.092994] niks3-server[1088]: 2026/09/20 08:20:34 INFO Completed upload id=636618worker2 # [ 273.103506] nix-grpc-daemon[1589]: time=2026-09-20T08:20:34.874Z level=INFO msg="Upload complete. (276ms)"6619lb # [ 273.095093] niks3-server[1088]: 2026/09/20 08:20:34 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6620worker2 # [ 273.109582] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34374 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=16 outputs=16621worker1 # [ 273.105590] nix-grpc-daemon[1638]: ts=2026-09-20T08:20:35Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06622worker1 # [ 273.107358] nix-grpc-daemon[1638]: ts=2026-09-20T08:20:35Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16623worker2 # [ 273.121882] nix-daemon[847]: reaped child process 1612, status = succeeded6624worker2 # [ 273.157991] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343746625worker2 # [ 273.170293] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343746626worker2 # [ 273.183730] nix-grpc-daemon[1589]: time=2026-09-20T08:20:34.954Z level=INFO msg="All 1 paths already cached"6627client # copying 1 paths to 'lb:50051'...6628client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6629worker2 # [ 273.191735] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343746630worker2 # [ 273.202174] nix-daemon[847]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)6631worker2 # [ 273.363776] nix-daemon[847]: accepted connection from pid 1636, user nix-grpc-daemon (trusted)6632worker2 # [ 273.378457] nix-daemon[847]: reaped child process 1639, status = succeeded6633worker2 # [ 273.532672] nix-daemon[847]: accepted connection from pid 1641, user nix-grpc-daemon (trusted)6634worker2 # [ 273.546469] nix-daemon[847]: reaped child process 1644, status = succeeded6635lb # [ 273.549765] niks3-server[1088]: 2026/09/20 08:20:35 INFO Received uploads request method=POST path=/api/pending_closures6636worker2 # [ 273.567672] nix-grpc-daemon[1589]: time=2026-09-20T08:20:35.338Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6637worker2 # [ 273.569192] nix-grpc-daemon[1589]: time=2026-09-20T08:20:35.339Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6638lb # [ 273.575829] niks3-server[1088]: 2026/09/20 08:20:35 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6639lb # [ 273.588336] niks3-server[1088]: 2026/09/20 08:20:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6640worker2 # [ 273.604265] nix-grpc-daemon[1589]: time=2026-09-20T08:20:35.374Z level=INFO msg="Uploading 1 narinfos"6641lb # [ 273.593847] niks3-server[1088]: 2026/09/20 08:20:35 INFO Signed narinfos id=64 count=16642lb # [ 273.601213] niks3-server[1088]: 2026/09/20 08:20:35 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6643lb # [ 273.609738] niks3-server[1088]: 2026/09/20 08:20:35 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6644lb # [ 273.618187] niks3-server[1088]: 2026/09/20 08:20:35 INFO Completed upload id=646645worker2 # [ 273.628662] nix-grpc-daemon[1589]: time=2026-09-20T08:20:35.399Z level=INFO msg="Upload complete. (414ms)"6646lb # [ 273.620396] niks3-server[1088]: 2026/09/20 08:20:35 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6647worker2 # [ 273.631673] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34374 duration_s=0 paths=1 nar_bytes_in=6246648worker2 # [ 273.637231] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343746649worker2 # [ 273.643211] nix-daemon[847]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)6650worker2 # [ 273.645743] nix-daemon[847]: reaped child process 1634, status = succeeded6651worker2 # [ 273.651033] nix-daemon[847]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)6652client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6653client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6654client # farm-b> LOG-farm-b-drain6655worker2 # [ 274.480800] nix-daemon[847]: reaped child process 1648, status = succeeded6656worker2 # [ 274.630440] nix-daemon[847]: accepted connection from pid 1663, user nix-grpc-daemon (trusted)6657worker2 # [ 274.645455] nix-daemon[847]: reaped child process 1666, status = succeeded6658lb # [ 274.649560] niks3-server[1088]: 2026/09/20 08:20:36 INFO Received uploads request method=POST path=/api/pending_closures6659worker2 # [ 274.669117] nix-grpc-daemon[1589]: time=2026-09-20T08:20:36.439Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6660worker2 # [ 274.670708] nix-grpc-daemon[1589]: time=2026-09-20T08:20:36.441Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6661lb # [ 274.690666] niks3-server[1088]: 2026/09/20 08:20:36 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6662lb # [ 274.697623] niks3-server[1088]: 2026/09/20 08:20:36 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6663lb # [ 274.704188] niks3-server[1088]: 2026/09/20 08:20:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6664worker2 # [ 274.717945] nix-grpc-daemon[1589]: time=2026-09-20T08:20:36.488Z level=INFO msg="Uploading 1 narinfos"6665lb # [ 274.707711] niks3-server[1088]: 2026/09/20 08:20:36 INFO Signed narinfos id=65 count=16666lb # [ 274.718765] niks3-server[1088]: 2026/09/20 08:20:36 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6667lb # [ 274.721836] niks3-server[1088]: 2026/09/20 08:20:36 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6668lb # [ 274.724239] niks3-server[1088]: 2026/09/20 08:20:36 INFO Completed upload id=656669lb # [ 274.726494] niks3-server[1088]: 2026/09/20 08:20:36 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6670worker2 # [ 274.735960] nix-grpc-daemon[1589]: time=2026-09-20T08:20:36.506Z level=INFO msg="Upload complete. (277ms)"6671worker2 # [ 274.740848] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34374 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=17 outputs=16672worker1 # [ 274.738178] nix-grpc-daemon[1638]: ts=2026-09-20T08:20:36Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06673worker1 # [ 274.740030] nix-grpc-daemon[1638]: ts=2026-09-20T08:20:36Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16674worker2 # [ 274.754797] nix-daemon[847]: reaped child process 1646, status = succeeded6675worker2 # [ 274.791409] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343746676worker2 # [ 274.803528] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343746677worker2 # [ 274.816649] nix-grpc-daemon[1589]: time=2026-09-20T08:20:36.587Z level=INFO msg="All 2 paths already cached"6678client # copying 1 paths to 'lb:50051'...6679client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6680worker2 # [ 274.824940] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343746681worker2 # [ 274.833519] nix-daemon[847]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)6682worker2 # [ 274.999359] nix-daemon[847]: accepted connection from pid 1670, user nix-grpc-daemon (trusted)6683worker2 # [ 275.013788] nix-daemon[847]: reaped child process 1673, status = succeeded6684worker2 # [ 275.168361] nix-daemon[847]: accepted connection from pid 1675, user nix-grpc-daemon (trusted)6685worker2 # [ 275.182164] nix-daemon[847]: reaped child process 1678, status = succeeded6686lb # [ 275.186893] niks3-server[1088]: 2026/09/20 08:20:36 INFO Received uploads request method=POST path=/api/pending_closures6687worker2 # [ 275.208232] nix-grpc-daemon[1589]: time=2026-09-20T08:20:36.978Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6688worker2 # [ 275.210152] nix-grpc-daemon[1589]: time=2026-09-20T08:20:36.980Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6689lb # [ 275.217110] niks3-server[1088]: 2026/09/20 08:20:36 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6690lb # [ 275.229062] niks3-server[1088]: 2026/09/20 08:20:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6691worker2 # [ 275.244094] nix-grpc-daemon[1589]: time=2026-09-20T08:20:37.014Z level=INFO msg="Uploading 1 narinfos"6692lb # [ 275.234156] niks3-server[1088]: 2026/09/20 08:20:36 INFO Signed narinfos id=66 count=16693lb # [ 275.240937] niks3-server[1088]: 2026/09/20 08:20:36 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6694lb # [ 275.250129] niks3-server[1088]: 2026/09/20 08:20:36 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6695lb # [ 275.255247] niks3-server[1088]: 2026/09/20 08:20:36 INFO Completed upload id=666696worker2 # [ 275.268059] nix-grpc-daemon[1589]: time=2026-09-20T08:20:37.038Z level=INFO msg="Upload complete. (420ms)"6697lb # [ 275.259542] niks3-server[1088]: 2026/09/20 08:20:36 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6698worker2 # [ 275.272326] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34374 duration_s=0 paths=1 nar_bytes_in=7526699worker2 # [ 275.276764] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343746700worker2 # [ 275.286119] nix-daemon[847]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)6701worker2 # [ 275.294250] nix-daemon[847]: reaped child process 1668, status = succeeded6702worker2 # [ 275.297383] nix-daemon[847]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)6703client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6704client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6705client # farm-top> LOG-farm-top-drain6706worker2 # [ 276.313951] nix-daemon[847]: reaped child process 1682, status = succeeded6707worker2 # [ 276.453199] nix-daemon[847]: accepted connection from pid 1697, user nix-grpc-daemon (trusted)6708worker2 # [ 276.467248] nix-daemon[847]: reaped child process 1700, status = succeeded6709lb # [ 276.471651] niks3-server[1088]: 2026/09/20 08:20:38 INFO Received uploads request method=POST path=/api/pending_closures6710worker2 # [ 276.491351] nix-grpc-daemon[1589]: time=2026-09-20T08:20:38.260Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6711worker2 # [ 276.493050] nix-grpc-daemon[1589]: time=2026-09-20T08:20:38.260Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6712lb # [ 276.504284] niks3-server[1088]: 2026/09/20 08:20:38 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6713lb # [ 276.511132] niks3-server[1088]: 2026/09/20 08:20:38 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6714lb # [ 276.524840] niks3-server[1088]: 2026/09/20 08:20:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6715lb # [ 276.531264] niks3-server[1088]: 2026/09/20 08:20:38 INFO Signed narinfos id=67 count=16716worker2 # [ 276.544174] nix-grpc-daemon[1589]: time=2026-09-20T08:20:38.314Z level=INFO msg="Uploading 1 narinfos"6717lb # [ 276.533936] niks3-server[1088]: 2026/09/20 08:20:38 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6718lb # [ 276.545507] niks3-server[1088]: 2026/09/20 08:20:38 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6719lb # [ 276.550204] niks3-server[1088]: 2026/09/20 08:20:38 INFO Completed upload id=676720lb # [ 276.553044] niks3-server[1088]: 2026/09/20 08:20:38 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6721worker2 # [ 276.560546] nix-grpc-daemon[1589]: time=2026-09-20T08:20:38.331Z level=INFO msg="Upload complete. (256ms)"6722worker2 # [ 276.566790] nix-grpc-daemon[1533]: ts=2026-09-20T08:20:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34374 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=18 outputs=16723worker2 # [ 276.580363] nix-daemon[847]: reaped child process 1680, status = succeeded6724client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&2, in 6.62 seconds)6725client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath6726client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath, in 0.18 seconds)6727worker1: must succeed: rm /nix/.rw-store/fill6728worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.10 seconds)6729worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6730worker1 # [ 277.469485] nix-grpc-daemon[1638]: ts=2026-09-20T08:20:39Z level=info event=healthy reason=min_free6731worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.07 seconds)6732(finished: subtest: low disk drains a worker and builds go to the other, in 10.05 seconds)6733(finished: run the VM test script, in 279.01 seconds)6734test script finished in 279.22s6735cleanup6736kill QemuMachine (pid 50)6737client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6738kill QemuMachine (pid 49)6739lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6740kill QemuMachine (pid 52)6741worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6742kill QemuMachine (pid 51)6743worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6744(finished: cleanup, in 1.07 seconds)6745additionally exposed symbols:6746 client, lb, worker1, worker2,6747 vlan1,6748 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh