vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #344
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.01 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13worker2 # Formatting '/build/vm-state-worker2/tmp.MMM7oHQx1j', fmt=raw size=107374182414worker2 # mke2fs 1.47.4 (6-Mar-2025)15worker2 # Discarding device blocks: 0/262144 done16worker1 # Disk image does not exist, creating the virtualisation disk image...17client # Disk image does not exist, creating the virtualisation disk image...18worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes19client: QEMU running (pid 49)20worker1: QEMU running (pid 51)21worker2: QEMU running (pid 52)22worker1 # Formatting '/build/vm-state-worker1/tmp.DVlwKSRjJI', fmt=raw size=107374182423worker2 # Filesystem UUID: 0b2804a0-7b92-491c-a3b3-a10f17bff26624worker1 # mke2fs 1.47.4 (6-Mar-2025)25worker2 # Superblock backups stored on blocks:26worker1 # Discarding device blocks: 0/262144 done27worker2 # 32768, 98304, 163840, 22937628worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes29worker2 # 30worker1 # Filesystem UUID: c865bc91-d5a9-49c7-bf1c-8481a81ee48a31worker2 # Allocating group tables: 0/8 done32worker1 # Superblock backups stored on blocks:33worker2 # Writing inode tables: 0/8 done34worker2 # Creating journal (8192 blocks): done35worker2 # Writing superblocks and filesystem accounting information: 0/8 done36worker2 # 37worker2 # Virtualisation disk image created.38worker1 # 32768, 98304, 163840, 22937639client # Formatting '/build/vm-state-client/tmp.A2lRr9XpCO', fmt=raw size=107374182440worker1 # 41client # mke2fs 1.47.4 (6-Mar-2025)42worker1 # Allocating group tables: 0/8 done43client # Discarding device blocks: 0/262144 done44worker1 # Writing inode tables: 0/8 done45worker1 # Creating journal (8192 blocks): done46worker1 # Writing superblocks and filesystem accounting information: 0/8 done47worker1 # 48worker1 # Virtualisation disk image created.49client # Creating filesystem with 262144 4k blocks and 65536 inodes50lb: QEMU running (pid 50)51lb # Disk image does not exist, creating the virtualisation disk image...52client # Filesystem UUID: 65fd0ae4-4428-4b87-afd1-cc9cd8af3aea53client # Superblock backups stored on blocks:54client # 32768, 98304, 163840, 22937655(finished: start all VMs, in 0.21 seconds)56client # 57client: waiting for unit network-addresses-eth1.service58client # Allocating group tables: 0/8 done59client # Writing inode tables: 0/8 done60client # Creating journal (8192 blocks): done61client: waiting for the VM to finish booting62lb # Formatting '/build/vm-state-lb/tmp.cYUnWzvFE8', fmt=raw size=107374182463lb # mke2fs 1.47.4 (6-Mar-2025)64client # Writing superblocks and filesystem accounting information: 0/8 done65lb # Discarding device blocks: 0/262144 done66lb # Creating filesystem with 262144 4k blocks and 65536 inodes67lb # Filesystem UUID: 2ea245f9-8b74-4928-863d-ea4b9a6ddbc568client # 69client # Virtualisation disk image created.70lb # Superblock backups stored on blocks:71lb # 32768, 98304, 163840, 22937672lb # 73lb # Allocating group tables: 0/8 done74lb # Writing inode tables: 0/8 done75lb # Creating journal (8192 blocks): done76lb # Writing superblocks and filesystem accounting information: 0/8 done77lb # 78lb # Virtualisation disk image created.79client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83client # 84client # 85client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086worker1 # 87worker2 # 88worker1 # 89worker2 # 90worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0091worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0092client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...93client # 94client # 95client # 96client # 97client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0098worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...99worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...100worker2 # 101worker2 # 102worker2 # 103worker2 # 104worker1 # 105worker1 # 106worker1 # 107worker1 # 108lb # 109lb # 110worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00111worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00112lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00113client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...114client # 115client # 116worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...117worker2 # 118worker2 # 119lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...120lb # 121lb # 122lb # 123lb # 124worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...125worker1 # 126worker1 # 127lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00128lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129lb # 130lb # 131client # Booting from ROM...132worker2 # Booting from ROM...133worker1 # Booting from ROM...134lb # Booting from ROM...135worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026137worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/bhr46xja1kyki42v8lp87l0nsrargk1l-nixos-system-worker2-test/init regInfo=/nix/store/iw1fwr9xgy9i67hbc5f1wjqv08csn4jl-closure-info/registration console=ttyS0,115200n8 console=tty0138worker2 # [ 0.000000] BIOS-provided physical RAM map:139worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable140worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved141worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved142client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4mswv1w7crl5njwzp9d41jjig5l256xq-nixos-system-client-test/init regInfo=/nix/store/blpxkzm53swxlxffz2dn2ks4cp5hilgc-closure-info/registration console=ttyS0,115200n8 console=tty0143client # [ 0.000000] BIOS-provided physical RAM map:144worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable145client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable146worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved147client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved148worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved149client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved150worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved151client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable152worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved153client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved154worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved155worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved156lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026157client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved158worker2 # [ 0.000000] NX (Execute Disable) protection: active159client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved160worker2 # [ 0.000000] APIC: Static calls initialized161worker2 # [ 0.000000] SMBIOS 2.8 present.162client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved163client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved164worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014165worker2 # [ 0.000000] DMI: Memory slots populated: 1/1166client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved167worker2 # [ 0.000000] Hypervisor detected: KVM168lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0qln5mjy767qjp5wbmxjg8jay8k05dsm-nixos-system-lb-test/init regInfo=/nix/store/nwvvzfrgncwhnws6wdjigc6jviavrdxi-closure-info/registration console=ttyS0,115200n8 console=tty0169client # [ 0.000000] NX (Execute Disable) protection: active170lb # [ 0.000000] BIOS-provided physical RAM map:171worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000172client # [ 0.000000] APIC: Static calls initialized173worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00174lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable175client # [ 0.000000] SMBIOS 2.8 present.176worker2 # [ 0.000001] kvm-clock: using sched offset of 487332025 cycles177lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved178client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014179lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved180worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns181client # [ 0.000000] DMI: Memory slots populated: 1/1182client # [ 0.000000] Hypervisor detected: KVM183worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor184lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable185client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000186worker2 # [ 0.000805] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000187lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved188client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00189worker2 # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs190lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved191client # [ 0.000000] kvm-clock: using sched offset of 484356539 cycles192lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved193worker2 # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT194worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026195worker2 # [ 0.002725] found SMP MP-table at [mem 0x000f5450-0x000f545f]196client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns197lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved198worker2 # [ 0.002736] Using GB pages for direct mapping199client # [ 0.000005] tsc: Detected 2400.012 MHz processor200lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved201worker2 # [ 0.002894] RAMDISK: [mem 0x5e367000-0x5ffcffff]202client # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000203worker2 # [ 0.002902] ACPI: Early table checksum verification disabled204lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved205lb # [ 0.000000] NX (Execute Disable) protection: active206client # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs207worker2 # [ 0.002905] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )208lb # [ 0.000000] APIC: Static calls initialized209client # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT210lb # [ 0.000000] SMBIOS 2.8 present.211worker2 # [ 0.002909] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)212worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ycsrgx65d5yfvzr743gfkyvj36s6578h-nixos-system-worker1-test/init regInfo=/nix/store/9kgibijjjb8lzklk71fyc6sa4ml0bv7g-closure-info/registration console=ttyS0,115200n8 console=tty0213worker1 # [ 0.000000] BIOS-provided physical RAM map:214client # [ 0.002740] found SMP MP-table at [mem 0x000f5450-0x000f545f]215worker2 # [ 0.002913] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)216lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014217client # [ 0.002750] Using GB pages for direct mapping218worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable219lb # [ 0.000000] DMI: Memory slots populated: 1/1220client # [ 0.002858] RAMDISK: [mem 0x5e366000-0x5ffcffff]221lb # [ 0.000000] Hypervisor detected: KVM222worker2 # [ 0.002920] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)223worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved224client # [ 0.002866] ACPI: Early table checksum verification disabled225worker2 # [ 0.002922] ACPI: FACS 0x000000005FFE0000 000040226lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000227worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved228client # [ 0.002869] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )229lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00230worker2 # [ 0.002923] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)231worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable232lb # [ 0.000001] kvm-clock: using sched offset of 488842646 cycles233client # [ 0.002873] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)234worker2 # [ 0.002925] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)235worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved236client # [ 0.002876] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)237lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns238worker2 # [ 0.002926] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)239worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved240lb # [ 0.000005] tsc: Detected 2400.012 MHz processor241client # [ 0.002883] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)242lb # [ 0.000815] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000243worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved244worker2 # [ 0.002928] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)245client # [ 0.002885] ACPI: FACS 0x000000005FFE0000 000040246worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved247worker2 # [ 0.002929] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]248lb # [ 0.000842] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs249client # [ 0.002886] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)250worker2 # [ 0.002930] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]251worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved252lb # [ 0.000844] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT253client # [ 0.002888] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)254lb # [ 0.002738] found SMP MP-table at [mem 0x000f5450-0x000f545f]255worker2 # [ 0.002931] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]256worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved257lb # [ 0.002749] Using GB pages for direct mapping258worker1 # [ 0.000000] NX (Execute Disable) protection: active259worker2 # [ 0.002931] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]260client # [ 0.002890] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)261lb # [ 0.002899] RAMDISK: [mem 0x5e367000-0x5ffcffff]262worker1 # [ 0.000000] APIC: Static calls initialized263worker1 # [ 0.000000] SMBIOS 2.8 present.264worker2 # [ 0.002932] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]265lb # [ 0.002908] ACPI: Early table checksum verification disabled266client # [ 0.002891] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)267lb # [ 0.002911] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )268worker2 # [ 0.002932] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]269worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014270client # [ 0.002892] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]271worker1 # [ 0.000000] DMI: Memory slots populated: 1/1272worker2 # [ 0.002933] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]273lb # [ 0.002915] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)274worker2 # [ 0.003159] No NUMA configuration found275worker1 # [ 0.000000] Hypervisor detected: KVM276client # [ 0.002893] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]277lb # [ 0.002919] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)278worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000279worker2 # [ 0.003160] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]280client # [ 0.002894] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]281worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00282worker2 # [ 0.003162] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]283lb # [ 0.002926] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)284client # [ 0.002894] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]285worker2 # [ 0.005473] Zone ranges:286worker1 # [ 0.000001] kvm-clock: using sched offset of 497813881 cycles287lb # [ 0.002928] ACPI: FACS 0x000000005FFE0000 000040288worker2 # [ 0.005474] DMA [mem 0x0000000000001000-0x0000000000ffffff]289client # [ 0.002895] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]290lb # [ 0.002929] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)291worker2 # [ 0.005476] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]292client # [ 0.002895] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]293worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns294worker2 # [ 0.005477] Normal empty295worker2 # [ 0.005478] Device empty296worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor297lb # [ 0.002931] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)298client # [ 0.002896] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]299worker2 # [ 0.005478] Movable zone start for each node300client # [ 0.003115] No NUMA configuration found301worker1 # [ 0.000815] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000302worker2 # [ 0.005479] Early memory node ranges303lb # [ 0.002932] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)304client # [ 0.003116] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]305worker2 # [ 0.005479] node 0: [mem 0x0000000000001000-0x000000000009efff]306worker1 # [ 0.000843] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs307lb # [ 0.002934] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)308client # [ 0.003118] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]309worker2 # [ 0.005480] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]310worker1 # [ 0.000845] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT311client # [ 0.005783] Zone ranges:312lb # [ 0.002935] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]313worker2 # [ 0.005481] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]314worker1 # [ 0.002754] found SMP MP-table at [mem 0x000f5450-0x000f545f]315client # [ 0.005784] DMA [mem 0x0000000000001000-0x0000000000ffffff]316worker2 # [ 0.005501] On node 0, zone DMA: 1 pages in unavailable ranges317worker1 # [ 0.002766] Using GB pages for direct mapping318lb # [ 0.002936] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]319client # [ 0.005786] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]320worker1 # [ 0.002912] RAMDISK: [mem 0x5e367000-0x5ffcffff]321client # [ 0.005787] Normal empty322worker2 # [ 0.005767] On node 0, zone DMA: 97 pages in unavailable ranges323lb # [ 0.002937] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]324client # [ 0.005788] Device empty325worker1 # [ 0.002921] ACPI: Early table checksum verification disabled326worker2 # [ 0.032905] On node 0, zone DMA32: 40 pages in unavailable ranges327client # [ 0.005788] Movable zone start for each node328lb # [ 0.002937] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]329worker2 # [ 0.033362] ACPI: PM-Timer IO Port: 0x608330worker1 # [ 0.002924] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )331client # [ 0.005789] Early memory node ranges332worker2 # [ 0.033372] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])333lb # [ 0.002938] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]334client # [ 0.005790] node 0: [mem 0x0000000000001000-0x000000000009efff]335worker1 # [ 0.002929] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)336lb # [ 0.002938] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]337worker2 # [ 0.033398] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23338client # [ 0.005791] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]339worker1 # [ 0.002933] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)340worker2 # [ 0.033400] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)341lb # [ 0.002939] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]342client # [ 0.005792] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]343lb # [ 0.003199] No NUMA configuration found344worker2 # [ 0.033402] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)345client # [ 0.005815] On node 0, zone DMA: 1 pages in unavailable ranges346worker1 # [ 0.002942] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)347lb # [ 0.003200] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]348worker2 # [ 0.033403] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)349worker1 # [ 0.002944] ACPI: FACS 0x000000005FFE0000 000040350client # [ 0.006094] On node 0, zone DMA: 97 pages in unavailable ranges351lb # [ 0.003202] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]352lb # [ 0.005468] Zone ranges:353worker2 # [ 0.033404] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)354client # [ 0.033354] On node 0, zone DMA32: 40 pages in unavailable ranges355worker1 # [ 0.002945] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)356client # [ 0.033862] ACPI: PM-Timer IO Port: 0x608357lb # [ 0.005470] DMA [mem 0x0000000000001000-0x0000000000ffffff]358worker2 # [ 0.033405] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)359worker1 # [ 0.002947] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)360client # [ 0.033873] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])361lb # [ 0.005471] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]362worker2 # [ 0.033407] ACPI: Using ACPI (MADT) for SMP configuration information363lb # [ 0.005473] Normal empty364lb # [ 0.005473] Device empty365worker2 # [ 0.033408] ACPI: HPET id: 0x8086a201 base: 0xfed00000366client # [ 0.033900] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23367worker1 # [ 0.002948] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)368worker2 # [ 0.033411] TSC deadline timer available369lb # [ 0.005474] Movable zone start for each node370client # [ 0.033902] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)371lb # [ 0.005475] Early memory node ranges372worker2 # [ 0.033415] CPU topo: Max. logical packages: 1373worker1 # [ 0.002950] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)374worker2 # [ 0.033416] CPU topo: Max. logical dies: 1375lb # [ 0.005475] node 0: [mem 0x0000000000001000-0x000000000009efff]376client # [ 0.033904] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)377worker2 # [ 0.033416] CPU topo: Max. dies per package: 1378worker1 # [ 0.002951] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]379lb # [ 0.005476] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]380client # [ 0.033905] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)381worker2 # [ 0.033420] CPU topo: Max. threads per core: 1382worker1 # [ 0.002952] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]383lb # [ 0.005477] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]384client # [ 0.033906] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)385worker2 # [ 0.033420] CPU topo: Num. cores per package: 1386worker2 # [ 0.033421] CPU topo: Num. threads per package: 1387lb # [ 0.005497] On node 0, zone DMA: 1 pages in unavailable ranges388worker1 # [ 0.002953] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]389client # [ 0.033907] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)390worker2 # [ 0.033421] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs391lb # [ 0.005756] On node 0, zone DMA: 97 pages in unavailable ranges392worker1 # [ 0.002953] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]393client # [ 0.033910] ACPI: Using ACPI (MADT) for SMP configuration information394lb # [ 0.032832] On node 0, zone DMA32: 40 pages in unavailable ranges395worker2 # [ 0.033437] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()396client # [ 0.033910] ACPI: HPET id: 0x8086a201 base: 0xfed00000397worker1 # [ 0.002954] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]398lb # [ 0.033295] ACPI: PM-Timer IO Port: 0x608399client # [ 0.033914] TSC deadline timer available400worker2 # [ 0.033467] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]401lb # [ 0.033306] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])402worker1 # [ 0.002954] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]403client # [ 0.033918] CPU topo: Max. logical packages: 1404worker2 # [ 0.033468] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]405lb # [ 0.033332] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23406client # [ 0.033919] CPU topo: Max. logical dies: 1407worker1 # [ 0.002955] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]408worker2 # [ 0.033469] [mem 0x60000000-0xafffffff] available for PCI devices409client # [ 0.033919] CPU topo: Max. dies per package: 1410worker1 # [ 0.003220] No NUMA configuration found411lb # [ 0.033335] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)412worker2 # [ 0.033471] Booting paravirtualized kernel on KVM413client # [ 0.033923] CPU topo: Max. threads per core: 1414worker1 # [ 0.003221] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]415lb # [ 0.033337] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)416client # [ 0.033923] CPU topo: Num. cores per package: 1417worker1 # [ 0.003224] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]418client # [ 0.033923] CPU topo: Num. threads per package: 1419worker2 # [ 0.033473] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns420worker1 # [ 0.005931] Zone ranges:421lb # [ 0.033338] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)422client # [ 0.033924] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs423lb # [ 0.033339] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)424worker2 # [ 0.037929] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1425worker1 # [ 0.005932] DMA [mem 0x0000000000001000-0x0000000000ffffff]426lb # [ 0.033339] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)427client # [ 0.033941] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()428worker1 # [ 0.005934] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]429worker2 # [ 0.040147] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152430worker1 # [ 0.005935] Normal empty431worker2 # [ 0.040189] kvm-guest: PV spinlocks disabled, single CPU432worker1 # [ 0.005936] Device empty433client # [ 0.033972] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]434lb # [ 0.033342] ACPI: Using ACPI (MADT) for SMP configuration information435worker1 # [ 0.005936] Movable zone start for each node436lb # [ 0.033343] ACPI: HPET id: 0x8086a201 base: 0xfed00000437worker1 # [ 0.005937] Early memory node ranges438client # [ 0.033974] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]439lb # [ 0.033346] TSC deadline timer available440lb # [ 0.033350] CPU topo: Max. logical packages: 1441worker1 # [ 0.005937] node 0: [mem 0x0000000000001000-0x000000000009efff]442client # [ 0.033975] [mem 0x60000000-0xafffffff] available for PCI devices443lb # [ 0.033351] CPU topo: Max. logical dies: 1444client # [ 0.033976] Booting paravirtualized kernel on KVM445worker1 # [ 0.005938] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]446lb # [ 0.033351] CPU topo: Max. dies per package: 1447lb # [ 0.033354] CPU topo: Max. threads per core: 1448worker1 # [ 0.005939] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]449client # [ 0.033979] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns450worker2 # [ 0.040190] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/bhr46xja1kyki42v8lp87l0nsrargk1l-nixos-system-worker2-test/init regInfo=/nix/store/iw1fwr9xgy9i67hbc5f1wjqv08csn4jl-closure-info/registration console=ttyS0,115200n8 console=tty0451lb # [ 0.033355] CPU topo: Num. cores per package: 1452worker1 # [ 0.005960] On node 0, zone DMA: 1 pages in unavailable ranges453lb # [ 0.033355] CPU topo: Num. threads per package: 1454client # [ 0.038451] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1455worker1 # [ 0.006245] On node 0, zone DMA: 97 pages in unavailable ranges456lb # [ 0.033355] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs457client # [ 0.040792] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152458worker2 # [ 0.040279] Unknown kernel command line parameters "regInfo=/nix/store/iw1fwr9xgy9i67hbc5f1wjqv08csn4jl-closure-info/registration", will be passed to user space.459worker1 # [ 0.035225] On node 0, zone DMA32: 40 pages in unavailable ranges460worker2 # [ 0.040293] random: crng init done461lb # [ 0.033373] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()462client # [ 0.040836] kvm-guest: PV spinlocks disabled, single CPU463worker1 # [ 0.035758] ACPI: PM-Timer IO Port: 0x608464worker2 # [ 0.040293] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes465lb # [ 0.033405] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]466worker1 # [ 0.035774] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])467worker2 # [ 0.042463] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)468worker1 # [ 0.035805] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23469lb # [ 0.033406] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]470worker1 # [ 0.035808] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)471worker2 # [ 0.043819] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)472lb # [ 0.033408] [mem 0x60000000-0xafffffff] available for PCI devices473worker2 # [ 0.043851] Fallback order for Node 0: 0474lb # [ 0.033409] Booting paravirtualized kernel on KVM475worker1 # [ 0.035810] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)476worker2 # [ 0.043854] Built 1 zonelists, mobility grouping on. Total pages: 393078477client # [ 0.040838] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4mswv1w7crl5njwzp9d41jjig5l256xq-nixos-system-client-test/init regInfo=/nix/store/blpxkzm53swxlxffz2dn2ks4cp5hilgc-closure-info/registration console=ttyS0,115200n8 console=tty0478worker1 # [ 0.035811] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)479worker2 # [ 0.043855] Policy zone: DMA32480lb # [ 0.033411] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns481worker2 # [ 0.046443] mem auto-init: stack:all(zero), heap alloc:on, heap free:off482worker1 # [ 0.035812] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)483lb # [ 0.037878] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1484worker2 # [ 0.049527] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1485client # [ 0.040934] Unknown kernel command line parameters "regInfo=/nix/store/blpxkzm53swxlxffz2dn2ks4cp5hilgc-closure-info/registration", will be passed to user space.486worker1 # [ 0.035813] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)487lb # [ 0.040107] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152488client # [ 0.040947] random: crng init done489worker2 # [ 0.052888] allocated 3145728 bytes of page_ext490worker1 # [ 0.035816] ACPI: Using ACPI (MADT) for SMP configuration information491lb # [ 0.040152] kvm-guest: PV spinlocks disabled, single CPU492worker2 # [ 0.062766] ftrace: allocating 48731 entries in 192 pages493client # [ 0.040948] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes494worker1 # [ 0.035817] ACPI: HPET id: 0x8086a201 base: 0xfed00000495worker2 # [ 0.062768] ftrace: allocated 192 pages with 2 groups496worker1 # [ 0.035822] TSC deadline timer available497worker2 # [ 0.063634] Dynamic Preempt: lazy498client # [ 0.043109] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)499worker1 # [ 0.035827] CPU topo: Max. logical packages: 1500worker2 # [ 0.063796] rcu: Preemptible hierarchical RCU implementation.501worker1 # [ 0.035828] CPU topo: Max. logical dies: 1502client # [ 0.044217] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)503worker2 # [ 0.063797] rcu: RCU event tracing is enabled.504worker1 # [ 0.035828] CPU topo: Max. dies per package: 1505client # [ 0.044250] Fallback order for Node 0: 0506worker2 # [ 0.063798] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.507worker1 # [ 0.035832] CPU topo: Max. threads per core: 1508lb # [ 0.040154] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/0qln5mjy767qjp5wbmxjg8jay8k05dsm-nixos-system-lb-test/init regInfo=/nix/store/nwvvzfrgncwhnws6wdjigc6jviavrdxi-closure-info/registration console=ttyS0,115200n8 console=tty0509client # [ 0.044253] Built 1 zonelists, mobility grouping on. Total pages: 393078510worker2 # [ 0.063799] Trampoline variant of Tasks RCU enabled.511worker1 # [ 0.035833] CPU topo: Num. cores per package: 1512client # [ 0.044254] Policy zone: DMA32513worker2 # [ 0.063799] Rude variant of Tasks RCU enabled.514worker1 # [ 0.035833] CPU topo: Num. threads per package: 1515worker2 # [ 0.063800] Tracing variant of Tasks RCU enabled.516client # [ 0.047427] mem auto-init: stack:all(zero), heap alloc:on, heap free:off517lb # [ 0.040246] Unknown kernel command line parameters "regInfo=/nix/store/nwvvzfrgncwhnws6wdjigc6jviavrdxi-closure-info/registration", will be passed to user space.518worker1 # [ 0.035833] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs519client # [ 0.050673] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1520worker2 # [ 0.063800] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.521lb # [ 0.040259] random: crng init done522client # [ 0.054066] allocated 3145728 bytes of page_ext523worker1 # [ 0.035859] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()524worker2 # [ 0.063801] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1525lb # [ 0.040260] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes526client # [ 0.064046] ftrace: allocating 48731 entries in 192 pages527worker1 # [ 0.035899] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]528lb # [ 0.042404] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)529worker2 # [ 0.063869] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.530client # [ 0.064048] ftrace: allocated 192 pages with 2 groups531client # [ 0.064920] Dynamic Preempt: lazy532worker1 # [ 0.035900] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]533lb # [ 0.043742] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)534client # [ 0.065096] rcu: Preemptible hierarchical RCU implementation.535worker2 # [ 0.063870] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.536worker1 # [ 0.035902] [mem 0x60000000-0xafffffff] available for PCI devices537lb # [ 0.043775] Fallback order for Node 0: 0538client # [ 0.065097] rcu: RCU event tracing is enabled.539worker1 # [ 0.035904] Booting paravirtualized kernel on KVM540lb # [ 0.043777] Built 1 zonelists, mobility grouping on. Total pages: 393078541worker2 # [ 0.063871] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.542lb # [ 0.043779] Policy zone: DMA32543client # [ 0.065097] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.544worker2 # [ 0.068480] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16545client # [ 0.065098] Trampoline variant of Tasks RCU enabled.546worker1 # [ 0.035908] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns547lb # [ 0.046307] mem auto-init: stack:all(zero), heap alloc:on, heap free:off548worker2 # [ 0.068761] rcu: srcu_init: Setting srcu_struct sizes based on contention.549client # [ 0.065099] Rude variant of Tasks RCU enabled.550lb # [ 0.049444] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1551worker1 # [ 0.040399] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1552client # [ 0.065099] Tracing variant of Tasks RCU enabled.553lb # [ 0.052759] allocated 3145728 bytes of page_ext554worker2 # [ 0.068768] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns555worker1 # [ 0.042721] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152556client # [ 0.065100] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.557lb # [ 0.062744] ftrace: allocating 48731 entries in 192 pages558worker1 # [ 0.042766] kvm-guest: PV spinlocks disabled, single CPU559lb # [ 0.062747] ftrace: allocated 192 pages with 2 groups560worker2 # [ 0.068877] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)561client # [ 0.065101] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1562lb # [ 0.063635] Dynamic Preempt: lazy563worker2 # [ 0.072340] Console: colour VGA+ 80x25564lb # [ 0.063773] rcu: Preemptible hierarchical RCU implementation.565worker2 # [ 0.072343] printk: legacy console [tty0] enabled566client # [ 0.065117] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.567lb # [ 0.063773] rcu: RCU event tracing is enabled.568worker2 # [ 0.101584] printk: legacy console [ttyS0] enabled569client # [ 0.065119] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.570worker2 # [ 0.197584] ACPI: Core revision 20250807571lb # [ 0.063774] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.572lb # [ 0.063775] Trampoline variant of Tasks RCU enabled.573client # [ 0.065120] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.574lb # [ 0.063776] Rude variant of Tasks RCU enabled.575worker1 # [ 0.042768] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ycsrgx65d5yfvzr743gfkyvj36s6578h-nixos-system-worker1-test/init regInfo=/nix/store/9kgibijjjb8lzklk71fyc6sa4ml0bv7g-closure-info/registration console=ttyS0,115200n8 console=tty0576worker2 # [ 0.198420] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns577lb # [ 0.063776] Tracing variant of Tasks RCU enabled.578client # [ 0.069538] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16579worker2 # [ 0.199909] APIC: Switch to symmetric I/O mode setup580lb # [ 0.063777] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.581client # [ 0.069816] rcu: srcu_init: Setting srcu_struct sizes based on contention.582worker1 # [ 0.042871] Unknown kernel command line parameters "regInfo=/nix/store/9kgibijjjb8lzklk71fyc6sa4ml0bv7g-closure-info/registration", will be passed to user space.583worker2 # [ 0.200833] x2apic enabled584lb # [ 0.063778] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1585worker1 # [ 0.042884] random: crng init done586client # [ 0.069823] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns587worker2 # [ 0.201558] APIC: Switched APIC routing to: physical x2apic588lb # [ 0.063829] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.589worker1 # [ 0.042885] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes590client # [ 0.069929] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)591worker1 # [ 0.045171] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)592lb # [ 0.063831] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.593client # [ 0.073727] Console: colour VGA+ 80x25594worker2 # [ 0.203318] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1595client # [ 0.073730] printk: legacy console [tty0] enabled596worker1 # [ 0.046302] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)597lb # [ 0.063832] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.598client # [ 0.104312] printk: legacy console [ttyS0] enabled599worker1 # [ 0.046340] Fallback order for Node 0: 0600lb # [ 0.068445] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16601client # [ 0.204592] ACPI: Core revision 20250807602worker1 # [ 0.046343] Built 1 zonelists, mobility grouping on. Total pages: 393078603worker2 # [ 0.204267] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns604worker1 # [ 0.046344] Policy zone: DMA32605lb # [ 0.068732] rcu: srcu_init: Setting srcu_struct sizes based on contention.606worker1 # [ 0.049350] mem auto-init: stack:all(zero), heap alloc:on, heap free:off607worker2 # [ 0.205849] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)608lb # [ 0.068740] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns609client # [ 0.205496] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns610worker1 # [ 0.052934] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1611worker2 # [ 0.207933] x86/cpu: User Mode Instruction Prevention (UMIP) activated612client # [ 0.207091] APIC: Switch to symmetric I/O mode setup613worker1 # [ 0.056566] allocated 3145728 bytes of page_ext614lb # [ 0.068846] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)615client # [ 0.208071] x2apic enabled616worker1 # [ 0.067099] ftrace: allocating 48731 entries in 192 pages617lb # [ 0.072394] Console: colour VGA+ 80x25618worker2 # [ 0.209012] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127619lb # [ 0.072398] printk: legacy console [tty0] enabled620worker1 # [ 0.067101] ftrace: allocated 192 pages with 2 groups621lb # [ 0.101821] printk: legacy console [ttyS0] enabled622worker1 # [ 0.068001] Dynamic Preempt: lazy623client # [ 0.208847] APIC: Switched APIC routing to: physical x2apic624worker2 # [ 0.209847] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0625lb # [ 0.197330] ACPI: Core revision 20250807626worker1 # [ 0.068214] rcu: Preemptible hierarchical RCU implementation.627worker1 # [ 0.068215] rcu: RCU event tracing is enabled.628client # [ 0.210752] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1629worker1 # [ 0.068215] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.630worker2 # [ 0.210850] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto631lb # [ 0.198233] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns632worker1 # [ 0.068217] Trampoline variant of Tasks RCU enabled.633lb # [ 0.199722] APIC: Switch to symmetric I/O mode setup634worker2 # [ 0.211848] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl635worker1 # [ 0.068218] Rude variant of Tasks RCU enabled.636client # [ 0.211752] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns637lb # [ 0.200665] x2apic enabled638worker1 # [ 0.068218] Tracing variant of Tasks RCU enabled.639worker2 # [ 0.212847] Transient Scheduler Attacks: Vulnerable: No microcode640worker1 # [ 0.068219] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.641lb # [ 0.201446] APIC: Switched APIC routing to: physical x2apic642client # [ 0.213422] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)643worker2 # [ 0.213847] Spectre V2 : Mitigation: Enhanced / Automatic IBRS644worker1 # [ 0.068219] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1645worker2 # [ 0.214847] Speculative Return Stack Overflow: Mitigation: Safe RET646client # [ 0.214512] x86/cpu: User Mode Instruction Prevention (UMIP) activated647worker1 # [ 0.068235] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.648lb # [ 0.203223] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1649client # [ 0.216348] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127650worker1 # [ 0.068237] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.651client # [ 0.217371] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0652lb # [ 0.204232] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns653worker1 # [ 0.068238] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.654lb # [ 0.205842] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)655worker2 # [ 0.215846] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization656worker1 # [ 0.072644] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16657client # [ 0.218197] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto658worker2 # [ 0.217854] Spectre V2 : Enabling IBPB for BPF659worker1 # [ 0.072939] rcu: srcu_init: Setting srcu_struct sizes based on contention.660lb # [ 0.206926] x86/cpu: User Mode Instruction Prevention (UMIP) activated661client # [ 0.219419] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl662worker1 # [ 0.072946] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns663worker2 # [ 0.218553] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier664lb # [ 0.207972] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127665client # [ 0.221419] Transient Scheduler Attacks: Vulnerable: No microcode666worker2 # [ 0.219847] active return thunk: srso_alias_return_thunk667lb # [ 0.208840] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0668worker1 # [ 0.073059] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)669client # [ 0.222419] Spectre V2 : Mitigation: Enhanced / Automatic IBRS670worker1 # [ 0.076950] Console: colour VGA+ 80x25671worker2 # [ 0.220688] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'672worker1 # [ 0.076953] printk: legacy console [tty0] enabled673client # [ 0.223419] Speculative Return Stack Overflow: Mitigation: Safe RET674lb # [ 0.209843] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto675worker1 # [ 0.107755] printk: legacy console [ttyS0] enabled676worker2 # [ 0.221847] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'677worker1 # [ 0.208201] ACPI: Core revision 20250807678lb # [ 0.210839] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl679worker2 # [ 0.222846] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'680lb # [ 0.211839] Transient Scheduler Attacks: Vulnerable: No microcode681worker2 # [ 0.223846] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'682worker1 # [ 0.209133] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns683lb # [ 0.212839] Spectre V2 : Mitigation: Enhanced / Automatic IBRS684worker2 # [ 0.224846] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'685worker1 # [ 0.210764] APIC: Switch to symmetric I/O mode setup686client # [ 0.224419] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization687lb # [ 0.213839] Speculative Return Stack Overflow: Mitigation: Safe RET688worker1 # [ 0.211746] x2apic enabled689worker2 # [ 0.225846] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'690client # [ 0.226428] Spectre V2 : Enabling IBPB for BPF691worker1 # [ 0.212553] APIC: Switched APIC routing to: physical x2apic692worker2 # [ 0.226847] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'693client # [ 0.227420] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier694worker2 # [ 0.227847] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256695client # [ 0.228420] active return thunk: srso_alias_return_thunk696worker1 # [ 0.214505] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1697worker2 # [ 0.228846] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64698lb # [ 0.214839] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization699client # [ 0.229449] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'700worker2 # [ 0.229846] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512701lb # [ 0.216847] Spectre V2 : Enabling IBPB for BPF702worker1 # [ 0.215530] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns703client # [ 0.230419] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'704worker2 # [ 0.230846] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024705lb # [ 0.217558] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier706worker2 # [ 0.231846] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8707client # [ 0.231419] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'708worker1 # [ 0.217228] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)709lb # [ 0.218839] active return thunk: srso_alias_return_thunk710client # [ 0.232419] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'711worker1 # [ 0.218316] x86/cpu: User Mode Instruction Prevention (UMIP) activated712worker2 # [ 0.232846] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.713lb # [ 0.219861] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'714client # [ 0.234189] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'715worker1 # [ 0.220385] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127716lb # [ 0.220839] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'717client # [ 0.235197] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'718worker1 # [ 0.221226] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0719lb # [ 0.221839] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'720client # [ 0.236233] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'721lb # [ 0.222839] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'722worker1 # [ 0.222229] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto723client # [ 0.237419] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256724lb # [ 0.223839] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'725client # [ 0.238419] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64726lb # [ 0.224839] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'727worker1 # [ 0.223225] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl728client # [ 0.239419] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512729worker1 # [ 0.224226] Transient Scheduler Attacks: Vulnerable: No microcode730lb # [ 0.225839] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'731client # [ 0.240419] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024732lb # [ 0.226840] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256733worker1 # [ 0.225225] Spectre V2 : Mitigation: Enhanced / Automatic IBRS734client # [ 0.241419] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8735lb # [ 0.227839] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64736worker1 # [ 0.226225] Speculative Return Stack Overflow: Mitigation: Safe RET737lb # [ 0.228839] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512738client # [ 0.242420] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.739lb # [ 0.229839] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024740lb # [ 0.230839] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8741worker1 # [ 0.227225] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization742lb # [ 0.231839] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.743worker1 # [ 0.229233] Spectre V2 : Enabling IBPB for BPF744worker1 # [ 0.230226] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier745worker1 # [ 0.231226] active return thunk: srso_alias_return_thunk746worker1 # [ 0.232944] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'747worker1 # [ 0.234225] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'748worker1 # [ 0.235225] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'749worker1 # [ 0.236225] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'750worker1 # [ 0.237225] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'751worker1 # [ 0.238225] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'752worker1 # [ 0.239225] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'753worker1 # [ 0.240225] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256754worker1 # [ 0.242225] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64755worker1 # [ 0.243225] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512756worker1 # [ 0.244225] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024757worker1 # [ 0.245225] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8758worker1 # [ 0.246225] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.759worker2 # [ 0.267426] Freeing SMP alternatives memory: 44K760worker2 # [ 0.267849] pid_max: default: 32768 minimum: 301761worker2 # [ 0.268933] LSM: initializing lsm=capability,landlock,yama,bpf,ima762worker2 # [ 0.269955] landlock: Up and running.763worker2 # [ 0.270847] Yama: becoming mindful.764worker2 # [ 0.271658] LSM support for eBPF active765worker2 # [ 0.272424] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)766worker2 # [ 0.273851] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)767worker2 # [ 0.276128] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)768client # [ 0.277363] Freeing SMP alternatives memory: 44K769client # [ 0.277962] pid_max: default: 32768 minimum: 301770worker2 # [ 0.277408] Performance Events: Fam17h+ core perfctr, AMD PMU driver.771client # [ 0.278511] LSM: initializing lsm=capability,landlock,yama,bpf,ima772worker2 # [ 0.277855] ... version: 2773client # [ 0.279541] landlock: Up and running.774worker2 # [ 0.278599] ... bit width: 48775client # [ 0.280420] Yama: becoming mindful.776lb # [ 0.265994] Freeing SMP alternatives memory: 44K777worker2 # [ 0.278849] ... generic counters: 6778lb # [ 0.266760] pid_max: default: 32768 minimum: 301779client # [ 0.281486] LSM support for eBPF active780worker2 # [ 0.279529] ... generic bitmap: 000000000000003f781worker2 # [ 0.279849] ... fixed-purpose counters: 0782lb # [ 0.267461] LSM: initializing lsm=capability,landlock,yama,bpf,ima783client # [ 0.282228] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)784lb # [ 0.267951] landlock: Up and running.785worker2 # [ 0.280568] ... fixed-purpose bitmap: 0000000000000000786lb # [ 0.269291] Yama: becoming mindful.787client # [ 0.283283] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)788worker2 # [ 0.280849] ... value mask: 0000ffffffffffff789lb # [ 0.270052] LSM support for eBPF active790worker2 # [ 0.281741] ... max period: 00007fffffffffff791worker2 # [ 0.282514] ... global_ctrl mask: 000000000000003f792lb # [ 0.270895] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)793client # [ 0.285620] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)794worker2 # [ 0.282955] signal: max sigframe size: 3376795lb # [ 0.271877] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)796worker2 # [ 0.283724] rcu: Hierarchical SRCU implementation.797client # [ 0.286978] Performance Events: Fam17h+ core perfctr, AMD PMU driver.798worker2 # [ 0.284448] rcu: Max phase no-delay instances is 400.799client # [ 0.287428] ... version: 2800client # [ 0.288109] ... bit width: 48801lb # [ 0.274345] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)802client # [ 0.288421] ... generic counters: 6803client # [ 0.289121] ... generic bitmap: 000000000000003f804lb # [ 0.275404] Performance Events: Fam17h+ core perfctr, AMD PMU driver.805client # [ 0.289421] ... fixed-purpose counters: 0806lb # [ 0.275844] ... version: 2807client # [ 0.290101] ... fixed-purpose bitmap: 0000000000000000808lb # [ 0.276567] ... bit width: 48809client # [ 0.290421] ... value mask: 0000ffffffffffff810lb # [ 0.276842] ... generic counters: 6811worker2 # [ 0.289324] smp: Bringing up secondary CPUs ...812client # [ 0.291288] ... max period: 00007fffffffffff813lb # [ 0.277538] ... generic bitmap: 000000000000003f814worker2 # [ 0.289863] smp: Brought up 1 node, 1 CPU815client # [ 0.292072] ... global_ctrl mask: 000000000000003f816lb # [ 0.277853] ... fixed-purpose counters: 0817worker2 # [ 0.290546] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)818client # [ 0.292535] signal: max sigframe size: 3376819lb # [ 0.278541] ... fixed-purpose bitmap: 0000000000000000820client # [ 0.293292] rcu: Hierarchical SRCU implementation.821lb # [ 0.278842] ... value mask: 0000ffffffffffff822client # [ 0.293966] rcu: Max phase no-delay instances is 400.823lb # [ 0.279720] ... max period: 00007fffffffffff824worker2 # [ 0.291077] Memory: 1454592K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)825lb # [ 0.280514] ... global_ctrl mask: 000000000000003f826worker2 # [ 0.292086] devtmpfs: initialized827worker1 # [ 0.282082] Freeing SMP alternatives memory: 44K828lb # [ 0.280954] signal: max sigframe size: 3376829worker2 # [ 0.292893] x86/mm: Memory block size: 128MB830worker1 # [ 0.282775] pid_max: default: 32768 minimum: 301831lb # [ 0.281711] rcu: Hierarchical SRCU implementation.832lb # [ 0.282439] rcu: Max phase no-delay instances is 400.833worker1 # [ 0.283325] LSM: initializing lsm=capability,landlock,yama,bpf,ima834worker2 # [ 0.294622] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)835worker1 # [ 0.284336] landlock: Up and running.836worker1 # [ 0.285226] Yama: becoming mindful.837client # [ 0.299215] smp: Bringing up secondary CPUs ...838worker2 # [ 0.295765] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).839worker1 # [ 0.286381] LSM support for eBPF active840client # [ 0.299994] smp: Brought up 1 node, 1 CPU841worker2 # [ 0.296926] pinctrl core: initialized pinctrl subsystem842client # [ 0.300422] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)843worker1 # [ 0.287176] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)844worker2 # [ 0.298138] PM: RTC time: 12:42:38, date: 2026-09-20845worker1 # [ 0.288266] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)846lb # [ 0.287451] smp: Bringing up secondary CPUs ...847client # [ 0.301638] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)848lb # [ 0.287856] smp: Brought up 1 node, 1 CPU849client # [ 0.302648] devtmpfs: initialized850lb # [ 0.288544] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)851client # [ 0.303512] x86/mm: Memory block size: 128MB852worker1 # [ 0.290958] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)853worker2 # [ 0.301632] NET: Registered PF_NETLINK/PF_ROUTE protocol family854lb # [ 0.288966] Memory: 1454576K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109340K reserved, 0K cma-reserved)855worker1 # [ 0.291807] Performance Events: Fam17h+ core perfctr, AMD PMU driver.856worker2 # [ 0.303047] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations857lb # [ 0.290098] devtmpfs: initialized858client # [ 0.305392] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)859worker1 # [ 0.292230] ... version: 2860worker2 # [ 0.303876] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations861worker1 # [ 0.292946] ... bit width: 48862lb # [ 0.290984] x86/mm: Memory block size: 128MB863worker1 # [ 0.293228] ... generic counters: 6864client # [ 0.306347] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).865worker2 # [ 0.305139] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations866worker1 # [ 0.294003] ... generic bitmap: 000000000000003f867client # [ 0.307533] pinctrl core: initialized pinctrl subsystem868worker2 # [ 0.305858] audit: initializing netlink subsys (disabled)869worker1 # [ 0.294235] ... fixed-purpose counters: 0870lb # [ 0.292744] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)871client # [ 0.308735] PM: RTC time: 12:42:38, date: 2026-09-20872worker1 # [ 0.294983] ... fixed-purpose bitmap: 0000000000000000873worker2 # [ 0.306993] thermal_sys: Registered thermal governor 'fair_share'874lb # [ 0.293880] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).875worker1 # [ 0.295227] ... value mask: 0000ffffffffffff876worker2 # [ 0.306995] thermal_sys: Registered thermal governor 'bang_bang'877lb # [ 0.294931] pinctrl core: initialized pinctrl subsystem878worker1 # [ 0.296179] ... max period: 00007fffffffffff879worker2 # [ 0.307850] thermal_sys: Registered thermal governor 'step_wise'880lb # [ 0.296122] PM: RTC time: 12:42:38, date: 2026-09-20881worker1 # [ 0.296991] ... global_ctrl mask: 000000000000003f882worker2 # [ 0.308839] thermal_sys: Registered thermal governor 'user_space'883worker1 # [ 0.297332] signal: max sigframe size: 3376884client # [ 0.312580] NET: Registered PF_NETLINK/PF_ROUTE protocol family885worker2 # [ 0.309645] audit: type=2000 audit(1789908159.239:1): state=initialized audit_enabled=0 res=1886worker1 # [ 0.298238] rcu: Hierarchical SRCU implementation.887worker2 # [ 0.311861] thermal_sys: Registered thermal governor 'power_allocator'888client # [ 0.313952] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations889worker1 # [ 0.299093] rcu: Max phase no-delay instances is 400.890worker2 # [ 0.311885] cpuidle: using governor menu891lb # [ 0.299757] NET: Registered PF_NETLINK/PF_ROUTE protocol family892client # [ 0.314448] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations893worker2 # [ 0.314082] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5894lb # [ 0.301114] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations895client # [ 0.315705] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations896client # [ 0.316432] audit: initializing netlink subsys (disabled)897worker2 # [ 0.315079] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]898lb # [ 0.301863] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations899worker2 # [ 0.315852] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry900client # [ 0.317574] thermal_sys: Registered thermal governor 'fair_share'901worker1 # [ 0.304587] smp: Bringing up secondary CPUs ...902lb # [ 0.303122] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations903worker2 # [ 0.316861] PCI: Using configuration type 1 for base access904client # [ 0.317576] thermal_sys: Registered thermal governor 'bang_bang'905worker1 # [ 0.305242] smp: Brought up 1 node, 1 CPU906lb # [ 0.303852] audit: initializing netlink subsys (disabled)907client # [ 0.318423] thermal_sys: Registered thermal governor 'step_wise'908worker2 # [ 0.317900] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.909worker1 # [ 0.305961] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)910lb # [ 0.304958] thermal_sys: Registered thermal governor 'fair_share'911client # [ 0.319400] thermal_sys: Registered thermal governor 'user_space'912lb # [ 0.304961] thermal_sys: Registered thermal governor 'bang_bang'913client # [ 0.320172] audit: type=2000 audit(1789908159.244:1): state=initialized audit_enabled=0 res=1914lb # [ 0.305843] thermal_sys: Registered thermal governor 'step_wise'915worker1 # [ 0.306411] Memory: 1454560K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)916lb # [ 0.306767] thermal_sys: Registered thermal governor 'user_space'917client # [ 0.321425] thermal_sys: Registered thermal governor 'power_allocator'918worker1 # [ 0.307523] devtmpfs: initialized919client # [ 0.321449] cpuidle: using governor menu920worker1 # [ 0.308364] x86/mm: Memory block size: 128MB921lb # [ 0.307525] audit: type=2000 audit(1789908159.250:1): state=initialized audit_enabled=0 res=1922worker2 # [ 0.323131] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages923client # [ 0.323702] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5924lb # [ 0.308845] thermal_sys: Registered thermal governor 'power_allocator'925lb # [ 0.308859] cpuidle: using governor menu926worker2 # [ 0.323850] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page927worker1 # [ 0.310304] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)928client # [ 0.324671] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]929lb # [ 0.311080] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5930client # [ 0.325424] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry931worker1 # [ 0.311253] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).932client # [ 0.326435] PCI: Using configuration type 1 for base access933worker1 # [ 0.312307] pinctrl core: initialized pinctrl subsystem934lb # [ 0.312063] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]935lb # [ 0.312845] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry936worker1 # [ 0.313520] PM: RTC time: 12:42:38, date: 2026-09-20937client # [ 0.327601] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.938worker2 # [ 0.328850] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages939lb # [ 0.313855] PCI: Using configuration type 1 for base access940worker2 # [ 0.329849] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page941lb # [ 0.314953] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.942worker1 # [ 0.317070] NET: Registered PF_NETLINK/PF_ROUTE protocol family943worker1 # [ 0.318568] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations944client # [ 0.332650] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages945client # [ 0.333423] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page946worker1 # [ 0.319253] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations947worker1 # [ 0.320517] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations948worker1 # [ 0.321239] audit: initializing netlink subsys (disabled)949lb # [ 0.322082] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages950worker1 # [ 0.322398] thermal_sys: Registered thermal governor 'fair_share'951lb # [ 0.322843] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page952worker1 # [ 0.322400] thermal_sys: Registered thermal governor 'bang_bang'953worker2 # [ 0.340198] ACPI: Added _OSI(Module Device)954client # [ 0.338423] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages955worker2 # [ 0.340851] ACPI: Added _OSI(Processor Device)956worker1 # [ 0.323228] thermal_sys: Registered thermal governor 'step_wise'957client # [ 0.339422] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page958worker2 # [ 0.341579] ACPI: Added _OSI(Processor Aggregator Device)959worker1 # [ 0.324230] audit: type=2000 audit(1789908159.265:1): state=initialized audit_enabled=0 res=1960worker1 # [ 0.326231] thermal_sys: Registered thermal governor 'user_space'961lb # [ 0.327843] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages962worker1 # [ 0.326232] thermal_sys: Registered thermal governor 'power_allocator'963lb # [ 0.328842] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page964worker1 # [ 0.327243] cpuidle: using governor menu965worker1 # [ 0.329466] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5966worker1 # [ 0.330483] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]967worker1 # [ 0.331231] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry968worker1 # [ 0.332240] PCI: Using configuration type 1 for base access969worker2 # [ 0.349978] ACPI: 1 ACPI AML tables successfully acquired and loaded970client # [ 0.349841] ACPI: Added _OSI(Module Device)971client # [ 0.350424] ACPI: Added _OSI(Processor Device)972worker1 # [ 0.333393] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.973client # [ 0.351188] ACPI: Added _OSI(Processor Aggregator Device)974lb # [ 0.337500] ACPI: Added _OSI(Module Device)975lb # [ 0.337844] ACPI: Added _OSI(Processor Device)976worker2 # [ 0.354255] ACPI: Interpreter enabled977lb # [ 0.338618] ACPI: Added _OSI(Processor Aggregator Device)978worker2 # [ 0.354864] ACPI: PM: (supports S0 S3 S4 S5)979worker2 # [ 0.355596] ACPI: Using IOAPIC for interrupt routing980worker1 # [ 0.340417] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages981worker2 # [ 0.357923] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug982worker1 # [ 0.341229] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page983worker2 # [ 0.358850] PCI: Using E820 reservations for host bridge windows984client # [ 0.360035] ACPI: 1 ACPI AML tables successfully acquired and loaded985lb # [ 0.345374] ACPI: 1 ACPI AML tables successfully acquired and loaded986worker2 # [ 0.361967] ACPI: Enabled 2 GPEs in block 00 to 3F987worker1 # [ 0.346229] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages988lb # [ 0.348766] ACPI: Interpreter enabled989client # [ 0.363841] ACPI: Interpreter enabled990worker1 # [ 0.347228] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page991lb # [ 0.349310] ACPI: PM: (supports S0 S3 S4 S5)992client # [ 0.364438] ACPI: PM: (supports S0 S3 S4 S5)993lb # [ 0.349843] ACPI: Using IOAPIC for interrupt routing994client # [ 0.365142] ACPI: Using IOAPIC for interrupt routing995lb # [ 0.350763] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug996client # [ 0.365467] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug997client # [ 0.366422] PCI: Using E820 reservations for host bridge windows998worker2 # [ 0.369405] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])999worker2 # [ 0.369855] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1000client # [ 0.369496] ACPI: Enabled 2 GPEs in block 00 to 3F1001worker2 # [ 0.370929] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1002lb # [ 0.355842] PCI: Using E820 reservations for host bridge windows1003lb # [ 0.356940] ACPI: Enabled 2 GPEs in block 00 to 3F1004worker2 # [ 0.371972] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1005worker2 # [ 0.373209] PCI host bridge to bus 0000:001006worker1 # [ 0.357661] ACPI: Added _OSI(Module Device)1007worker2 # [ 0.373854] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1008worker1 # [ 0.358229] ACPI: Added _OSI(Processor Device)1009worker1 # [ 0.358996] ACPI: Added _OSI(Processor Aggregator Device)1010worker2 # [ 0.374850] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1011worker2 # [ 0.375849] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1012worker2 # [ 0.376849] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1013client # [ 0.378128] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1014worker2 # [ 0.377854] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1015client # [ 0.378428] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1016worker2 # [ 0.378849] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1017lb # [ 0.365545] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1018worker2 # [ 0.379873] pci_bus 0000:00: root bus resource [bus 00-ff]1019client # [ 0.380299] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1020lb # [ 0.366455] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1021worker2 # [ 0.380861] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1022worker1 # [ 0.365783] ACPI: 1 ACPI AML tables successfully acquired and loaded1023client # [ 0.381421] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1024lb # [ 0.366919] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1025client # [ 0.382760] PCI host bridge to bus 0000:001026worker2 # [ 0.382309] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1027lb # [ 0.367964] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1028client # [ 0.383426] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1029lb # [ 0.369212] PCI host bridge to bus 0000:001030client # [ 0.384422] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1031worker1 # [ 0.369632] ACPI: Interpreter enabled1032lb # [ 0.369847] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1033worker1 # [ 0.370245] ACPI: PM: (supports S0 S3 S4 S5)1034client # [ 0.385422] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1035lb # [ 0.370843] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1036worker1 # [ 0.370987] ACPI: Using IOAPIC for interrupt routing1037client # [ 0.386421] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1038lb # [ 0.371842] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1039client # [ 0.387422] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1040lb # [ 0.372842] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1041client # [ 0.388422] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1042lb # [ 0.373842] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1043worker1 # [ 0.373303] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1044client # [ 0.389422] pci_bus 0000:00: root bus resource [bus 00-ff]1045worker1 # [ 0.374229] PCI: Using E820 reservations for host bridge windows1046lb # [ 0.374842] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1047worker2 # [ 0.384938] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1048client # [ 0.390459] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1049lb # [ 0.375842] pci_bus 0000:00: root bus resource [bus 00-ff]1050worker2 # [ 0.385862] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1051client # [ 0.391906] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1052lb # [ 0.376843] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1053worker2 # [ 0.386849] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1054worker1 # [ 0.377375] ACPI: Enabled 2 GPEs in block 00 to 3F1055lb # [ 0.378277] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1056worker2 # [ 0.388020] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1057worker2 # [ 0.389554] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1058worker2 # [ 0.391868] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1059worker2 # [ 0.392744] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1060worker1 # [ 0.384686] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1061worker2 # [ 0.393600] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1062client # [ 0.394536] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1063worker1 # [ 0.385234] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1064worker2 # [ 0.393855] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1065client # [ 0.395435] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1066worker1 # [ 0.386317] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1067client # [ 0.396399] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1068lb # [ 0.380985] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1069worker2 # [ 0.395649] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1070worker1 # [ 0.387354] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1071lb # [ 0.381855] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1072client # [ 0.397761] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1073worker1 # [ 0.388599] PCI host bridge to bus 0000:001074lb # [ 0.382872] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1075worker1 # [ 0.389232] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1076worker2 # [ 0.397859] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1077lb # [ 0.384019] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1078client # [ 0.399177] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1079worker2 # [ 0.398671] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1080worker1 # [ 0.390228] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1081worker2 # [ 0.399547] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1082worker1 # [ 0.391228] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1083lb # [ 0.385586] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1084worker1 # [ 0.392227] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1085worker2 # [ 0.400417] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1086client # [ 0.401431] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1087worker1 # [ 0.393228] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1088client # [ 0.402294] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1089lb # [ 0.388876] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1090worker1 # [ 0.394228] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1091client # [ 0.403176] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1092lb # [ 0.389730] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1093worker1 # [ 0.395228] pci_bus 0000:00: root bus resource [bus 00-ff]1094client # [ 0.404240] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1095worker2 # [ 0.402857] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1096lb # [ 0.390613] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1097worker1 # [ 0.396279] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1098worker2 # [ 0.403857] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1099lb # [ 0.391666] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1100client # [ 0.406007] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1101worker2 # [ 0.404812] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1102worker1 # [ 0.397772] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1103lb # [ 0.393318] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1104client # [ 0.407429] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1105worker2 # [ 0.406237] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1106client # [ 0.408264] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1107client # [ 0.409198] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1108worker2 # [ 0.407859] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1109lb # [ 0.394873] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1110worker2 # [ 0.408674] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1111lb # [ 0.395714] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1112client # [ 0.410821] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1113worker2 # [ 0.409582] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1114lb # [ 0.396596] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1115lb # [ 0.398282] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1116worker2 # [ 0.410402] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1117client # [ 0.413429] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1118client # [ 0.414311] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1119worker1 # [ 0.400315] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1120worker2 # [ 0.411868] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1121worker1 # [ 0.401242] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1122client # [ 0.415228] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1123worker2 # [ 0.412718] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1124lb # [ 0.400875] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1125worker1 # [ 0.402258] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1126worker2 # [ 0.413576] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1127lb # [ 0.401749] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1128client # [ 0.416871] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1129lb # [ 0.402542] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1130worker1 # [ 0.403414] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1131worker2 # [ 0.414438] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1132lb # [ 0.403410] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1133client # [ 0.418449] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1134worker1 # [ 0.405011] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1135client # [ 0.419334] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1136worker2 # [ 0.415858] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1137lb # [ 0.405832] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1138client # [ 0.420203] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1139worker2 # [ 0.416715] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1140lb # [ 0.406488] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1141worker2 # [ 0.417872] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1142worker1 # [ 0.408237] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1143client # [ 0.422010] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1144worker1 # [ 0.409221] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1145lb # [ 0.406863] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1146worker2 # [ 0.419399] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1147worker1 # [ 0.410249] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1148client # [ 0.423429] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1149lb # [ 0.408454] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1150worker1 # [ 0.411235] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1151worker2 # [ 0.420857] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1152client # [ 0.424293] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1153worker2 # [ 0.421694] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1154client # [ 0.425163] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1155lb # [ 0.409850] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1156worker2 # [ 0.422619] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1157worker1 # [ 0.412883] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1158lb # [ 0.410697] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1159worker2 # [ 0.422856] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1160client # [ 0.426936] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1161lb # [ 0.411586] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1162worker1 # [ 0.415260] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1163worker2 # [ 0.424471] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1164worker1 # [ 0.416169] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1165lb # [ 0.412589] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1166client # [ 0.428631] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1167worker1 # [ 0.417001] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1168worker2 # [ 0.425653] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1169client # [ 0.429429] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1170worker2 # [ 0.426594] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1171client # [ 0.430428] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1172lb # [ 0.415870] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1173worker1 # [ 0.418680] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1174worker2 # [ 0.427402] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1175lb # [ 0.416829] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1176client # [ 0.432026] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1177lb # [ 0.417682] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1178worker2 # [ 0.428875] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1179worker1 # [ 0.421235] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1180client # [ 0.433429] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1181worker2 # [ 0.429748] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1182worker1 # [ 0.422131] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1183client # [ 0.434328] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1184lb # [ 0.419440] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1185worker2 # [ 0.430592] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1186worker1 # [ 0.422979] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1187client # [ 0.435184] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1188client # [ 0.436284] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1189worker2 # [ 0.431378] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1190worker1 # [ 0.423886] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1191lb # [ 0.421829] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1192client # [ 0.438017] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1193worker2 # [ 0.433856] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1194lb # [ 0.422579] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1195worker2 # [ 0.434733] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1196client # [ 0.439243] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1197lb # [ 0.422868] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1198worker2 # [ 0.435611] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1199client # [ 0.440156] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1200lb # [ 0.423849] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1201worker1 # [ 0.426235] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1202worker1 # [ 0.427884] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1203worker2 # [ 0.436419] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1204client # [ 0.440993] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1205lb # [ 0.425465] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1206worker1 # [ 0.428252] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1207worker2 # [ 0.437399] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1208client # [ 0.442441] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1209worker2 # [ 0.438065] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1210lb # [ 0.426856] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1211worker1 # [ 0.429845] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1212client # [ 0.443295] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1213lb # [ 0.427867] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1214client # [ 0.444146] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1215worker2 # [ 0.440062] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1216worker1 # [ 0.432188] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1217client # [ 0.445846] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1218worker1 # [ 0.432896] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1219lb # [ 0.429462] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1220worker1 # [ 0.433251] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1221client # [ 0.447432] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1222lb # [ 0.431712] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1223client # [ 0.448376] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1224worker1 # [ 0.435322] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1225lb # [ 0.432595] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1226client # [ 0.449223] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1227lb # [ 0.433692] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1228client # [ 0.450895] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1229worker1 # [ 0.438176] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1230lb # [ 0.435449] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1231worker1 # [ 0.438873] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1232client # [ 0.452161] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1233worker1 # [ 0.439252] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1234client # [ 0.452630] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1235worker1 # [ 0.440853] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1236worker2 # [ 0.441038] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1237client # [ 0.453978] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1238lb # [ 0.437977] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1239worker2 # [ 0.443412] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1240lb # [ 0.438850] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1241lb # [ 0.439867] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1242worker2 # [ 0.444274] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1243worker1 # [ 0.443237] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1244worker1 # [ 0.444889] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1245worker2 # [ 0.445412] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1246lb # [ 0.441523] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1247worker1 # [ 0.445252] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1248worker2 # [ 0.446085] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1249worker1 # [ 0.446234] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1250lb # [ 0.443758] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1251worker2 # [ 0.447346] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1252worker1 # [ 0.447839] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1253lb # [ 0.444817] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1254worker2 # [ 0.448102] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1255lb # [ 0.447003] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1256worker1 # [ 0.449241] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1257worker2 # [ 0.449731] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1258worker1 # [ 0.450239] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1259worker2 # [ 0.450519] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1260client # [ 0.454620] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1261worker2 # [ 0.451163] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1262worker1 # [ 0.451814] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1263client # [ 0.456991] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1264worker2 # [ 0.452428] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1265client # [ 0.457659] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1266worker1 # [ 0.455046] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1267client # [ 0.459085] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1268worker1 # [ 0.455860] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1269worker1 # [ 0.456252] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1270client # [ 0.460459] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1271worker2 # [ 0.456187] ACPI: PCI: Interrupt link LNKA configured for IRQ 101272worker2 # [ 0.456958] ACPI: PCI: Interrupt link LNKB configured for IRQ 101273worker1 # [ 0.457814] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1274client # [ 0.461750] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1275worker2 # [ 0.457951] ACPI: PCI: Interrupt link LNKC configured for IRQ 111276client # [ 0.462699] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1277worker2 # [ 0.458946] ACPI: PCI: Interrupt link LNKD configured for IRQ 111278worker2 # [ 0.459949] ACPI: PCI: Interrupt link LNKE configured for IRQ 101279worker1 # [ 0.460129] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1280client # [ 0.464294] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1281worker2 # [ 0.460947] ACPI: PCI: Interrupt link LNKF configured for IRQ 101282worker1 # [ 0.461235] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1283client # [ 0.465082] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1284worker2 # [ 0.461949] ACPI: PCI: Interrupt link LNKG configured for IRQ 111285lb # [ 0.448126] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1286worker1 # [ 0.462214] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1287worker2 # [ 0.462945] ACPI: PCI: Interrupt link LNKH configured for IRQ 111288client # [ 0.465771] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1289worker2 # [ 0.463886] ACPI: PCI: Interrupt link GSIA configured for IRQ 161290lb # [ 0.450870] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1291worker1 # [ 0.463696] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1292client # [ 0.466990] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1293worker2 # [ 0.464815] ACPI: PCI: Interrupt link GSIB configured for IRQ 171294lb # [ 0.452039] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1295worker1 # [ 0.465109] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1296worker2 # [ 0.465551] ACPI: PCI: Interrupt link GSIC configured for IRQ 181297worker2 # [ 0.465864] ACPI: PCI: Interrupt link GSID configured for IRQ 191298worker1 # [ 0.466096] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1299lb # [ 0.453848] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1300worker2 # [ 0.466862] ACPI: PCI: Interrupt link GSIE configured for IRQ 201301client # [ 0.470597] ACPI: PCI: Interrupt link LNKA configured for IRQ 101302worker2 # [ 0.467830] ACPI: PCI: Interrupt link GSIF configured for IRQ 211303lb # [ 0.454997] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1304worker1 # [ 0.468019] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1305client # [ 0.471532] ACPI: PCI: Interrupt link LNKB configured for IRQ 101306worker2 # [ 0.468553] ACPI: PCI: Interrupt link GSIG configured for IRQ 221307lb # [ 0.456139] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1308client # [ 0.472527] ACPI: PCI: Interrupt link LNKC configured for IRQ 111309worker2 # [ 0.468862] ACPI: PCI: Interrupt link GSIH configured for IRQ 231310client # [ 0.473520] ACPI: PCI: Interrupt link LNKD configured for IRQ 111311lb # [ 0.457128] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1312worker2 # [ 0.470925] iommu: Default domain type: Translated1313client # [ 0.474526] ACPI: PCI: Interrupt link LNKE configured for IRQ 101314worker2 # [ 0.471724] iommu: DMA domain TLB invalidation policy: lazy mode1315client # [ 0.475522] ACPI: PCI: Interrupt link LNKF configured for IRQ 101316worker2 # [ 0.472889] ACPI: bus type USB registered1317lb # [ 0.459800] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1318client # [ 0.476532] ACPI: PCI: Interrupt link LNKG configured for IRQ 111319worker2 # [ 0.473629] usbcore: registered new interface driver usbfs1320lb # [ 0.460506] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1321client # [ 0.477526] ACPI: PCI: Interrupt link LNKH configured for IRQ 111322worker2 # [ 0.473864] usbcore: registered new interface driver hub1323client # [ 0.478461] ACPI: PCI: Interrupt link GSIA configured for IRQ 161324worker2 # [ 0.474768] usbcore: registered new device driver usb1325lb # [ 0.461172] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1326client # [ 0.479435] ACPI: PCI: Interrupt link GSIB configured for IRQ 171327worker2 # [ 0.476337] NetLabel: Initializing1328client # [ 0.480425] ACPI: PCI: Interrupt link GSIC configured for IRQ 181329lb # [ 0.462618] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1330worker2 # [ 0.476850] NetLabel: domain hash size = 1281331client # [ 0.481415] ACPI: PCI: Interrupt link GSID configured for IRQ 191332worker2 # [ 0.477616] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1333client # [ 0.482191] ACPI: PCI: Interrupt link GSIE configured for IRQ 201334worker2 # [ 0.477880] NetLabel: unlabeled traffic allowed by default1335client # [ 0.482435] ACPI: PCI: Interrupt link GSIF configured for IRQ 211336worker2 # [ 0.478815] PCI: Using ACPI for IRQ routing1337worker1 # [ 0.469093] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1338client # [ 0.483425] ACPI: PCI: Interrupt link GSIG configured for IRQ 221339lb # [ 0.465874] ACPI: PCI: Interrupt link LNKA configured for IRQ 101340client # [ 0.484436] ACPI: PCI: Interrupt link GSIH configured for IRQ 231341lb # [ 0.466948] ACPI: PCI: Interrupt link LNKB configured for IRQ 101342worker1 # [ 0.471949] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1343lb # [ 0.467945] ACPI: PCI: Interrupt link LNKC configured for IRQ 111344client # [ 0.486453] iommu: Default domain type: Translated1345lb # [ 0.468945] ACPI: PCI: Interrupt link LNKD configured for IRQ 111346client # [ 0.487286] iommu: DMA domain TLB invalidation policy: lazy mode1347worker1 # [ 0.472507] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1348client # [ 0.488452] ACPI: bus type USB registered1349lb # [ 0.469948] ACPI: PCI: Interrupt link LNKE configured for IRQ 101350client # [ 0.489196] usbcore: registered new interface driver usbfs1351lb # [ 0.470939] ACPI: PCI: Interrupt link LNKF configured for IRQ 101352worker1 # [ 0.474236] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1353client # [ 0.489440] usbcore: registered new interface driver hub1354lb # [ 0.471942] ACPI: PCI: Interrupt link LNKG configured for IRQ 111355client # [ 0.490359] usbcore: registered new device driver usb1356worker1 # [ 0.475486] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1357lb # [ 0.472938] ACPI: PCI: Interrupt link LNKH configured for IRQ 111358lb # [ 0.473879] ACPI: PCI: Interrupt link GSIA configured for IRQ 161359client # [ 0.492072] NetLabel: Initializing1360worker1 # [ 0.476555] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1361client # [ 0.492424] NetLabel: domain hash size = 1281362lb # [ 0.474843] ACPI: PCI: Interrupt link GSIB configured for IRQ 171363client # [ 0.493223] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1364lb # [ 0.475832] ACPI: PCI: Interrupt link GSIC configured for IRQ 181365worker1 # [ 0.477490] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1366client # [ 0.494185] NetLabel: unlabeled traffic allowed by default1367lb # [ 0.476729] ACPI: PCI: Interrupt link GSID configured for IRQ 191368client # [ 0.494434] PCI: Using ACPI for IRQ routing1369lb # [ 0.477675] ACPI: PCI: Interrupt link GSIE configured for IRQ 201370worker1 # [ 0.480136] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1371lb # [ 0.478623] ACPI: PCI: Interrupt link GSIF configured for IRQ 211372worker1 # [ 0.480891] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1373lb # [ 0.479577] ACPI: PCI: Interrupt link GSIG configured for IRQ 221374lb # [ 0.479857] ACPI: PCI: Interrupt link GSIH configured for IRQ 231375worker1 # [ 0.481610] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1376lb # [ 0.481924] iommu: Default domain type: Translated1377lb # [ 0.482764] iommu: DMA domain TLB invalidation policy: lazy mode1378worker1 # [ 0.483256] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1379lb # [ 0.483825] ACPI: bus type USB registered1380lb # [ 0.484406] usbcore: registered new interface driver usbfs1381lb # [ 0.484858] usbcore: registered new interface driver hub1382lb # [ 0.485799] usbcore: registered new device driver usb1383worker1 # [ 0.487638] ACPI: PCI: Interrupt link LNKA configured for IRQ 101384lb # [ 0.487403] NetLabel: Initializing1385worker1 # [ 0.488337] ACPI: PCI: Interrupt link LNKB configured for IRQ 101386lb # [ 0.487843] NetLabel: domain hash size = 1281387lb # [ 0.488574] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1388worker1 # [ 0.489328] ACPI: PCI: Interrupt link LNKC configured for IRQ 111389lb # [ 0.488880] NetLabel: unlabeled traffic allowed by default1390worker1 # [ 0.490329] ACPI: PCI: Interrupt link LNKD configured for IRQ 111391lb # [ 0.489809] PCI: Using ACPI for IRQ routing1392worker1 # [ 0.491327] ACPI: PCI: Interrupt link LNKE configured for IRQ 101393worker1 # [ 0.492549] ACPI: PCI: Interrupt link LNKF configured for IRQ 101394worker1 # [ 0.493343] ACPI: PCI: Interrupt link LNKG configured for IRQ 111395worker1 # [ 0.494334] ACPI: PCI: Interrupt link LNKH configured for IRQ 111396worker1 # [ 0.495266] ACPI: PCI: Interrupt link GSIA configured for IRQ 161397worker1 # [ 0.496240] ACPI: PCI: Interrupt link GSIB configured for IRQ 171398worker1 # [ 0.497222] ACPI: PCI: Interrupt link GSIC configured for IRQ 181399worker1 # [ 0.497982] ACPI: PCI: Interrupt link GSID configured for IRQ 191400worker1 # [ 0.498242] ACPI: PCI: Interrupt link GSIE configured for IRQ 201401worker1 # [ 0.499219] ACPI: PCI: Interrupt link GSIF configured for IRQ 211402worker1 # [ 0.499980] ACPI: PCI: Interrupt link GSIG configured for IRQ 221403worker1 # [ 0.500316] ACPI: PCI: Interrupt link GSIH configured for IRQ 231404worker2 # [ 0.523567] pci 0000:00:01.0: vgaarb: setting as boot VGA device1405worker1 # [ 0.502640] iommu: Default domain type: Translated1406worker2 # [ 0.523845] pci 0000:00:01.0: vgaarb: bridge control possible1407worker1 # [ 0.503235] iommu: DMA domain TLB invalidation policy: lazy mode1408worker1 # [ 0.504506] ACPI: bus type USB registered1409worker2 # [ 0.523845] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1410worker2 # [ 0.523854] vgaarb: loaded1411worker1 # [ 0.505293] usbcore: registered new interface driver usbfs1412worker2 # [ 0.524583] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01413worker1 # [ 0.506240] usbcore: registered new interface driver hub1414worker2 # [ 0.524852] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1415worker1 # [ 0.507142] usbcore: registered new device driver usb1416worker1 # [ 0.508822] NetLabel: Initializing1417worker1 # [ 0.509229] NetLabel: domain hash size = 1281418worker1 # [ 0.509993] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1419worker1 # [ 0.510269] NetLabel: unlabeled traffic allowed by default1420worker1 # [ 0.511212] PCI: Using ACPI for IRQ routing1421worker2 # [ 0.528933] clocksource: Switched to clocksource kvm-clock1422worker2 # [ 0.532468] VFS: Disk quotas dquot_6.6.01423worker2 # [ 0.533198] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1424worker2 # [ 0.534568] pnp: PnP ACPI init1425client # [ 0.541913] pci 0000:00:01.0: vgaarb: setting as boot VGA device1426worker2 # [ 0.535382] ACPI: IRQ 4 override to edge(!), high(!)1427client # [ 0.542418] pci 0000:00:01.0: vgaarb: bridge control possible1428worker2 # [ 0.536344] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1429worker2 # [ 0.537870] pnp: PnP ACPI: found 6 devices1430client # [ 0.542418] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1431client # [ 0.542426] vgaarb: loaded1432client # [ 0.543252] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01433client # [ 0.544099] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1434client # [ 0.548522] clocksource: Switched to clocksource kvm-clock1435worker2 # [ 0.545518] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1436worker2 # [ 0.547001] clocksource: Switched to clocksource acpi_pm1437lb # [ 0.534138] pci 0000:00:01.0: vgaarb: setting as boot VGA device1438worker2 # [ 0.548004] NET: Registered PF_INET protocol family1439lb # [ 0.534838] pci 0000:00:01.0: vgaarb: bridge control possible1440client # [ 0.552351] VFS: Disk quotas dquot_6.6.01441worker2 # [ 0.549233] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1442lb # [ 0.534838] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1443lb # [ 0.534845] vgaarb: loaded1444client # [ 0.553148] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1445lb # [ 0.535594] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01446client # [ 0.554915] pnp: PnP ACPI init1447lb # [ 0.535846] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1448client # [ 0.555810] ACPI: IRQ 4 override to edge(!), high(!)1449client # [ 0.556928] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1450client # [ 0.558632] pnp: PnP ACPI: found 6 devices1451lb # [ 0.540057] clocksource: Switched to clocksource kvm-clock1452lb # [ 0.544012] VFS: Disk quotas dquot_6.6.01453lb # [ 0.544758] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1454lb # [ 0.546208] pnp: PnP ACPI init1455lb # [ 0.547058] ACPI: IRQ 4 override to edge(!), high(!)1456client # [ 0.566412] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1457lb # [ 0.548066] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1458client # [ 0.568179] clocksource: Switched to clocksource acpi_pm1459worker2 # [ 0.565573] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1460lb # [ 0.549655] pnp: PnP ACPI: found 6 devices1461client # [ 0.569276] NET: Registered PF_INET protocol family1462worker2 # [ 0.567117] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1463client # [ 0.570582] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1464worker2 # [ 0.568472] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1465worker2 # [ 0.569843] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1466worker2 # [ 0.571180] TCP: Hash tables configured (established 16384 bind 16384)1467worker2 # [ 0.572351] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1468worker2 # [ 0.573760] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1469lb # [ 0.557464] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1470worker2 # [ 0.574960] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1471lb # [ 0.558874] clocksource: Switched to clocksource acpi_pm1472worker2 # [ 0.576197] NET: Registered PF_UNIX/PF_LOCAL protocol family1473lb # [ 0.559854] NET: Registered PF_INET protocol family1474worker2 # [ 0.577178] NET: Registered PF_XDP protocol family1475worker1 # [ 0.558703] pci 0000:00:01.0: vgaarb: setting as boot VGA device1476worker1 # [ 0.559224] pci 0000:00:01.0: vgaarb: bridge control possible1477worker2 # [ 0.577969] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1478lb # [ 0.561067] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1479worker2 # [ 0.578933] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1480worker1 # [ 0.559224] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1481worker1 # [ 0.559232] vgaarb: loaded1482worker2 # [ 0.579954] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1483worker1 # [ 0.559993] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01484worker2 # [ 0.581095] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1485worker1 # [ 0.560229] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1486worker2 # [ 0.582173] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1487worker2 # [ 0.583259] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1488worker2 # [ 0.584998] ACPI: \_SB_.GSIA: Enabled at IRQ 161489client # [ 0.588010] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1490worker1 # [ 0.563318] clocksource: Switched to clocksource kvm-clock1491client # [ 0.589672] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1492worker1 # [ 0.565056] VFS: Disk quotas dquot_6.6.01493worker2 # [ 0.587701] ACPI: \_SB_.GSIB: Enabled at IRQ 171494client # [ 0.591102] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1495worker2 # [ 0.589680] ACPI: \_SB_.GSIC: Enabled at IRQ 181496client # [ 0.592526] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1497worker1 # [ 0.567765] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1498client # [ 0.593893] TCP: Hash tables configured (established 16384 bind 16384)1499worker2 # [ 0.591639] ACPI: \_SB_.GSID: Enabled at IRQ 191500worker1 # [ 0.569143] pnp: PnP ACPI init1501worker1 # [ 0.569946] ACPI: IRQ 4 override to edge(!), high(!)1502client # [ 0.595105] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1503worker2 # [ 0.593310] PCI: CLS 0 bytes, default 641504client # [ 0.596452] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1505worker1 # [ 0.570920] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1506worker2 # [ 0.594216] Trying to unpack rootfs image as initramfs...1507worker1 # [ 0.572505] pnp: PnP ACPI: found 6 devices1508client # [ 0.597618] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1509lb # [ 0.578791] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1510client # [ 0.598888] NET: Registered PF_UNIX/PF_LOCAL protocol family1511client # [ 0.599877] NET: Registered PF_XDP protocol family1512worker2 # [ 0.596272] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1513lb # [ 0.580357] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1514client # [ 0.600755] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1515lb # [ 0.581622] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1516client # [ 0.601811] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1517lb # [ 0.582926] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1518client # [ 0.602853] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1519lb # [ 0.584183] TCP: Hash tables configured (established 16384 bind 16384)1520client # [ 0.603995] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1521lb # [ 0.585284] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1522client # [ 0.605144] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1523lb # [ 0.586519] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1524worker1 # [ 0.580208] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1525client # [ 0.606319] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1526worker1 # [ 0.581684] clocksource: Switched to clocksource acpi_pm1527lb # [ 0.587564] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1528client # [ 0.608146] ACPI: \_SB_.GSIA: Enabled at IRQ 161529worker1 # [ 0.582685] NET: Registered PF_INET protocol family1530lb # [ 0.588777] NET: Registered PF_UNIX/PF_LOCAL protocol family1531lb # [ 0.589739] NET: Registered PF_XDP protocol family1532worker1 # [ 0.583900] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1533lb # [ 0.590587] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1534client # [ 0.610418] ACPI: \_SB_.GSIB: Enabled at IRQ 171535lb # [ 0.591583] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1536lb # [ 0.592565] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1537client # [ 0.612377] ACPI: \_SB_.GSIC: Enabled at IRQ 181538lb # [ 0.593636] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1539client # [ 0.614353] ACPI: \_SB_.GSID: Enabled at IRQ 191540lb # [ 0.594709] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1541lb # [ 0.595786] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1542client # [ 0.616058] PCI: CLS 0 bytes, default 641543lb # [ 0.597650] ACPI: \_SB_.GSIA: Enabled at IRQ 161544client # [ 0.616989] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1545client # [ 0.618843] Trying to unpack rootfs image as initramfs...1546lb # [ 0.600505] ACPI: \_SB_.GSIB: Enabled at IRQ 171547lb # [ 0.602459] ACPI: \_SB_.GSIC: Enabled at IRQ 181548lb # [ 0.604448] ACPI: \_SB_.GSID: Enabled at IRQ 191549lb # [ 0.606166] PCI: CLS 0 bytes, default 641550lb # [ 0.607038] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1551worker1 # [ 0.601590] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1552lb # [ 0.608804] Trying to unpack rootfs image as initramfs...1553worker1 # [ 0.603151] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1554worker1 # [ 0.604473] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1555worker1 # [ 0.605896] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1556worker1 # [ 0.607126] TCP: Hash tables configured (established 16384 bind 16384)1557worker1 # [ 0.608230] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1558worker1 # [ 0.609556] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1559worker1 # [ 0.610622] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1560worker1 # [ 0.611806] NET: Registered PF_UNIX/PF_LOCAL protocol family1561worker1 # [ 0.612782] NET: Registered PF_XDP protocol family1562worker1 # [ 0.613651] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1563worker2 # [ 0.637507] Initialise system trusted keyrings1564worker1 # [ 0.614658] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1565worker2 # [ 0.638459] workingset: timestamp_bits=40 max_order=19 bucket_order=01566worker1 # [ 0.615629] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1567worker1 # [ 0.616740] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1568worker1 # [ 0.617868] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1569worker1 # [ 0.618928] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1570worker1 # [ 0.620655] ACPI: \_SB_.GSIA: Enabled at IRQ 161571worker1 # [ 0.623139] ACPI: \_SB_.GSIB: Enabled at IRQ 171572worker1 # [ 0.625047] ACPI: \_SB_.GSIC: Enabled at IRQ 181573worker1 # [ 0.627007] ACPI: \_SB_.GSID: Enabled at IRQ 191574worker1 # [ 0.628685] PCI: CLS 0 bytes, default 641575worker1 # [ 0.629575] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1576worker1 # [ 0.631248] Trying to unpack rootfs image as initramfs...1577worker2 # [ 0.662274] Key type asymmetric registered1578worker2 # [ 0.662985] Asymmetric key parser 'x509' registered1579client # [ 0.666056] Initialise system trusted keyrings1580worker2 # [ 0.663875] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1581client # [ 0.667022] workingset: timestamp_bits=40 max_order=19 bucket_order=01582lb # [ 0.651831] Initialise system trusted keyrings1583worker2 # [ 0.669231] io scheduler mq-deadline registered1584worker2 # [ 0.670034] io scheduler kyber registered1585lb # [ 0.655176] workingset: timestamp_bits=40 max_order=19 bucket_order=01586worker2 # [ 0.672649] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1587worker2 # [ 0.674006] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1588worker2 # [ 0.679736] Linux agpgart interface v0.1031589worker2 # [ 0.680534] ACPI: bus type drm_connector registered1590worker2 # [ 0.683568] usbcore: registered new interface driver usbserial_generic1591worker2 # [ 0.684682] usbserial: USB Serial support registered for generic1592worker2 # [ 0.687120] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1593client # [ 0.691020] Key type asymmetric registered1594worker2 # [ 0.687120] Please enable it if your BIOS has the CPPC option.1595client # [ 0.691768] Asymmetric key parser 'x509' registered1596worker2 # [ 0.689433] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1597client # [ 0.692588] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1598client # [ 0.695694] io scheduler mq-deadline registered1599client # [ 0.696435] io scheduler kyber registered1600worker2 # [ 0.693272] drop_monitor: Initializing network drop monitor service1601worker2 # [ 0.694649] NET: Registered PF_INET6 protocol family1602lb # [ 0.678233] Key type asymmetric registered1603lb # [ 0.678957] Asymmetric key parser 'x509' registered1604lb # [ 0.679796] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1605client # [ 0.700631] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1606worker2 # [ 0.698821] Segment Routing with IPv61607lb # [ 0.682265] io scheduler mq-deadline registered1608worker1 # [ 0.676733] Initialise system trusted keyrings1609lb # [ 0.683007] io scheduler kyber registered1610client # [ 0.701940] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1611worker2 # [ 0.701118] In-situ OAM (IOAM) with IPv61612worker2 # [ 0.703399] IPI shorthand broadcast: enabled1613worker1 # [ 0.680356] workingset: timestamp_bits=40 max_order=19 bucket_order=01614lb # [ 0.687308] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1615client # [ 0.707446] Linux agpgart interface v0.1031616client # [ 0.708240] ACPI: bus type drm_connector registered1617lb # [ 0.688615] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1618client # [ 0.712745] usbcore: registered new interface driver usbserial_generic1619worker2 # [ 0.709687] sched_clock: Marking stable (576013887, 133077965)->(784729906, -75638054)1620lb # [ 0.693979] Linux agpgart interface v0.1031621client # [ 0.713826] usbserial: USB Serial support registered for generic1622lb # [ 0.694748] ACPI: bus type drm_connector registered1623client # [ 0.716621] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1624lb # [ 0.697615] usbcore: registered new interface driver usbserial_generic1625client # [ 0.716621] Please enable it if your BIOS has the CPPC option.1626lb # [ 0.698672] usbserial: USB Serial support registered for generic1627worker2 # [ 0.716280] registered taskstats version 11628client # [ 0.718804] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1629worker2 # [ 0.717238] Loading compiled-in X.509 certificates1630client # [ 0.721761] drop_monitor: Initializing network drop monitor service1631lb # [ 0.702149] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1632client # [ 0.722926] NET: Registered PF_INET6 protocol family1633lb # [ 0.702149] Please enable it if your BIOS has the CPPC option.1634lb # [ 0.704312] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1635client # [ 0.726098] Segment Routing with IPv61636lb # [ 0.707285] drop_monitor: Initializing network drop monitor service1637worker1 # [ 0.702407] Key type asymmetric registered1638lb # [ 0.708471] NET: Registered PF_INET6 protocol family1639client # [ 0.728654] In-situ OAM (IOAM) with IPv61640worker1 # [ 0.703203] Asymmetric key parser 'x509' registered1641client # [ 0.729714] IPI shorthand broadcast: enabled1642worker1 # [ 0.704132] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1643lb # [ 0.713639] Segment Routing with IPv61644worker1 # [ 0.709496] io scheduler mq-deadline registered1645worker1 # [ 0.710308] io scheduler kyber registered1646lb # [ 0.717155] In-situ OAM (IOAM) with IPv61647lb # [ 0.718256] IPI shorthand broadcast: enabled1648client # [ 0.738193] sched_clock: Marking stable (599016061, 138595732)->(810113789, -72501996)1649worker2 # [ 0.736115] Demotion targets for Node 0: null1650worker2 # [ 0.736977] Key type .fscrypt registered1651worker1 # [ 0.714507] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1652worker2 # [ 0.737693] Key type fscrypt-provisioning registered1653worker1 # [ 0.715863] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1654client # [ 0.743741] registered taskstats version 11655worker2 # [ 0.741224] ima: No TPM chip found, activating TPM-bypass!1656client # [ 0.744685] Loading compiled-in X.509 certificates1657worker2 # [ 0.742180] ima: Allocated hash algorithm: sha11658worker2 # [ 0.742956] ima: No architecture policies found1659lb # [ 0.726653] sched_clock: Marking stable (593016075, 133098754)->(805743681, -79628852)1660worker1 # [ 0.721271] Linux agpgart interface v0.1031661worker1 # [ 0.722076] ACPI: bus type drm_connector registered1662worker2 # [ 0.745288] PM: Magic number: 10:478:7341663worker2 # [ 0.746865] RAS: Correctable Errors collector initialized.1664worker1 # [ 0.724730] usbcore: registered new interface driver usbserial_generic1665lb # [ 0.731230] registered taskstats version 11666worker1 # [ 0.725830] usbserial: USB Serial support registered for generic1667lb # [ 0.732195] Loading compiled-in X.509 certificates1668worker1 # [ 0.729318] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1669worker1 # [ 0.729318] Please enable it if your BIOS has the CPPC option.1670worker1 # [ 0.731567] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1671worker2 # [ 0.755793] clk: Disabling unused clocks1672worker1 # [ 0.734460] drop_monitor: Initializing network drop monitor service1673worker1 # [ 0.735656] NET: Registered PF_INET6 protocol family1674worker2 # [ 0.759110] PM: genpd: Disabling unused power domains1675client # [ 0.762624] Demotion targets for Node 0: null1676client # [ 0.763497] Key type .fscrypt registered1677client # [ 0.764230] Key type fscrypt-provisioning registered1678client # [ 0.765218] ima: No TPM chip found, activating TPM-bypass!1679worker1 # [ 0.740760] Segment Routing with IPv61680lb # [ 0.750129] Demotion targets for Node 0: null1681client # [ 0.769631] ima: Allocated hash algorithm: sha11682worker1 # [ 0.744329] In-situ OAM (IOAM) with IPv61683lb # [ 0.750989] Key type .fscrypt registered1684client # [ 0.770424] ima: No architecture policies found1685worker1 # [ 0.745449] IPI shorthand broadcast: enabled1686client # [ 0.772630] PM: Magic number: 10:478:7341687lb # [ 0.753126] Key type fscrypt-provisioning registered1688lb # [ 0.754037] ima: No TPM chip found, activating TPM-bypass!1689client # [ 0.774237] RAS: Correctable Errors collector initialized.1690lb # [ 0.754946] ima: Allocated hash algorithm: sha11691lb # [ 0.759167] ima: No architecture policies found1692lb # [ 0.760149] PM: Magic number: 10:478:7341693worker1 # [ 0.753850] sched_clock: Marking stable (614015197, 139278779)->(835035035, -81741059)1694lb # [ 0.761872] RAS: Correctable Errors collector initialized.1695worker1 # [ 0.757565] registered taskstats version 11696worker1 # [ 0.758571] Loading compiled-in X.509 certificates1697client # [ 0.784314] clk: Disabling unused clocks1698client # [ 0.786625] PM: genpd: Disabling unused power domains1699lb # [ 0.769820] clk: Disabling unused clocks1700lb # [ 0.773141] PM: genpd: Disabling unused power domains1701worker1 # [ 0.778310] Demotion targets for Node 0: null1702worker1 # [ 0.779263] Key type .fscrypt registered1703worker1 # [ 0.779998] Key type fscrypt-provisioning registered1704worker1 # [ 0.780989] ima: No TPM chip found, activating TPM-bypass!1705worker1 # [ 0.785314] ima: Allocated hash algorithm: sha11706worker1 # [ 0.786183] ima: No architecture policies found1707worker1 # [ 0.788314] PM: Magic number: 10:478:7341708worker1 # [ 0.790036] RAS: Correctable Errors collector initialized.1709worker1 # [ 0.798956] clk: Disabling unused clocks1710worker1 # [ 0.803322] PM: genpd: Disabling unused power domains1711worker2 # [ 0.924947] Freeing initrd memory: 29092K1712worker2 # [ 0.928179] Freeing unused decrypted memory: 2028K1713worker2 # [ 0.930856] Freeing unused kernel image (initmem) memory: 3644K1714worker2 # [ 0.931968] Write protecting the kernel read-only data: 32768k1715worker2 # [ 0.933888] Freeing unused kernel image (text/rodata gap) memory: 1208K1716worker2 # [ 0.935505] Freeing unused kernel image (rodata/data gap) memory: 752K1717client # [ 0.956372] Freeing initrd memory: 29096K1718client # [ 0.959582] Freeing unused decrypted memory: 2028K1719client # [ 0.962245] Freeing unused kernel image (initmem) memory: 3644K1720client # [ 0.963353] Write protecting the kernel read-only data: 32768k1721client # [ 0.965258] Freeing unused kernel image (text/rodata gap) memory: 1208K1722client # [ 0.966872] Freeing unused kernel image (rodata/data gap) memory: 752K1723lb # [ 0.948760] Freeing initrd memory: 29092K1724lb # [ 0.952354] Freeing unused decrypted memory: 2028K1725lb # [ 0.955428] Freeing unused kernel image (initmem) memory: 3644K1726lb # [ 0.956595] Write protecting the kernel read-only data: 32768k1727lb # [ 0.958641] Freeing unused kernel image (text/rodata gap) memory: 1208K1728lb # [ 0.960290] Freeing unused kernel image (rodata/data gap) memory: 752K1729worker2 # [ 0.988067] x86/mm: Checked W+X mappings: passed, no W+X pages found.1730worker2 # [ 0.989147] Run /init as init process1731worker2 # [ 0.999312] systemd[1]: Inserted module 'autofs4'1732worker1 # [ 0.976593] Freeing initrd memory: 29092K1733worker1 # [ 0.979837] Freeing unused decrypted memory: 2028K1734worker1 # [ 0.982618] Freeing unused kernel image (initmem) memory: 3644K1735worker1 # [ 0.983753] Write protecting the kernel read-only data: 32768k1736worker1 # [ 0.985729] Freeing unused kernel image (text/rodata gap) memory: 1208K1737worker1 # [ 0.987331] Freeing unused kernel image (rodata/data gap) memory: 752K1738worker2 # [ 1.015574] fuse: init (API version 7.45)1739client # [ 1.018070] x86/mm: Checked W+X mappings: passed, no W+X pages found.1740client # [ 1.019155] Run /init as init process1741worker2 # [ 1.021316] ACPI: \_SB_.GSIG: Enabled at IRQ 221742worker2 # [ 1.023777] ACPI: \_SB_.GSIH: Enabled at IRQ 231743client # [ 1.029418] systemd[1]: Inserted module 'autofs4'1744worker2 # [ 1.026972] ACPI: \_SB_.GSIE: Enabled at IRQ 201745lb # [ 1.011381] x86/mm: Checked W+X mappings: passed, no W+X pages found.1746lb # [ 1.012505] Run /init as init process1747worker2 # [ 1.029725] ACPI: \_SB_.GSIF: Enabled at IRQ 211748lb # [ 1.023554] systemd[1]: Inserted module 'autofs4'1749client # [ 1.045923] fuse: init (API version 7.45)1750client # [ 1.051760] ACPI: \_SB_.GSIG: Enabled at IRQ 221751client # [ 1.054147] ACPI: \_SB_.GSIH: Enabled at IRQ 231752client # [ 1.056982] ACPI: \_SB_.GSIE: Enabled at IRQ 201753worker2 # [ 1.054786] systemd[1]: Successfully made /usr/ read-only.1754client # [ 1.059064] ACPI: \_SB_.GSIF: Enabled at IRQ 211755lb # [ 1.040607] fuse: init (API version 7.45)1756worker1 # [ 1.039792] x86/mm: Checked W+X mappings: passed, no W+X pages found.1757lb # [ 1.046616] ACPI: \_SB_.GSIG: Enabled at IRQ 221758worker1 # [ 1.040968] Run /init as init process1759lb # [ 1.049388] ACPI: \_SB_.GSIH: Enabled at IRQ 231760lb # [ 1.053742] ACPI: \_SB_.GSIE: Enabled at IRQ 201761lb # [ 1.056180] ACPI: \_SB_.GSIF: Enabled at IRQ 211762worker1 # [ 1.052791] systemd[1]: Inserted module 'autofs4'1763client # [ 1.083311] systemd[1]: Successfully made /usr/ read-only.1764worker1 # [ 1.070336] fuse: init (API version 7.45)1765worker1 # [ 1.076555] ACPI: \_SB_.GSIG: Enabled at IRQ 221766lb # [ 1.083157] systemd[1]: Successfully made /usr/ read-only.1767worker1 # [ 1.079036] ACPI: \_SB_.GSIH: Enabled at IRQ 231768worker1 # [ 1.082247] ACPI: \_SB_.GSIE: Enabled at IRQ 201769worker1 # [ 1.084512] ACPI: \_SB_.GSIF: Enabled at IRQ 211770worker1 # [ 1.111167] systemd[1]: Successfully made /usr/ read-only.1771worker2 # [ 1.391392] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772worker2 # [ 1.403256] systemd[1]: Detected virtualization kvm.1773worker2 # [ 1.405337] systemd[1]: Detected architecture x86-64.1774worker2 # [ 1.407408] systemd[1]: Running in initrd.1775worker2 # [ 1.409805] systemd[1]: Initializing machine ID from random generator.1776worker2 # [ 1.412660] systemd[1]: Hostname set to <worker2>.1777client # [ 1.419867] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778client # [ 1.431737] systemd[1]: Detected virtualization kvm.1779client # [ 1.433857] systemd[1]: Detected architecture x86-64.1780client # [ 1.435966] systemd[1]: Running in initrd.1781client # [ 1.438375] systemd[1]: Initializing machine ID from random generator.1782client # [ 1.441243] systemd[1]: Hostname set to <client>.1783lb # [ 1.419746] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1784lb # [ 1.431846] systemd[1]: Detected virtualization kvm.1785lb # [ 1.433991] systemd[1]: Detected architecture x86-64.1786lb # [ 1.436250] systemd[1]: Running in initrd.1787lb # [ 1.438958] systemd[1]: Initializing machine ID from random generator.1788lb # [ 1.441977] systemd[1]: Hostname set to <lb>.1789worker1 # [ 1.446715] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790worker1 # [ 1.451926] systemd[1]: Detected virtualization kvm.1791worker1 # [ 1.452812] systemd[1]: Detected architecture x86-64.1792worker1 # [ 1.453720] systemd[1]: Running in initrd.1793worker1 # [ 1.454841] systemd[1]: Initializing machine ID from random generator.1794worker1 # [ 1.456133] systemd[1]: Hostname set to <worker1>.1795worker2 # [ 1.633911] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796client # [ 1.648569] systemd[1]: bpf-restrict-fs: LSM BPF program attached1797worker1 # [ 1.646545] systemd[1]: bpf-restrict-fs: LSM BPF program attached1798lb # [ 1.652772] systemd[1]: bpf-restrict-fs: LSM BPF program attached1799worker2 # [ 1.688490] systemd[1]: Queued start job for default target Initrd Default Target.1800worker2 # [ 1.692404] systemd[1]: Created slice Slice /system/modprobe.1801worker2 # [ 1.693619] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1802worker2 # [ 1.695124] systemd[1]: Expecting device /dev/disk/by-label/nixos...1803worker2 # [ 1.696243] systemd[1]: Reached target Path Units.1804worker2 # [ 1.697141] systemd[1]: Reached target Slice Units.1805worker2 # [ 1.697995] systemd[1]: Reached target Swaps.1806worker2 # [ 1.698838] systemd[1]: Reached target Timer Units.1807client # [ 1.701517] systemd[1]: Queued start job for default target Initrd Default Target.1808worker2 # [ 1.699828] systemd[1]: Listening on D-Bus System Message Bus Socket.1809worker2 # [ 1.701112] systemd[1]: Listening on Journal Socket (/dev/log).1810worker2 # [ 1.702290] systemd[1]: Listening on Journal Sockets.1811client # [ 1.705896] systemd[1]: Created slice Slice /system/modprobe.1812worker2 # [ 1.703266] systemd[1]: Listening on udev Control Socket.1813worker2 # [ 1.704245] systemd[1]: Listening on udev Kernel Socket.1814client # [ 1.707099] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1815worker2 # [ 1.705319] systemd[1]: Reached target Socket Units.1816client # [ 1.708505] systemd[1]: Expecting device /dev/disk/by-label/nixos...1817client # [ 1.709652] systemd[1]: Reached target Path Units.1818worker2 # [ 1.707055] systemd[1]: Starting Create List of Static Device Nodes...1819client # [ 1.710498] systemd[1]: Reached target Slice Units.1820client # [ 1.711434] systemd[1]: Reached target Swaps.1821client # [ 1.712246] systemd[1]: Reached target Timer Units.1822lb # [ 1.692429] systemd[1]: Queued start job for default target Initrd Default Target.1823client # [ 1.713232] systemd[1]: Listening on D-Bus System Message Bus Socket.1824worker2 # [ 1.710913] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1825worker1 # [ 1.688340] systemd[1]: Queued start job for default target Initrd Default Target.1826client # [ 1.714488] systemd[1]: Listening on Journal Socket (/dev/log).1827client # [ 1.715666] systemd[1]: Listening on Journal Sockets.1828lb # [ 1.696619] systemd[1]: Created slice Slice /system/modprobe.1829client # [ 1.716679] systemd[1]: Listening on udev Control Socket.1830worker1 # [ 1.691752] systemd[1]: Created slice Slice /system/modprobe.1831client # [ 1.717721] systemd[1]: Listening on udev Kernel Socket.1832lb # [ 1.697806] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1833client # [ 1.718677] systemd[1]: Reached target Socket Units.1834lb # [ 1.699203] systemd[1]: Expecting device /dev/disk/by-label/nixos...1835worker1 # [ 1.693000] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1836lb # [ 1.700271] systemd[1]: Reached target Path Units.1837worker1 # [ 1.694402] systemd[1]: Expecting device /dev/disk/by-label/nixos...1838lb # [ 1.701171] systemd[1]: Reached target Slice Units.1839client # [ 1.720398] systemd[1]: Starting Create List of Static Device Nodes...1840worker1 # [ 1.695493] systemd[1]: Reached target Path Units.1841worker2 # [ 1.718285] systemd[1]: Starting Load Kernel Module configfs...1842lb # [ 1.701990] systemd[1]: Reached target Swaps.1843worker1 # [ 1.696351] systemd[1]: Reached target Slice Units.1844lb # [ 1.702823] systemd[1]: Reached target Timer Units.1845worker1 # [ 1.697195] systemd[1]: Reached target Swaps.1846worker1 # [ 1.697966] systemd[1]: Reached target Timer Units.1847lb # [ 1.703836] systemd[1]: Listening on D-Bus System Message Bus Socket.1848lb # [ 1.705053] systemd[1]: Listening on Journal Socket (/dev/log).1849worker1 # [ 1.698963] systemd[1]: Listening on D-Bus System Message Bus Socket.1850client # [ 1.724681] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1851lb # [ 1.706198] systemd[1]: Listening on Journal Sockets.1852worker1 # [ 1.700171] systemd[1]: Listening on Journal Socket (/dev/log).1853lb # [ 1.707181] systemd[1]: Listening on udev Control Socket.1854worker1 # [ 1.701341] systemd[1]: Listening on Journal Sockets.1855lb # [ 1.708200] systemd[1]: Listening on udev Kernel Socket.1856worker1 # [ 1.702353] systemd[1]: Listening on udev Control Socket.1857lb # [ 1.709159] systemd[1]: Reached target Socket Units.1858worker1 # [ 1.703444] systemd[1]: Listening on udev Kernel Socket.1859worker1 # [ 1.704369] systemd[1]: Reached target Socket Units.1860lb # [ 1.710973] systemd[1]: Starting Create List of Static Device Nodes...1861worker1 # [ 1.706229] systemd[1]: Starting Create List of Static Device Nodes...1862client # [ 1.732734] systemd[1]: Starting Load Kernel Module configfs...1863worker2 # [ 1.730768] systemd[1]: Starting Journal Service...1864lb # [ 1.714973] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1865worker1 # [ 1.710198] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1866lb # [ 1.721688] systemd[1]: Starting Load Kernel Module configfs...1867worker1 # [ 1.716378] systemd[1]: Starting Load Kernel Module configfs...1868client # [ 1.747031] systemd[1]: Starting Journal Service...1869worker2 # [ 1.745169] systemd[1]: Starting Load Kernel Modules...1870worker1 # [ 1.729898] systemd[1]: Starting Journal Service...1871lb # [ 1.737304] systemd[1]: Starting Journal Service...1872client # [ 1.762678] systemd[1]: Starting Load Kernel Modules...1873worker2 # [ 1.750179] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1874worker1 # [ 1.743388] systemd[1]: Starting Load Kernel Modules...1875lb # [ 1.750263] systemd[1]: Starting Load Kernel Modules...1876worker2 # [ 1.767916] netfs: FS-Cache loaded1877worker2 # [ 1.772711] 9pnet: Installing 9P2000 support1878client # [ 1.766681] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1879client # [ 1.782324] netfs: FS-Cache loaded1880client # [ 1.787183] 9pnet: Installing 9P2000 support1881worker1 # [ 1.749398] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1882worker2 # [ 1.784382] systemd[1]: Starting Coldplug All udev Devices...1883lb # [ 1.757200] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1884lb # [ 1.773857] netfs: FS-Cache loaded1885worker1 # [ 1.770016] netfs: FS-Cache loaded1886client # [ 1.796799] systemd[1]: Starting Coldplug All udev Devices...1887lb # [ 1.778771] 9pnet: Installing 9P2000 support1888worker1 # [ 1.774849] 9pnet: Installing 9P2000 support1889worker2 # [ 1.801204] systemd[1]: Finished Create List of Static Device Nodes.1890lb # [ 1.789228] systemd[1]: Starting Coldplug All udev Devices...1891worker1 # [ 1.784554] systemd[1]: Starting Coldplug All udev Devices...1892client # [ 1.810709] systemd[1]: Finished Create List of Static Device Nodes.1893worker2 # [ 1.810565] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1894client # [ 1.817196] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1895worker2 # [ 1.816155] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1896client # [ 1.824999] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1897worker1 # [ 1.799668] systemd[1]: Finished Create List of Static Device Nodes.1898lb # [ 1.806196] systemd[1]: Finished Create List of Static Device Nodes.1899worker2 # [ 1.823545] systemd[1]: modprobe@configfs.service: Deactivated successfully.1900worker2 # [ 1.824797] systemd-journald[67]: Collecting audit messages is disabled.1901client # [ 1.830020] systemd[1]: modprobe@configfs.service: Deactivated successfully.1902client # [ 1.831414] systemd-journald[67]: Collecting audit messages is disabled.1903worker1 # [ 1.805910] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1904worker2 # [ 1.829504] systemd[1]: Finished Load Kernel Module configfs.1905lb # [ 1.813259] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1906client # [ 1.837000] systemd[1]: Finished Load Kernel Module configfs.1907worker2 # [ 1.833588] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1908lb # [ 1.819569] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1909worker1 # [ 1.813721] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1910worker1 # [ 1.816169] systemd-journald[67]: Collecting audit messages is disabled.1911client # [ 1.841584] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1912lb # [ 1.824377] systemd-journald[67]: Collecting audit messages is disabled.1913worker2 # [ 1.841179] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1914lb # [ 1.825966] systemd[1]: modprobe@configfs.service: Deactivated successfully.1915client # [ 1.845063] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1916worker1 # [ 1.822735] systemd[1]: modprobe@configfs.service: Deactivated successfully.1917worker2 # [ 1.847327] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1918lb # [ 1.833501] systemd[1]: Finished Load Kernel Module configfs.1919worker1 # [ 1.827668] systemd[1]: Finished Load Kernel Module configfs.1920worker2 # [ 1.850172] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1921client # [ 1.853683] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1922client # [ 1.856740] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1923lb # [ 1.837649] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1924worker1 # [ 1.832784] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1925worker1 # [ 1.835178] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1926lb # [ 1.842563] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1927lb # [ 1.850240] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1928worker1 # [ 1.844398] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1929lb # [ 1.851537] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1930worker1 # [ 1.845844] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1931worker2 # [ 1.878678] systemd[1]: Finished Load Kernel Modules.1932client # [ 1.886172] systemd[1]: Finished Load Kernel Modules.1933worker2 # [ 1.888304] systemd[1]: Starting Apply Kernel Variables...1934client # [ 1.892809] systemd[1]: Starting Apply Kernel Variables...1935lb # [ 1.879720] systemd[1]: Finished Load Kernel Modules.1936worker1 # [ 1.875808] systemd[1]: Finished Load Kernel Modules.1937worker2 # [ 1.899228] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1938client # [ 1.902760] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1939worker1 # [ 1.881474] systemd[1]: Starting Apply Kernel Variables...1940lb # [ 1.889203] systemd[1]: Starting Apply Kernel Variables...1941worker2 # [ 1.909340] systemd[1]: Starting Create Static Device Nodes in /dev...1942client # [ 1.912265] systemd[1]: Starting Create Static Device Nodes in /dev...1943worker1 # [ 1.891459] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1944lb # [ 1.901410] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1945worker1 # [ 1.900976] systemd[1]: Starting Create Static Device Nodes in /dev...1946client # [ 1.929919] systemd[1]: Finished Apply Kernel Variables.1947lb # [ 1.912314] systemd[1]: Starting Create Static Device Nodes in /dev...1948worker2 # [ 1.929387] systemd[1]: Finished Apply Kernel Variables.1949worker1 # [ 1.917449] systemd[1]: Finished Apply Kernel Variables.1950lb # [ 1.925231] systemd[1]: Finished Apply Kernel Variables.1951worker2 # [ 1.809256] systemd-modules-load[68]: Inserted module 'dm_mod'1952client # [ 1.946164] systemd[1]: Finished Create Static Device Nodes in /dev.1953worker2 # [ 1.944311] systemd[1]: Started Journal Service.1954worker2 # [ 1.812221] systemd-modules-load[68]: Inserted module 'virtio_balloon'1955client # [ 1.810404] systemd-modules-load[68]: Inserted module 'dm_mod'1956worker2 # [ 1.814276] systemd-modules-load[68]: Inserted module 'virtio_gpu'1957client # [ 1.950260] systemd[1]: Started Journal Service.1958client # [ 1.812653] systemd-modules-load[68]: Inserted module 'virtio_balloon'1959client # [ 1.813740] systemd-modules-load[68]: Inserted module 'virtio_gpu'1960worker2 # [ 1.820159] systemd[1]: Finished Create Static Device Nodes in /dev.1961lb # [ 1.940763] systemd[1]: Started Journal Service.1962worker1 # [ 1.934836] systemd[1]: Finished Create Static Device Nodes in /dev.1963worker2 # [ 1.824911] systemd[1]: Reached target Preparation for Local File Systems.1964client # [ 1.823695] systemd[1]: Reached target Preparation for Local File Systems.1965lb # [ 1.808723] systemd-modules-load[68]: Inserted module 'dm_mod'1966worker2 # [ 1.828073] systemd[1]: Reached target Local File Systems.1967worker1 # [ 1.938498] systemd[1]: Started Journal Service.1968client # [ 1.825801] systemd[1]: Reached target Local File Systems.1969lb # [ 1.811993] systemd-modules-load[68]: Inserted module 'virtio_balloon'1970worker1 # [ 1.798684] systemd-modules-load[68]: Inserted module 'dm_mod'1971worker1 # [ 1.800909] systemd-modules-load[68]: Inserted module 'virtio_balloon'1972lb # [ 1.813248] systemd-modules-load[68]: Inserted module 'virtio_gpu'1973worker1 # [ 1.801924] systemd-modules-load[68]: Inserted module 'virtio_gpu'1974worker2 # [ 1.831065] systemd[1]: Starting Create System Files and Directories...1975client # [ 1.829036] systemd[1]: Starting Create System Files and Directories...1976worker2 # [ 1.835663] systemd[1]: Starting Rule-based Manager for Device Events and Files...1977lb # [ 1.820172] systemd[1]: Finished Create Static Device Nodes in /dev.1978client # [ 1.836067] systemd[1]: Starting Rule-based Manager for Device Events and Files...1979worker1 # [ 1.812096] systemd[1]: Reached target Preparation for Local File Systems.1980worker1 # [ 1.813144] systemd[1]: Reached target Local File Systems.1981lb # [ 1.826602] systemd[1]: Reached target Preparation for Local File Systems.1982worker1 # [ 1.816072] systemd[1]: Starting Create System Files and Directories...1983lb # [ 1.829096] systemd[1]: Reached target Local File Systems.1984lb # [ 1.830361] systemd[1]: Starting Create System Files and Directories...1985worker1 # [ 1.820743] systemd[1]: Starting Rule-based Manager for Device Events and Files...1986lb # [ 1.835325] systemd[1]: Starting Rule-based Manager for Device Events and Files...1987client # [ 1.859442] systemd[1]: Finished Create System Files and Directories.1988worker2 # [ 1.863744] systemd[1]: Finished Create System Files and Directories.1989worker1 # [ 1.844947] systemd[1]: Finished Create System Files and Directories.1990lb # [ 1.860629] systemd[1]: Finished Create System Files and Directories.1991client # [ 1.879765] systemd-udevd[83]: Using default interface naming scheme 'v261'.1992worker2 # [ 1.888986] systemd-udevd[83]: Using default interface naming scheme 'v261'.1993worker1 # [ 1.868744] systemd-udevd[83]: Using default interface naming scheme 'v261'.1994lb # [ 1.888395] systemd-udevd[83]: Using default interface naming scheme 'v261'.1995client # [ 1.904067] systemd[1]: Started Rule-based Manager for Device Events and Files.1996worker2 # [ 1.916243] systemd[1]: Started Rule-based Manager for Device Events and Files.1997worker1 # [ 1.894350] systemd[1]: Started Rule-based Manager for Device Events and Files.1998lb # [ 1.912845] systemd[1]: Started Rule-based Manager for Device Events and Files.1999client # [ 1.949991] systemd[1]: Finished Coldplug All udev Devices.2000client # [ 1.950856] systemd[1]: Reached target System Initialization.
loading 2,014 hidden lines…
4015lb # [ 16.432866] envoy[909]: [2026-09-20 12:42:54.621][909][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4016lb # [ 16.440102] envoy[909]: [2026-09-20 12:42:54.621][909][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4017lb # [ 16.442182] envoy[909]: [2026-09-20 12:42:54.621][909][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4018lb # [ 16.443743] envoy[909]: [2026-09-20 12:42:54.621][909][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4019lb # [ 16.445590] envoy[909]: [2026-09-20 12:42:54.621][909][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4020lb # [ 16.447279] envoy[909]: [2026-09-20 12:42:54.628][909][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4021lb # [ 16.449613] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4022lb # [ 16.451131] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24023lb # [ 16.452708] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4024lb # [ 16.454735] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4025lb # [ 16.456465] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4026lb # [ 16.458062] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4027lb # [ 16.460037] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4028lb # [ 16.464995] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4029lb # [ 16.467089] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4030lb # [ 16.468938] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4031worker1 # [ 16.458863] dhcpcd[693]: eth0: leased 10.0.2.15 for 86400 seconds4032worker1 # [ 16.460428] dhcpcd[693]: eth0: adding route to 10.0.2.0/244033lb # [ 16.472052] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4034worker1 # [ 16.461470] dhcpcd[693]: eth0: adding default route via 10.0.2.24035lb # [ 16.473912] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4036lb # [ 16.477133] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4037lb # [ 16.478837] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4038lb # [ 16.484783] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24039lb # [ 16.486445] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4040lb # [ 16.488518] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4041lb # [ 16.490430] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4042lb # [ 16.493707] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4043lb # [ 16.495668] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4044lb # [ 16.523400] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4045lb # [ 16.525470] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4046lb # [ 16.527714] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84047lb # [ 16.529686] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4048lb # [ 16.532378] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4049lb # [ 16.534760] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4050lb # [ 16.541304] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4051lb # [ 16.543302] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4052lb # [ 16.545996] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4053lb # [ 16.548556] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4054lb # [ 16.551254] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4055lb # [ 16.555443] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4056lb # [ 16.560660] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4057lb # [ 16.562692] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4058lb # [ 16.566973] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4059lb # [ 16.569394] envoy[909]: [2026-09-20 12:42:54.629][909][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4060lb # [ 16.571881] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4061lb # [ 16.575122] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4062lb # [ 16.578149] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4063lb # [ 16.587677] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4064worker1 # [ 16.578292] systemd[1]: Started DHCP Client.4065worker1 # [ 16.580676] systemd[1]: Reached target Multi-User System.4066worker1 # [ 16.581912] systemd[1]: Startup finished in 905ms (kernel) + 3.961s (initrd) + 11.712s (userspace) = 16.580s.4067lb # [ 16.590546] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4068lb # [ 16.595566] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4069lb # [ 16.597604] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4070lb # [ 16.601098] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4071lb # [ 16.604102] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4072lb # [ 16.608252] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4073lb # [ 16.611213] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4074lb # [ 16.613529] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4075lb # [ 16.616216] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4076lb # [ 16.617935] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4077lb # [ 16.619849] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4078lb # [ 16.621802] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4079lb # [ 16.624151] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4080lb # [ 16.626743] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4081lb # [ 16.628524] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4082lb # [ 16.631864] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4083lb # [ 16.634722] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4084lb # [ 16.637420] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4085lb # [ 16.639907] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4086lb # [ 16.641821] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4087lb # [ 16.643623] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4088lb # [ 16.646521] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4089lb # [ 16.648306] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4090lb # [ 16.652484] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4091lb # [ 16.654152] envoy[909]: [2026-09-20 12:42:54.630][909][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4092lb # [ 16.656678] envoy[909]: [2026-09-20 12:42:54.823][909][info][main] [source/server/server.cc:531] HTTP header map info:4093lb # [ 16.658179] envoy[909]: [2026-09-20 12:42:54.888][909][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4094lb # [ 16.671368] envoy[909]: [2026-09-20 12:42:54.889][909][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4095lb # [ 16.672850] envoy[909]: [2026-09-20 12:42:54.889][909][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4096lb # [ 16.680792] envoy[909]: [2026-09-20 12:42:54.889][909][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4097lb # [ 16.723947] envoy[909]: [2026-09-20 12:42:55.022][909][info][main] [source/server/server.cc:968] runtime: {}4098lb # [ 16.731877] envoy[909]: [2026-09-20 12:42:55.030][909][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4099lb # [ 16.734095] envoy[909]: [2026-09-20 12:42:55.032][909][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014100lb # [ 16.737127] envoy[909]: [2026-09-20 12:42:55.035][909][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014101lb # [ 16.740647] envoy[909]: [2026-09-20 12:42:55.039][909][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4102lb # [ 16.742313] envoy[909]: [2026-09-20 12:42:55.040][909][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4103lb # [ 16.743895] envoy[909]: [2026-09-20 12:42:55.040][909][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4104lb # [ 16.801545] envoy[909]: [2026-09-20 12:42:55.100][909][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4105worker1 # [ 16.791310] systemd[1]: Starting Nix worker-protocol over gRPC...4106worker2 # [ 16.820428] systemd[1]: Reached target Network is Online.4107worker2 # [ 16.829222] systemd[1]: Starting scheduler-token.service...4108lb # [ 16.829733] envoy[909]: [2026-09-20 12:42:55.128][909][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4109lb # [ 16.832447] envoy[909]: [2026-09-20 12:42:55.131][909][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4110lb # [ 16.835444] envoy[909]: [2026-09-20 12:42:55.131][909][info][main] [source/server/server.cc:1077] starting main dispatch loop4111worker2 # [ 16.959123] systemd[1]: scheduler-token.service: Deactivated successfully.4112worker2 # [ 16.960789] systemd[1]: Finished scheduler-token.service.4113worker2 # [ 16.962077] systemd[1]: scheduler-token.service: Consumed 39ms CPU time over 130ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4114worker2 # [ 16.968132] systemd[1]: Starting Nix worker-protocol over gRPC...4115worker1 # [ 17.018609] nix-grpc-daemon[784]: ts=2026-09-20T12:42:55Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4116worker1 # [ 17.028393] nix-grpc-daemon[784]: ts=2026-09-20T12:42:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4117worker1 # [ 17.034604] nix-grpc-daemon[784]: ts=2026-09-20T12:42:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14118worker1 # [ 17.085977] nix-grpc-daemon[784]: ts=2026-09-20T12:42:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4119worker1 # [ 17.089329] systemd[1]: Started Nix worker-protocol over gRPC.4120worker1 # [ 17.143676] nix-grpc-daemon[784]: ts=2026-09-20T12:42:55Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4121lb # [ 17.158704] envoy[909]: [2026-09-20 12:42:55.457][909][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4122worker2 # [ 17.181611] nix-grpc-daemon[789]: ts=2026-09-20T12:42:55Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4123lb # [ 17.163231] envoy[909]: [2026-09-20 12:42:55.461][909][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4124lb # [ 17.167561] envoy[909]: [2026-09-20 12:42:55.461][909][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4125worker2 # [ 17.190201] nix-grpc-daemon[789]: ts=2026-09-20T12:42:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4126lb # [ 17.172924] envoy[909]: [2026-09-20 12:42:55.466][909][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4127worker2 # [ 17.195942] nix-grpc-daemon[789]: ts=2026-09-20T12:42:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14128worker2 # [ 17.241965] nix-grpc-daemon[789]: ts=2026-09-20T12:42:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4129worker2 # [ 17.247401] systemd[1]: Started Nix worker-protocol over gRPC.4130worker2 # [ 17.313161] nix-grpc-daemon[789]: ts=2026-09-20T12:42:55Z level=info event=scheduler_connected addr=lb:500514131worker2 # [ 17.329249] nix-grpc-daemon[789]: ts=2026-09-20T12:42:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4132worker1 # [ 17.344811] nix-grpc-daemon[784]: ts=2026-09-20T12:42:55Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4133worker2 # [ 17.532651] nix-grpc-daemon[789]: ts=2026-09-20T12:42:55Z level=info event=scheduler_connected addr=lb:500514134worker2 # [ 17.534828] nix-grpc-daemon[789]: ts=2026-09-20T12:42:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4135worker2 # [ 17.735814] nix-grpc-daemon[789]: ts=2026-09-20T12:42:56Z level=info event=scheduler_connected addr=lb:500514136worker2 # [ 17.737830] nix-grpc-daemon[789]: ts=2026-09-20T12:42:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4137worker1 # [ 17.745337] nix-grpc-daemon[784]: ts=2026-09-20T12:42:56Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4138worker2 # [ 17.939303] nix-grpc-daemon[789]: ts=2026-09-20T12:42:56Z level=info event=scheduler_connected addr=lb:500514139worker2 # [ 17.941633] nix-grpc-daemon[789]: ts=2026-09-20T12:42:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4140worker2 # [ 18.142994] nix-grpc-daemon[789]: ts=2026-09-20T12:42:56Z level=info event=scheduler_connected addr=lb:500514141worker2 # [ 18.145601] nix-grpc-daemon[789]: ts=2026-09-20T12:42:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4142worker2 # [ 18.348308] nix-grpc-daemon[789]: ts=2026-09-20T12:42:56Z level=info event=scheduler_connected addr=lb:500514143worker2 # [ 18.350249] nix-grpc-daemon[789]: ts=2026-09-20T12:42:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4144worker2 # [ 18.549820] nix-grpc-daemon[789]: ts=2026-09-20T12:42:56Z level=info event=scheduler_connected addr=lb:500514145worker2 # [ 18.552572] nix-grpc-daemon[789]: ts=2026-09-20T12:42:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4146worker1 # [ 18.550664] nix-grpc-daemon[784]: ts=2026-09-20T12:42:56Z level=info event=scheduler_connected addr=lb:500514147worker1 # [ 18.553238] nix-grpc-daemon[784]: ts=2026-09-20T12:42:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4148worker2 # [ 18.753685] nix-grpc-daemon[789]: ts=2026-09-20T12:42:57Z level=info event=scheduler_connected addr=lb:500514149worker2 # [ 18.755654] nix-grpc-daemon[789]: ts=2026-09-20T12:42:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4150worker1 # [ 18.754364] nix-grpc-daemon[784]: ts=2026-09-20T12:42:57Z level=info event=scheduler_connected addr=lb:500514151worker1 # [ 18.757345] nix-grpc-daemon[784]: ts=2026-09-20T12:42:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4152worker2 # [ 18.956920] nix-grpc-daemon[789]: ts=2026-09-20T12:42:57Z level=info event=scheduler_connected addr=lb:500514153worker2 # [ 18.959035] nix-grpc-daemon[789]: ts=2026-09-20T12:42:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4154worker1 # [ 18.958277] nix-grpc-daemon[784]: ts=2026-09-20T12:42:57Z level=info event=scheduler_connected addr=lb:500514155worker1 # [ 18.961212] nix-grpc-daemon[784]: ts=2026-09-20T12:42:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4156worker2 # [ 19.160751] nix-grpc-daemon[789]: ts=2026-09-20T12:42:57Z level=info event=scheduler_connected addr=lb:500514157worker2 # [ 19.163581] nix-grpc-daemon[789]: ts=2026-09-20T12:42:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4158worker1 # [ 19.161886] nix-grpc-daemon[784]: ts=2026-09-20T12:42:57Z level=info event=scheduler_connected addr=lb:500514159worker1 # [ 19.164714] nix-grpc-daemon[784]: ts=2026-09-20T12:42:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4160worker2 # [ 19.365924] nix-grpc-daemon[789]: ts=2026-09-20T12:42:57Z level=info event=scheduler_connected addr=lb:500514161worker2 # [ 19.367919] nix-grpc-daemon[789]: ts=2026-09-20T12:42:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4162worker1 # [ 19.365776] nix-grpc-daemon[784]: ts=2026-09-20T12:42:57Z level=info event=scheduler_connected addr=lb:500514163worker1 # [ 19.368559] nix-grpc-daemon[784]: ts=2026-09-20T12:42:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4164worker2 # [ 19.567491] nix-grpc-daemon[789]: ts=2026-09-20T12:42:57Z level=info event=scheduler_connected addr=lb:500514165worker2 # [ 19.571739] nix-grpc-daemon[789]: ts=2026-09-20T12:42:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4166worker1 # [ 19.571702] nix-grpc-daemon[784]: ts=2026-09-20T12:42:57Z level=info event=scheduler_connected addr=lb:500514167worker1 # [ 19.573165] nix-grpc-daemon[784]: ts=2026-09-20T12:42:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4168worker2 # [ 19.772643] nix-grpc-daemon[789]: ts=2026-09-20T12:42:58Z level=info event=scheduler_connected addr=lb:500514169worker2 # [ 19.774569] nix-grpc-daemon[789]: ts=2026-09-20T12:42:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4170worker1 # [ 19.772698] nix-grpc-daemon[784]: ts=2026-09-20T12:42:58Z level=info event=scheduler_connected addr=lb:500514171worker1 # [ 19.776897] nix-grpc-daemon[784]: ts=2026-09-20T12:42:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4172worker2 # [ 19.975968] nix-grpc-daemon[789]: ts=2026-09-20T12:42:58Z level=info event=scheduler_connected addr=lb:500514173worker2 # [ 19.978242] nix-grpc-daemon[789]: ts=2026-09-20T12:42:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4174worker1 # [ 19.977878] nix-grpc-daemon[784]: ts=2026-09-20T12:42:58Z level=info event=scheduler_connected addr=lb:500514175worker1 # [ 19.980689] nix-grpc-daemon[784]: ts=2026-09-20T12:42:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4176worker2 # [ 20.179383] nix-grpc-daemon[789]: ts=2026-09-20T12:42:58Z level=info event=scheduler_connected addr=lb:500514177worker2 # [ 20.181666] nix-grpc-daemon[789]: ts=2026-09-20T12:42:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4178worker1 # [ 20.181706] nix-grpc-daemon[784]: ts=2026-09-20T12:42:58Z level=info event=scheduler_connected addr=lb:500514179worker1 # [ 20.184788] nix-grpc-daemon[784]: ts=2026-09-20T12:42:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4180worker2 # [ 20.383316] nix-grpc-daemon[789]: ts=2026-09-20T12:42:58Z level=info event=scheduler_connected addr=lb:500514181worker2 # [ 20.385203] nix-grpc-daemon[789]: ts=2026-09-20T12:42:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4182worker1 # [ 20.385826] nix-grpc-daemon[784]: ts=2026-09-20T12:42:58Z level=info event=scheduler_connected addr=lb:500514183worker1 # [ 20.388509] nix-grpc-daemon[784]: ts=2026-09-20T12:42:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4184worker2 # [ 20.586953] nix-grpc-daemon[789]: ts=2026-09-20T12:42:58Z level=info event=scheduler_connected addr=lb:500514185worker2 # [ 20.591697] nix-grpc-daemon[789]: ts=2026-09-20T12:42:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4186worker1 # [ 20.590796] nix-grpc-daemon[784]: ts=2026-09-20T12:42:58Z level=info event=scheduler_connected addr=lb:500514187worker1 # [ 20.592566] nix-grpc-daemon[784]: ts=2026-09-20T12:42:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4188worker2 # [ 20.792609] nix-grpc-daemon[789]: ts=2026-09-20T12:42:59Z level=info event=scheduler_connected addr=lb:500514189worker2 # [ 20.794572] nix-grpc-daemon[789]: ts=2026-09-20T12:42:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4190worker1 # [ 20.791614] nix-grpc-daemon[784]: ts=2026-09-20T12:42:59Z level=info event=scheduler_connected addr=lb:500514191worker1 # [ 20.794211] nix-grpc-daemon[784]: ts=2026-09-20T12:42:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4192worker2 # [ 20.995647] nix-grpc-daemon[789]: ts=2026-09-20T12:42:59Z level=info event=scheduler_connected addr=lb:500514193worker2 # [ 20.997572] nix-grpc-daemon[789]: ts=2026-09-20T12:42:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4194worker1 # [ 20.995274] nix-grpc-daemon[784]: ts=2026-09-20T12:42:59Z level=info event=scheduler_connected addr=lb:500514195worker1 # [ 20.997831] nix-grpc-daemon[784]: ts=2026-09-20T12:42:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4196worker2 # [ 21.198920] nix-grpc-daemon[789]: ts=2026-09-20T12:42:59Z level=info event=scheduler_connected addr=lb:500514197worker2 # [ 21.201389] nix-grpc-daemon[789]: ts=2026-09-20T12:42:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4198worker1 # [ 21.198366] nix-grpc-daemon[784]: ts=2026-09-20T12:42:59Z level=info event=scheduler_connected addr=lb:500514199worker1 # [ 21.200290] nix-grpc-daemon[784]: ts=2026-09-20T12:42:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4200worker2 # [ 21.403952] nix-grpc-daemon[789]: ts=2026-09-20T12:42:59Z level=info event=scheduler_connected addr=lb:500514201worker2 # [ 21.405898] nix-grpc-daemon[789]: ts=2026-09-20T12:42:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4202worker1 # [ 21.401421] nix-grpc-daemon[784]: ts=2026-09-20T12:42:59Z level=info event=scheduler_connected addr=lb:500514203worker1 # [ 21.403758] nix-grpc-daemon[784]: ts=2026-09-20T12:42:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4204worker2 # [ 21.605687] nix-grpc-daemon[789]: ts=2026-09-20T12:42:59Z level=info event=scheduler_connected addr=lb:500514205worker2 # [ 21.608074] nix-grpc-daemon[789]: ts=2026-09-20T12:42:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4206worker1 # [ 21.606436] nix-grpc-daemon[784]: ts=2026-09-20T12:42:59Z level=info event=scheduler_connected addr=lb:500514207worker1 # [ 21.608264] nix-grpc-daemon[784]: ts=2026-09-20T12:42:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4208worker2 # [ 21.809278] nix-grpc-daemon[789]: ts=2026-09-20T12:43:00Z level=info event=scheduler_connected addr=lb:500514209worker2 # [ 21.811930] nix-grpc-daemon[789]: ts=2026-09-20T12:43:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4210worker1 # [ 21.807765] nix-grpc-daemon[784]: ts=2026-09-20T12:43:00Z level=info event=scheduler_connected addr=lb:500514211worker1 # [ 21.810258] nix-grpc-daemon[784]: ts=2026-09-20T12:43:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4212worker2 # [ 22.013355] nix-grpc-daemon[789]: ts=2026-09-20T12:43:00Z level=info event=scheduler_connected addr=lb:500514213worker2 # [ 22.015715] nix-grpc-daemon[789]: ts=2026-09-20T12:43:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4214worker1 # [ 22.009601] nix-grpc-daemon[784]: ts=2026-09-20T12:43:00Z level=info event=scheduler_connected addr=lb:500514215worker1 # [ 22.012235] nix-grpc-daemon[784]: ts=2026-09-20T12:43:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4216worker2 # [ 22.217312] nix-grpc-daemon[789]: ts=2026-09-20T12:43:00Z level=info event=scheduler_connected addr=lb:500514217worker2 # [ 22.219900] nix-grpc-daemon[789]: ts=2026-09-20T12:43:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4218worker1 # [ 22.213170] nix-grpc-daemon[784]: ts=2026-09-20T12:43:00Z level=info event=scheduler_connected addr=lb:500514219worker1 # [ 22.215745] nix-grpc-daemon[784]: ts=2026-09-20T12:43:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4220worker2 # [ 22.422616] nix-grpc-daemon[789]: ts=2026-09-20T12:43:00Z level=info event=scheduler_connected addr=lb:500514221worker2 # [ 22.424542] nix-grpc-daemon[789]: ts=2026-09-20T12:43:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4222worker1 # [ 22.416669] nix-grpc-daemon[784]: ts=2026-09-20T12:43:00Z level=info event=scheduler_connected addr=lb:500514223worker1 # [ 22.419241] nix-grpc-daemon[784]: ts=2026-09-20T12:43:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4224worker2 # [ 22.626155] nix-grpc-daemon[789]: ts=2026-09-20T12:43:00Z level=info event=scheduler_connected addr=lb:500514225worker2 # [ 22.628805] nix-grpc-daemon[789]: ts=2026-09-20T12:43:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4226worker1 # [ 22.621525] nix-grpc-daemon[784]: ts=2026-09-20T12:43:00Z level=info event=scheduler_connected addr=lb:500514227worker1 # [ 22.623389] nix-grpc-daemon[784]: ts=2026-09-20T12:43:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4228worker2 # [ 22.830453] nix-grpc-daemon[789]: ts=2026-09-20T12:43:01Z level=info event=scheduler_connected addr=lb:500514229worker2 # [ 22.834759] nix-grpc-daemon[789]: ts=2026-09-20T12:43:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4230worker1 # [ 22.822315] nix-grpc-daemon[784]: ts=2026-09-20T12:43:01Z level=info event=scheduler_connected addr=lb:500514231worker1 # [ 22.826058] nix-grpc-daemon[784]: ts=2026-09-20T12:43:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4232worker2 # [ 23.036262] nix-grpc-daemon[789]: ts=2026-09-20T12:43:01Z level=info event=scheduler_connected addr=lb:500514233worker2 # [ 23.039605] nix-grpc-daemon[789]: ts=2026-09-20T12:43:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4234worker1 # [ 23.026954] nix-grpc-daemon[784]: ts=2026-09-20T12:43:01Z level=info event=scheduler_connected addr=lb:500514235worker1 # [ 23.031664] nix-grpc-daemon[784]: ts=2026-09-20T12:43:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4236worker2 # [ 23.241077] nix-grpc-daemon[789]: ts=2026-09-20T12:43:01Z level=info event=scheduler_connected addr=lb:500514237worker2 # [ 23.243725] nix-grpc-daemon[789]: ts=2026-09-20T12:43:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4238worker1 # [ 23.232384] nix-grpc-daemon[784]: ts=2026-09-20T12:43:01Z level=info event=scheduler_connected addr=lb:500514239worker1 # [ 23.235245] nix-grpc-daemon[784]: ts=2026-09-20T12:43:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4240worker2 # [ 23.446221] nix-grpc-daemon[789]: ts=2026-09-20T12:43:01Z level=info event=scheduler_connected addr=lb:500514241worker2 # [ 23.448124] nix-grpc-daemon[789]: ts=2026-09-20T12:43:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4242worker1 # [ 23.436261] nix-grpc-daemon[784]: ts=2026-09-20T12:43:01Z level=info event=scheduler_connected addr=lb:500514243worker1 # [ 23.438885] nix-grpc-daemon[784]: ts=2026-09-20T12:43:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4244worker2 # [ 23.647821] nix-grpc-daemon[789]: ts=2026-09-20T12:43:01Z level=info event=scheduler_connected addr=lb:500514245worker2 # [ 23.650507] nix-grpc-daemon[789]: ts=2026-09-20T12:43:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4246worker1 # [ 23.641072] nix-grpc-daemon[784]: ts=2026-09-20T12:43:01Z level=info event=scheduler_connected addr=lb:500514247worker1 # [ 23.643362] nix-grpc-daemon[784]: ts=2026-09-20T12:43:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4248worker2 # [ 23.851847] nix-grpc-daemon[789]: ts=2026-09-20T12:43:02Z level=info event=scheduler_connected addr=lb:500514249worker2 # [ 23.854611] nix-grpc-daemon[789]: ts=2026-09-20T12:43:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4250worker1 # [ 23.842193] nix-grpc-daemon[784]: ts=2026-09-20T12:43:02Z level=info event=scheduler_connected addr=lb:500514251worker1 # [ 23.844847] nix-grpc-daemon[784]: ts=2026-09-20T12:43:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4252worker2 # [ 24.055931] nix-grpc-daemon[789]: ts=2026-09-20T12:43:02Z level=info event=scheduler_connected addr=lb:500514253worker2 # [ 24.058427] nix-grpc-daemon[789]: ts=2026-09-20T12:43:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4254worker1 # [ 24.046148] nix-grpc-daemon[784]: ts=2026-09-20T12:43:02Z level=info event=scheduler_connected addr=lb:500514255worker1 # [ 24.048840] nix-grpc-daemon[784]: ts=2026-09-20T12:43:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4256worker2 # [ 24.259568] nix-grpc-daemon[789]: ts=2026-09-20T12:43:02Z level=info event=scheduler_connected addr=lb:500514257worker2 # [ 24.262288] nix-grpc-daemon[789]: ts=2026-09-20T12:43:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4258worker1 # [ 24.249602] nix-grpc-daemon[784]: ts=2026-09-20T12:43:02Z level=info event=scheduler_connected addr=lb:500514259worker1 # [ 24.252214] nix-grpc-daemon[784]: ts=2026-09-20T12:43:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4260worker2 # [ 24.464520] nix-grpc-daemon[789]: ts=2026-09-20T12:43:02Z level=info event=scheduler_connected addr=lb:500514261worker2 # [ 24.466670] nix-grpc-daemon[789]: ts=2026-09-20T12:43:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4262worker1 # [ 24.453058] nix-grpc-daemon[784]: ts=2026-09-20T12:43:02Z level=info event=scheduler_connected addr=lb:500514263worker1 # [ 24.455869] nix-grpc-daemon[784]: ts=2026-09-20T12:43:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4264worker2 # [ 24.667704] nix-grpc-daemon[789]: ts=2026-09-20T12:43:02Z level=info event=scheduler_connected addr=lb:500514265worker2 # [ 24.670228] nix-grpc-daemon[789]: ts=2026-09-20T12:43:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4266worker1 # [ 24.658252] nix-grpc-daemon[784]: ts=2026-09-20T12:43:02Z level=info event=scheduler_connected addr=lb:500514267worker1 # [ 24.660190] nix-grpc-daemon[784]: ts=2026-09-20T12:43:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4268worker2 # [ 24.871214] nix-grpc-daemon[789]: ts=2026-09-20T12:43:03Z level=info event=scheduler_connected addr=lb:500514269worker2 # [ 24.873141] nix-grpc-daemon[789]: ts=2026-09-20T12:43:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4270worker1 # [ 24.859082] nix-grpc-daemon[784]: ts=2026-09-20T12:43:03Z level=info event=scheduler_connected addr=lb:500514271worker1 # [ 24.861626] nix-grpc-daemon[784]: ts=2026-09-20T12:43:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4272worker2 # [ 25.074149] nix-grpc-daemon[789]: ts=2026-09-20T12:43:03Z level=info event=scheduler_connected addr=lb:500514273worker2 # [ 25.076256] nix-grpc-daemon[789]: ts=2026-09-20T12:43:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4274worker1 # [ 25.062674] nix-grpc-daemon[784]: ts=2026-09-20T12:43:03Z level=info event=scheduler_connected addr=lb:500514275worker1 # [ 25.065339] nix-grpc-daemon[784]: ts=2026-09-20T12:43:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4276worker2 # [ 25.277635] nix-grpc-daemon[789]: ts=2026-09-20T12:43:03Z level=info event=scheduler_connected addr=lb:500514277worker2 # [ 25.280318] nix-grpc-daemon[789]: ts=2026-09-20T12:43:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4278worker1 # [ 25.266457] nix-grpc-daemon[784]: ts=2026-09-20T12:43:03Z level=info event=scheduler_connected addr=lb:500514279worker1 # [ 25.269250] nix-grpc-daemon[784]: ts=2026-09-20T12:43:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4280worker2 # [ 25.481566] nix-grpc-daemon[789]: ts=2026-09-20T12:43:03Z level=info event=scheduler_connected addr=lb:500514281worker2 # [ 25.483548] nix-grpc-daemon[789]: ts=2026-09-20T12:43:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4282worker1 # [ 25.469883] nix-grpc-daemon[784]: ts=2026-09-20T12:43:03Z level=info event=scheduler_connected addr=lb:500514283worker1 # [ 25.472434] nix-grpc-daemon[784]: ts=2026-09-20T12:43:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4284worker2 # [ 25.684534] nix-grpc-daemon[789]: ts=2026-09-20T12:43:03Z level=info event=scheduler_connected addr=lb:500514285worker2 # [ 25.686616] nix-grpc-daemon[789]: ts=2026-09-20T12:43:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4286worker1 # [ 25.674584] nix-grpc-daemon[784]: ts=2026-09-20T12:43:03Z level=info event=scheduler_connected addr=lb:500514287worker1 # [ 25.676325] nix-grpc-daemon[784]: ts=2026-09-20T12:43:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4288worker2 # [ 25.887807] nix-grpc-daemon[789]: ts=2026-09-20T12:43:04Z level=info event=scheduler_connected addr=lb:500514289worker2 # [ 25.891837] nix-grpc-daemon[789]: ts=2026-09-20T12:43:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4290worker1 # [ 25.875368] nix-grpc-daemon[784]: ts=2026-09-20T12:43:04Z level=info event=scheduler_connected addr=lb:500514291worker1 # [ 25.878222] nix-grpc-daemon[784]: ts=2026-09-20T12:43:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4292worker2 # [ 26.093699] nix-grpc-daemon[789]: ts=2026-09-20T12:43:04Z level=info event=scheduler_connected addr=lb:500514293worker2 # [ 26.096471] nix-grpc-daemon[789]: ts=2026-09-20T12:43:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4294worker1 # [ 26.078486] nix-grpc-daemon[784]: ts=2026-09-20T12:43:04Z level=info event=scheduler_connected addr=lb:500514295worker1 # [ 26.080524] nix-grpc-daemon[784]: ts=2026-09-20T12:43:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4296worker2 # [ 26.297902] nix-grpc-daemon[789]: ts=2026-09-20T12:43:04Z level=info event=scheduler_connected addr=lb:500514297worker2 # [ 26.300480] nix-grpc-daemon[789]: ts=2026-09-20T12:43:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4298worker1 # [ 26.281557] nix-grpc-daemon[784]: ts=2026-09-20T12:43:04Z level=info event=scheduler_connected addr=lb:500514299worker1 # [ 26.283922] nix-grpc-daemon[784]: ts=2026-09-20T12:43:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4300lb # [ 26.311379] rustfs-bucket-start[1020]: mb s3://farm4301lb # [ 26.321756] systemd[1]: Finished rustfs-bucket.service.4302lb # [ 26.329434] systemd[1]: Starting niks3 server...4303worker2 # [ 26.502790] nix-grpc-daemon[789]: ts=2026-09-20T12:43:04Z level=info event=scheduler_connected addr=lb:500514304worker2 # [ 26.504880] nix-grpc-daemon[789]: ts=2026-09-20T12:43:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4305worker1 # [ 26.484576] nix-grpc-daemon[784]: ts=2026-09-20T12:43:04Z level=info event=scheduler_connected addr=lb:500514306worker1 # [ 26.486813] nix-grpc-daemon[784]: ts=2026-09-20T12:43:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4307lb # [ 26.559620] postgres[1039]: [1039] ERROR: relation "goose_db_version" does not exist at character 364308lb # [ 26.560879] postgres[1039]: [1039] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4309lb # [ 26.607210] niks3-server[1030]: 2026/09/20 12:43:04 OK 20241026095416_initial_model.sql (23.27ms)4310lb # [ 26.611410] niks3-server[1030]: 2026/09/20 12:43:04 OK 20251210153512_drop_unused_gin_index.sql (4.29ms)4311lb # [ 26.616755] niks3-server[1030]: 2026/09/20 12:43:04 OK 20251218171726_add_pins.sql (5.41ms)4312lb # [ 26.623151] niks3-server[1030]: 2026/09/20 12:43:04 OK 20260628120000_add_object_size_and_stats.sql (5ms)4313lb # [ 26.628427] niks3-server[1030]: 2026/09/20 12:43:04 OK 20260905000000_add_claims.sql (5.15ms)4314lb # [ 26.632813] niks3-server[1030]: 2026/09/20 12:43:04 OK 20260920000000_drop_claims.sql (4.47ms)4315lb # [ 26.634434] niks3-server[1030]: 2026/09/20 12:43:04 goose: successfully migrated database to version: 202609200000004316lb # [ 26.640887] niks3-server[1030]: 2026/09/20 12:43:04 OK 1_commit_pending_closure.sql (6.49ms)4317lb # [ 26.644097] niks3-server[1030]: 2026/09/20 12:43:04 OK 2_object_stats_trigger.sql (1.79ms)4318lb # [ 26.645843] niks3-server[1030]: 2026/09/20 12:43:04 goose: up to current file version: 24319lb # [ 26.655087] niks3-server[1030]: 2026/09/20 12:43:04 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4320worker2 # [ 26.706498] nix-grpc-daemon[789]: ts=2026-09-20T12:43:04Z level=info event=scheduler_connected addr=lb:500514321worker2 # [ 26.709137] nix-grpc-daemon[789]: ts=2026-09-20T12:43:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4322worker1 # [ 26.689083] nix-grpc-daemon[784]: ts=2026-09-20T12:43:04Z level=info event=scheduler_connected addr=lb:500514323worker1 # [ 26.690955] nix-grpc-daemon[784]: ts=2026-09-20T12:43:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4324lb # [ 26.733994] niks3-server[1030]: 2026/09/20 12:43:05 INFO Read proxy enabled — serving cache objects from S34325lb # [ 26.736384] niks3-server[1030]: 2026/09/20 12:43:05 INFO Using socket-activated listener address=0.0.0.0:57514326lb # [ 26.739569] niks3-server[1030]: 2026/09/20 12:43:05 INFO systemd watchdog enabled interval=15s4327lb # [ 26.740807] systemd[1]: Started niks3 server.4328lb # [ 26.741476] systemd[1]: Reached target Multi-User System.4329lb # [ 26.743790] systemd[1]: Startup finished in 883ms (kernel) + 4.030s (initrd) + 21.830s (userspace) = 26.743s.4330lb # [ 26.745408] niks3-server[1030]: 2026/09/20 12:43:05 INFO Starting HTTP server address=0.0.0.0:57514331lb # [ 26.756468] niks3-server[1030]: 2026/09/20 12:43:05 INFO lead: acquired remote=192.168.1.4:364944332worker2 # [ 26.779711] nix-grpc-daemon[789]: ts=2026-09-20T12:43:05Z level=info event=scheduler_take_over4333worker2 # [ 26.910817] nix-grpc-daemon[789]: ts=2026-09-20T12:43:05Z level=info event=scheduler_connected addr=lb:500514334worker2 # [ 26.913725] nix-grpc-daemon[789]: ts=2026-09-20T12:43:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4335worker1 # [ 26.889875] nix-grpc-daemon[784]: ts=2026-09-20T12:43:05Z level=info event=scheduler_connected addr=lb:500514336worker1 # [ 26.892469] nix-grpc-daemon[784]: ts=2026-09-20T12:43:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4337worker2 # [ 27.115505] nix-grpc-daemon[789]: ts=2026-09-20T12:43:05Z level=info event=scheduler_connected addr=lb:500514338worker2 # [ 27.119522] nix-grpc-daemon[789]: ts=2026-09-20T12:43:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4339worker1 # [ 27.092999] nix-grpc-daemon[784]: ts=2026-09-20T12:43:05Z level=info event=scheduler_connected addr=lb:500514340worker1 # [ 27.095280] nix-grpc-daemon[784]: ts=2026-09-20T12:43:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4341worker2 # [ 27.320185] nix-grpc-daemon[789]: ts=2026-09-20T12:43:05Z level=info event=scheduler_connected addr=lb:500514342worker1 # [ 27.295730] nix-grpc-daemon[784]: ts=2026-09-20T12:43:05Z level=info event=scheduler_connected addr=lb:500514343worker2 # [ 27.330450] nix-grpc-daemon[789]: ts=2026-09-20T12:43:05Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:557964344worker2 # [ 27.334171] nix-grpc-daemon[789]: ts=2026-09-20T12:43:05Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04345worker2 # [ 27.348335] nix-grpc-daemon[789]: ts=2026-09-20T12:43:05Z level=info event=oidc_jwks provider=mock keys=14346worker2 # [ 27.351530] nix-grpc-daemon[789]: ts=2026-09-20T12:43:05Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:557964347worker2 # [ 27.353681] nix-grpc-daemon[789]: ts=2026-09-20T12:43:05Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04348lb: (finished: waiting for unit niks3.service, in 17.23 seconds)4349lb: waiting for TCP port 5751 on localhost4350lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4351lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds)4352lb: waiting for unit envoy.service4353lb: (finished: waiting for unit envoy.service, in 0.04 seconds)4354lb: waiting for TCP port 50051 on localhost4355lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4356lb # [ 27.740102] envoy[909]: conn peer=[::1]:43250 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24357lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4358worker2 # [ 27.840835] systemd[1]: Starting scheduler-token.service...4359worker2 # [ 27.914406] systemd[1]: scheduler-token.service: Deactivated successfully.4360worker2 # [ 27.916168] systemd[1]: Finished scheduler-token.service.4361worker2 # [ 27.917730] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 76ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4362lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4363??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4364 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284365lb: must succeed: curl -sf localhost:9901/clusters4366lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4367lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.06 seconds)4368subtest: one node schedules and both builders hold a WorkerSession on it4369lb: must succeed: curl -sf localhost:9901/clusters4370lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4371worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4372worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)4373lb: must succeed: curl -sf localhost:9901/clusters4374lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4375lb: must succeed: curl -sf localhost:9901/clusters4376lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4377worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open'4378worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.04 seconds)4379(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.22 seconds)4380subtest: balancer auth: client cert, bearer token, nothing, unknown CN4381worker2 # [ 28.492814] nix-grpc-daemon[789]: ts=2026-09-20T12:43:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:558024382worker2 # [ 28.500633] systemd[1]: Started Nix Daemon.4383worker2 # [ 28.711703] nix-daemon[857]: accepted connection from pid 789, user nix-grpc-daemon (trusted)4384worker2 # [ 28.763226] nix-grpc-daemon[789]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 1/5)4385worker2 # [ 28.819224] nix-grpc-daemon[789]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 2/5)4386worker2 # [ 28.872278] nix-grpc-daemon[789]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 370 ms (attempt 3/5)4387worker2 # [ 29.247963] nix-grpc-daemon[789]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 433 ms (attempt 4/5)4388worker2 # [ 29.688244] nix-grpc-daemon[789]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4389worker1 # [ 29.694393] nix-grpc-daemon[784]: ts=2026-09-20T12:43:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:438804390worker1 # [ 29.701445] systemd[1]: Started Nix Daemon.4391worker1 # [ 29.927424] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4392worker1 # [ 29.964890] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 6 ms (attempt 1/5)4393worker1 # [ 29.973442] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 2/5)4394worker1 # [ 30.015822] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 374 ms (attempt 3/5)4395worker1 # [ 30.392681] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 472 ms (attempt 4/5)4396worker1 # [ 30.874743] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4397worker1 # [ 30.891275] nix-grpc-daemon[784]: ts=2026-09-20T12:43:09Z level=debug event=path_info_miss path=4mswv1w7crl5njwzp9d41jjig5l256xq-nixos-system-client-test error="error: path '/nix/store/4mswv1w7crl5njwzp9d41jjig5l256xq-nixos-system-client-test' is required, but there is no substituter that can build it"4398worker2 # [ 30.937608] nix-grpc-daemon[789]: ts=2026-09-20T12:43:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:558024399worker2 # [ 30.952787] nix-grpc-daemon[789]: ts=2026-09-20T12:43:09Z level=debug event=path_info_miss path=4mswv1w7crl5njwzp9d41jjig5l256xq-nixos-system-client-test error="error: path '/nix/store/4mswv1w7crl5njwzp9d41jjig5l256xq-nixos-system-client-test' is required, but there is no substituter that can build it"4400client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4401client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.07 seconds)4402client: must succeed: install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4403client: (finished: must succeed: install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4404worker2 # [ 31.265872] nix-grpc-daemon[789]: ts=2026-09-20T12:43:09Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:558024405worker2 # [ 31.277471] nix-grpc-daemon[789]: ts=2026-09-20T12:43:09Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:558024406worker2 # [ 31.284486] nix-grpc-daemon[789]: ts=2026-09-20T12:43:09Z level=debug event=path_info_miss path=4mswv1w7crl5njwzp9d41jjig5l256xq-nixos-system-client-test error="error: path '/nix/store/4mswv1w7crl5njwzp9d41jjig5l256xq-nixos-system-client-test' is required, but there is no substituter that can build it"4407worker2 # [ 31.290730] nix-grpc-daemon[789]: ts=2026-09-20T12:43:09Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:558024408worker2 # [ 31.296186] nix-grpc-daemon[789]: ts=2026-09-20T12:43:09Z level=debug event=path_info_miss path=4mswv1w7crl5njwzp9d41jjig5l256xq-nixos-system-client-test error="error: path '/nix/store/4mswv1w7crl5njwzp9d41jjig5l256xq-nixos-system-client-test' is required, but there is no substituter that can build it"4409client: must succeed: rm -r /var/lib/nix-grpc-store4410client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4411worker1 # [ 31.496244] nix-grpc-daemon[784]: ts=2026-09-20T12:43:09Z level=info event=denied method=QueryMissing cn=- role=none4412worker2 # [ 31.757951] nix-grpc-daemon[789]: ts=2026-09-20T12:43:10Z level=info event=denied method=QueryMissing cn=stranger role=none4413(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.58 seconds)4414subtest: DAG build is scheduled across workers and lands in the cache4415client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24416worker2 # [ 31.990746] nix-grpc-daemon[789]: ts=2026-09-20T12:43:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:558024417client # don't know how to build these paths:4418client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4419worker1 # [ 31.976534] nix-grpc-daemon[784]: ts=2026-09-20T12:43:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438804420worker2 # [ 32.033750] nix-grpc-daemon[789]: ts=2026-09-20T12:43:10Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04421worker2 # [ 32.036358] nix-grpc-daemon[789]: ts=2026-09-20T12:43:10Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=14422worker1 # [ 32.056833] nix-grpc-daemon[784]: ts=2026-09-20T12:43:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438804423worker1 # [ 32.071460] nix-grpc-daemon[784]: ts=2026-09-20T12:43:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438804424client # copying 1 paths to 'lb:50051'...4425worker1 # [ 32.078927] nix-grpc-daemon[784]: ts=2026-09-20T12:43:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:438804426client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4427worker1 # [ 32.094919] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4428worker1 # [ 32.113756] nix-grpc-daemon[784]: ts=2026-09-20T12:43:10Z level=info event=niks3_push_started pid=8514429worker1 # [ 32.441271] nix-grpc-daemon[851]: time=2026-09-20T12:43:10.709Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""4430worker1 # [ 32.668455] nix-daemon[842]: accepted connection from pid 863, user nix-grpc-daemon (trusted)4431worker1 # [ 32.692218] nix-daemon[842]: reaped child process 867, status = succeeded4432worker1 # [ 32.859531] nix-daemon[842]: accepted connection from pid 869, user nix-grpc-daemon (trusted)4433worker1 # [ 32.876416] nix-daemon[842]: reaped child process 872, status = succeeded4434lb # [ 32.905318] niks3-server[1030]: 2026/09/20 12:43:11 INFO Received uploads request method=POST path=/api/pending_closures4435worker1 # [ 32.912066] nix-grpc-daemon[851]: time=2026-09-20T12:43:11.184Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4436worker1 # [ 32.914683] nix-grpc-daemon[851]: time=2026-09-20T12:43:11.186Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4437lb # [ 32.961506] niks3-server[1030]: 2026/09/20 12:43:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4438lb # [ 32.972406] niks3-server[1030]: 2026/09/20 12:43:11 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4439lb # [ 32.983454] niks3-server[1030]: 2026/09/20 12:43:11 INFO Signed narinfos id=1 count=14440worker1 # [ 32.973702] nix-grpc-daemon[851]: time=2026-09-20T12:43:11.245Z level=INFO msg="Uploading 1 narinfos"4441lb # [ 32.991317] niks3-server[1030]: 2026/09/20 12:43:11 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4442lb # [ 33.000182] niks3-server[1030]: 2026/09/20 12:43:11 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4443lb # [ 33.011733] niks3-server[1030]: 2026/09/20 12:43:11 INFO Completed upload id=14444worker1 # [ 33.000065] nix-grpc-daemon[851]: time=2026-09-20T12:43:11.272Z level=INFO msg="Upload complete. (533ms)"4445worker1 # [ 33.004456] nix-grpc-daemon[784]: ts=2026-09-20T12:43:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=0 paths=1 nar_bytes_in=5044446lb # [ 33.017296] niks3-server[1030]: 2026/09/20 12:43:11 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4447worker1 # [ 33.008400] nix-grpc-daemon[784]: ts=2026-09-20T12:43:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438804448worker1 # [ 33.017242] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4449worker1 # [ 33.020234] nix-daemon[842]: reaped child process 849, status = succeeded4450client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4451worker1 # [ 33.029098] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4452client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4453client # farm-a> LOG-farm-a-t14454worker1 # [ 34.853593] nix-daemon[842]: reaped child process 876, status = succeeded4455worker1 # [ 35.043249] nix-daemon[842]: accepted connection from pid 891, user nix-grpc-daemon (trusted)4456worker1 # [ 35.060393] nix-daemon[842]: reaped child process 894, status = succeeded4457lb # [ 35.085904] niks3-server[1030]: 2026/09/20 12:43:13 INFO Received uploads request method=POST path=/api/pending_closures4458worker1 # [ 35.083502] nix-grpc-daemon[851]: time=2026-09-20T12:43:13.355Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4459worker1 # [ 35.085818] nix-grpc-daemon[851]: time=2026-09-20T12:43:13.357Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4460lb # [ 35.130406] niks3-server[1030]: 2026/09/20 12:43:13 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4461lb # [ 35.134441] niks3-server[1030]: 2026/09/20 12:43:13 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4462lb # [ 35.136968] niks3-server[1030]: 2026/09/20 12:43:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4463lb # [ 35.139994] niks3-server[1030]: 2026/09/20 12:43:13 INFO Signed narinfos id=2 count=14464worker1 # [ 35.130702] nix-grpc-daemon[851]: time=2026-09-20T12:43:13.401Z level=INFO msg="Uploading 1 narinfos"4465lb # [ 35.146485] niks3-server[1030]: 2026/09/20 12:43:13 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4466lb # [ 35.156655] niks3-server[1030]: 2026/09/20 12:43:13 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4467lb # [ 35.160216] niks3-server[1030]: 2026/09/20 12:43:13 INFO Completed upload id=24468worker1 # [ 35.149887] nix-grpc-daemon[851]: time=2026-09-20T12:43:13.421Z level=INFO msg="Upload complete. (309ms)"4469lb # [ 35.163041] niks3-server[1030]: 2026/09/20 12:43:13 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4470worker1 # [ 35.154571] nix-grpc-daemon[784]: ts=2026-09-20T12:43:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=2 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14471worker1 # [ 35.164643] nix-daemon[842]: reaped child process 874, status = succeeded4472worker2 # [ 35.208421] nix-grpc-daemon[789]: ts=2026-09-20T12:43:13Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04473worker2 # [ 35.212662] nix-grpc-daemon[789]: ts=2026-09-20T12:43:13Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=14474worker1 # [ 35.222083] nix-grpc-daemon[784]: ts=2026-09-20T12:43:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438804475worker1 # [ 35.232838] nix-grpc-daemon[784]: ts=2026-09-20T12:43:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438804476worker1 # [ 35.241350] nix-grpc-daemon[851]: time=2026-09-20T12:43:13.513Z level=INFO msg="All 1 paths already cached"4477client # copying 1 paths to 'lb:50051'...4478worker1 # [ 35.246482] nix-grpc-daemon[784]: ts=2026-09-20T12:43:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:438804479client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4480worker1 # [ 35.258063] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4481worker1 # [ 35.453643] nix-daemon[842]: accepted connection from pid 898, user nix-grpc-daemon (trusted)4482worker1 # [ 35.473276] nix-daemon[842]: reaped child process 901, status = succeeded4483worker1 # [ 35.665628] nix-daemon[842]: accepted connection from pid 904, user nix-grpc-daemon (trusted)4484worker1 # [ 35.685354] nix-daemon[842]: reaped child process 908, status = succeeded4485lb # [ 35.707338] niks3-server[1030]: 2026/09/20 12:43:14 INFO Received uploads request method=POST path=/api/pending_closures4486worker1 # [ 35.702536] nix-grpc-daemon[851]: time=2026-09-20T12:43:13.974Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4487worker1 # [ 35.704129] nix-grpc-daemon[851]: time=2026-09-20T12:43:13.974Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4488lb # [ 35.726477] niks3-server[1030]: 2026/09/20 12:43:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4489lb # [ 35.729093] niks3-server[1030]: 2026/09/20 12:43:14 INFO Signed narinfos id=3 count=14490worker1 # [ 35.719289] nix-grpc-daemon[851]: time=2026-09-20T12:43:13.990Z level=INFO msg="Uploading 1 narinfos"4491lb # [ 35.731794] niks3-server[1030]: 2026/09/20 12:43:14 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4492lb # [ 35.737299] niks3-server[1030]: 2026/09/20 12:43:14 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4493lb # [ 35.743444] niks3-server[1030]: 2026/09/20 12:43:14 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4494lb # [ 35.749156] niks3-server[1030]: 2026/09/20 12:43:14 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4495lb # [ 35.751927] niks3-server[1030]: 2026/09/20 12:43:14 INFO Completed upload id=34496worker1 # [ 35.740036] nix-grpc-daemon[851]: time=2026-09-20T12:43:14.012Z level=INFO msg="Upload complete. (469ms)"4497worker1 # [ 35.743125] nix-grpc-daemon[784]: ts=2026-09-20T12:43:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=0 paths=1 nar_bytes_in=6244498worker1 # [ 35.745817] nix-grpc-daemon[784]: ts=2026-09-20T12:43:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438804499worker1 # [ 35.752335] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4500worker1 # [ 35.758898] nix-daemon[842]: reaped child process 896, status = succeeded4501client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4502worker1 # [ 35.765616] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4503client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4504client # farm-b> LOG-farm-b-t14505worker1 # [ 36.585721] nix-daemon[842]: reaped child process 912, status = succeeded4506worker1 # [ 36.743260] nix-daemon[842]: accepted connection from pid 927, user nix-grpc-daemon (trusted)4507worker1 # [ 36.761328] nix-daemon[842]: reaped child process 930, status = succeeded4508lb # [ 36.786670] niks3-server[1030]: 2026/09/20 12:43:15 INFO Received uploads request method=POST path=/api/pending_closures4509worker1 # [ 36.782346] nix-grpc-daemon[851]: time=2026-09-20T12:43:15.053Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4510worker1 # [ 36.785732] nix-grpc-daemon[851]: time=2026-09-20T12:43:15.056Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4511lb # [ 36.812571] envoy[909]: conn peer=[2001:db8:1::1]:43830 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=25004512lb # [ 36.814764] envoy[909]: conn peer=[2001:db8:1::1]:43840 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=362 ms=414513lb # [ 36.819138] envoy[909]: conn peer=[2001:db8:1::1]:43850 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=94514lb # [ 36.821087] envoy[909]: conn peer=[2001:db8:1::1]:43866 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=114515lb # [ 36.826231] niks3-server[1030]: 2026/09/20 12:43:15 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4516lb # [ 36.834589] niks3-server[1030]: 2026/09/20 12:43:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4517lb # [ 36.839966] niks3-server[1030]: 2026/09/20 12:43:15 INFO Signed narinfos id=4 count=14518worker1 # [ 36.828432] nix-grpc-daemon[851]: time=2026-09-20T12:43:15.100Z level=INFO msg="Uploading 1 narinfos"4519lb # [ 36.841755] niks3-server[1030]: 2026/09/20 12:43:15 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4520lb # [ 36.849822] niks3-server[1030]: 2026/09/20 12:43:15 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4521lb # [ 36.857137] niks3-server[1030]: 2026/09/20 12:43:15 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4522lb # [ 36.863944] niks3-server[1030]: 2026/09/20 12:43:15 INFO Completed upload id=44523worker1 # [ 36.851737] nix-grpc-daemon[851]: time=2026-09-20T12:43:15.123Z level=INFO msg="Upload complete. (275ms)"4524lb # [ 36.866503] niks3-server[1030]: 2026/09/20 12:43:15 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4525worker1 # [ 36.855804] nix-grpc-daemon[784]: ts=2026-09-20T12:43:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14526worker2 # [ 36.895296] nix-grpc-daemon[789]: ts=2026-09-20T12:43:15Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04527worker1 # [ 36.867369] nix-daemon[842]: reaped child process 910, status = succeeded4528worker2 # [ 36.897625] nix-grpc-daemon[789]: ts=2026-09-20T12:43:15Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=14529worker1 # [ 36.911394] nix-grpc-daemon[784]: ts=2026-09-20T12:43:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438804530worker1 # [ 36.919861] nix-grpc-daemon[784]: ts=2026-09-20T12:43:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438804531worker1 # [ 36.927655] nix-grpc-daemon[851]: time=2026-09-20T12:43:15.199Z level=INFO msg="All 2 paths already cached"4532client # copying 1 paths to 'lb:50051'...4533client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4534worker1 # [ 36.933363] nix-grpc-daemon[784]: ts=2026-09-20T12:43:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:438804535worker1 # [ 36.943097] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4536worker1 # [ 37.134657] nix-daemon[842]: accepted connection from pid 934, user nix-grpc-daemon (trusted)4537worker1 # [ 37.163593] nix-daemon[842]: reaped child process 937, status = succeeded4538worker1 # [ 37.360493] nix-daemon[842]: accepted connection from pid 939, user nix-grpc-daemon (trusted)4539worker1 # [ 37.380707] nix-daemon[842]: reaped child process 942, status = succeeded4540lb # [ 37.403944] niks3-server[1030]: 2026/09/20 12:43:15 INFO Received uploads request method=POST path=/api/pending_closures4541worker1 # [ 37.399483] nix-grpc-daemon[851]: time=2026-09-20T12:43:15.671Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4542worker1 # [ 37.402615] nix-grpc-daemon[851]: time=2026-09-20T12:43:15.673Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4543lb # [ 37.435959] niks3-server[1030]: 2026/09/20 12:43:15 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4544lb # [ 37.450284] niks3-server[1030]: 2026/09/20 12:43:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4545lb # [ 37.457560] niks3-server[1030]: 2026/09/20 12:43:15 INFO Signed narinfos id=5 count=14546worker1 # [ 37.449585] nix-grpc-daemon[851]: time=2026-09-20T12:43:15.721Z level=INFO msg="Uploading 1 narinfos"4547lb # [ 37.462151] niks3-server[1030]: 2026/09/20 12:43:15 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4548lb # [ 37.476783] niks3-server[1030]: 2026/09/20 12:43:15 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4549lb # [ 37.486074] niks3-server[1030]: 2026/09/20 12:43:15 INFO Completed upload id=54550worker1 # [ 37.476918] nix-grpc-daemon[851]: time=2026-09-20T12:43:15.748Z level=INFO msg="Upload complete. (526ms)"4551lb # [ 37.488982] niks3-server[1030]: 2026/09/20 12:43:15 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4552worker1 # [ 37.480994] nix-grpc-daemon[784]: ts=2026-09-20T12:43:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=0 paths=1 nar_bytes_in=7524553worker1 # [ 37.484769] nix-grpc-daemon[784]: ts=2026-09-20T12:43:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438804554worker1 # [ 37.493100] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4555worker1 # [ 37.500960] nix-daemon[842]: reaped child process 932, status = succeeded4556client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4557worker1 # [ 37.510976] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4558client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4559client # farm-top> LOG-farm-top-t14560worker1 # [ 38.545530] nix-daemon[842]: reaped child process 946, status = succeeded4561worker1 # [ 38.739266] nix-daemon[842]: accepted connection from pid 961, user nix-grpc-daemon (trusted)4562worker1 # [ 38.764440] nix-daemon[842]: reaped child process 964, status = succeeded4563lb # [ 38.797565] niks3-server[1030]: 2026/09/20 12:43:17 INFO Received uploads request method=POST path=/api/pending_closures4564worker1 # [ 38.798775] nix-grpc-daemon[851]: time=2026-09-20T12:43:17.070Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4565worker1 # [ 38.802661] nix-grpc-daemon[851]: time=2026-09-20T12:43:17.072Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4566lb # [ 38.845904] niks3-server[1030]: 2026/09/20 12:43:17 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4567lb # [ 38.853303] niks3-server[1030]: 2026/09/20 12:43:17 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4568lb # [ 38.868884] niks3-server[1030]: 2026/09/20 12:43:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4569lb # [ 38.872678] niks3-server[1030]: 2026/09/20 12:43:17 INFO Signed narinfos id=6 count=14570worker1 # [ 38.861216] nix-grpc-daemon[851]: time=2026-09-20T12:43:17.132Z level=INFO msg="Uploading 1 narinfos"4571lb # [ 38.877645] niks3-server[1030]: 2026/09/20 12:43:17 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4572lb # [ 38.887286] niks3-server[1030]: 2026/09/20 12:43:17 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4573lb # [ 38.890972] niks3-server[1030]: 2026/09/20 12:43:17 INFO Completed upload id=64574worker1 # [ 38.881253] nix-grpc-daemon[851]: time=2026-09-20T12:43:17.153Z level=INFO msg="Upload complete. (355ms)"4575lb # [ 38.893616] niks3-server[1030]: 2026/09/20 12:43:17 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4576worker1 # [ 38.885529] nix-grpc-daemon[784]: ts=2026-09-20T12:43:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14577worker1 # [ 38.896066] nix-daemon[842]: reaped child process 944, status = succeeded4578client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 7.17 seconds)4579client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4580client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.20 seconds)4581client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4582client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4583client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4584client # copying 3 paths...4585client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4586client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4587client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4588client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.30 seconds)4589(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.75 seconds)4590subtest: repeat is answered Cached by the scheduler without building4591worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4592worker1 # finding garbage collector roots...4593worker1 # deleting specified paths...4594worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4595worker1 # deleting unused links...4596worker1 # note: hard linking is currently saving 0.0 KiB4597worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.28 seconds)4598worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4599worker2 # finding garbage collector roots...4600worker2 # deleting specified paths...4601worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4602worker2 # deleting unused links...4603worker2 # note: hard linking is currently saving 0.0 KiB4604worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.32 seconds)4605client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24606worker1 # [ 40.355355] nix-grpc-daemon[784]: ts=2026-09-20T12:43:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:438804607client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4608client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4609worker1 # [ 40.369680] nix-grpc-daemon[784]: ts=2026-09-20T12:43:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438804610worker1 # [ 40.376066] nix-grpc-daemon[851]: time=2026-09-20T12:43:18.647Z level=INFO msg="All 2 paths already cached"4611worker2 # [ 40.424208] nix-grpc-daemon[789]: ts=2026-09-20T12:43:18Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14612client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.32 seconds)4613client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4614client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.20 seconds)4615lb: must succeed: curl -sf localhost:9901/clusters4616lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4617lb: must succeed: curl -sf localhost:9901/clusters4618lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4619worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4620worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4621(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.34 seconds)4622subtest: inputs already in the cache are not sent to the scheduler4623lb: must succeed: curl -sf localhost:9901/clusters4624lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4625lb: must succeed: curl -sf localhost:9901/clusters4626lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4627worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4628worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.03 seconds)4629client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&24630client # don't know how to build these paths:4631client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4632worker2 # [ 41.173125] nix-grpc-daemon[789]: ts=2026-09-20T12:43:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:558024633worker2 # [ 41.177048] nix-grpc-daemon[789]: ts=2026-09-20T12:43:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:558024634worker2 # [ 41.193049] nix-grpc-daemon[789]: ts=2026-09-20T12:43:19Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04635worker2 # [ 41.195655] nix-grpc-daemon[789]: ts=2026-09-20T12:43:19Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=14636worker1 # [ 41.208315] nix-grpc-daemon[784]: ts=2026-09-20T12:43:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438804637worker1 # [ 41.217241] nix-grpc-daemon[784]: ts=2026-09-20T12:43:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438804638worker1 # [ 41.226773] nix-grpc-daemon[851]: time=2026-09-20T12:43:19.498Z level=INFO msg="All 2 paths already cached"4639client # copying 1 paths to 'lb:50051'...4640client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4641worker1 # [ 41.233144] nix-grpc-daemon[784]: ts=2026-09-20T12:43:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:438804642worker1 # [ 41.242267] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4643worker1 # [ 41.410848] nix-daemon[842]: accepted connection from pid 982, user nix-grpc-daemon (trusted)4644worker1 # [ 41.429922] nix-daemon[842]: reaped child process 985, status = succeeded4645worker1 # [ 41.594314] nix-daemon[842]: accepted connection from pid 987, user nix-grpc-daemon (trusted)4646worker1 # [ 41.610917] nix-daemon[842]: reaped child process 990, status = succeeded4647lb # [ 41.636188] niks3-server[1030]: 2026/09/20 12:43:19 INFO Received uploads request method=POST path=/api/pending_closures4648worker1 # [ 41.629232] nix-grpc-daemon[851]: time=2026-09-20T12:43:19.900Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4649worker1 # [ 41.631553] nix-grpc-daemon[851]: time=2026-09-20T12:43:19.902Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4650lb # [ 41.654827] niks3-server[1030]: 2026/09/20 12:43:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4651lb # [ 41.657234] niks3-server[1030]: 2026/09/20 12:43:19 INFO Signed narinfos id=7 count=14652worker1 # [ 41.647460] nix-grpc-daemon[851]: time=2026-09-20T12:43:19.918Z level=INFO msg="Uploading 1 narinfos"4653lb # [ 41.659488] niks3-server[1030]: 2026/09/20 12:43:19 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4654lb # [ 41.662583] niks3-server[1030]: 2026/09/20 12:43:19 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4655lb # [ 41.667575] niks3-server[1030]: 2026/09/20 12:43:19 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4656lb # [ 41.674254] niks3-server[1030]: 2026/09/20 12:43:19 INFO Completed upload id=74657worker1 # [ 41.662409] nix-grpc-daemon[851]: time=2026-09-20T12:43:19.934Z level=INFO msg="Upload complete. (410ms)"4658lb # [ 41.676078] niks3-server[1030]: 2026/09/20 12:43:19 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4659worker1 # [ 41.665918] nix-grpc-daemon[784]: ts=2026-09-20T12:43:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=0 paths=1 nar_bytes_in=7524660worker1 # [ 41.669282] nix-grpc-daemon[784]: ts=2026-09-20T12:43:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438804661worker1 # [ 41.679122] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4662worker1 # [ 41.683296] nix-daemon[842]: reaped child process 980, status = succeeded4663client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4664worker1 # [ 41.690677] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4665client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4666client # farm-top> LOG-farm-top-t1b4667worker1 # [ 42.911402] nix-daemon[842]: reaped child process 994, status = succeeded4668worker1 # [ 43.070134] nix-daemon[842]: accepted connection from pid 1010, user nix-grpc-daemon (trusted)4669worker1 # [ 43.085564] nix-daemon[842]: reaped child process 1013, status = succeeded4670lb # [ 43.109510] niks3-server[1030]: 2026/09/20 12:43:21 INFO Received uploads request method=POST path=/api/pending_closures4671worker1 # [ 43.103703] nix-grpc-daemon[851]: time=2026-09-20T12:43:21.375Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4672worker1 # [ 43.106649] nix-grpc-daemon[851]: time=2026-09-20T12:43:21.377Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4673lb # [ 43.136739] niks3-server[1030]: 2026/09/20 12:43:21 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4674lb # [ 43.140993] niks3-server[1030]: 2026/09/20 12:43:21 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4675lb # [ 43.144615] niks3-server[1030]: 2026/09/20 12:43:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4676lb # [ 43.147809] niks3-server[1030]: 2026/09/20 12:43:21 INFO Signed narinfos id=8 count=14677worker1 # [ 43.136049] nix-grpc-daemon[851]: time=2026-09-20T12:43:21.407Z level=INFO msg="Uploading 1 narinfos"4678lb # [ 43.152639] niks3-server[1030]: 2026/09/20 12:43:21 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4679lb # [ 43.157571] niks3-server[1030]: 2026/09/20 12:43:21 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4680lb # [ 43.162157] niks3-server[1030]: 2026/09/20 12:43:21 INFO Completed upload id=84681worker1 # [ 43.150201] nix-grpc-daemon[851]: time=2026-09-20T12:43:21.422Z level=INFO msg="Upload complete. (248ms)"4682lb # [ 43.164109] niks3-server[1030]: 2026/09/20 12:43:21 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4683worker1 # [ 43.153415] nix-grpc-daemon[784]: ts=2026-09-20T12:43:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14684worker1 # [ 43.161923] nix-daemon[842]: reaped child process 992, status = succeeded4685client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.21 seconds)4686client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath4687client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.18 seconds)4688lb: must succeed: curl -sf localhost:9901/clusters4689lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4690lb: must succeed: curl -sf localhost:9901/clusters4691lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4692worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4693worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.03 seconds)4694(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.66 seconds)4695subtest: two clients wanting the same drv build it once4696client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4697client # [ 43.570145] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4698client # Running as unit: dedup1.service; invocation ID: df0b0ba170f0408eaed5535df0dd5b544699client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.05 seconds)4700client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4701worker2 # [ 43.752386] nix-grpc-daemon[789]: ts=2026-09-20T12:43:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:558024702client # [ 43.754436] nix[887]: don't know how to build these paths:4703client # [ 43.755611] nix[887]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4704worker2 # [ 43.765941] nix-grpc-daemon[789]: ts=2026-09-20T12:43:22Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04705worker2 # [ 43.769542] nix-grpc-daemon[789]: ts=2026-09-20T12:43:22Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14706worker2 # [ 43.772866] nix-grpc-daemon[789]: ts=2026-09-20T12:43:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:558024707worker2 # [ 43.785136] nix-grpc-daemon[789]: ts=2026-09-20T12:43:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:558024708client # [ 43.789123] nix[887]: copying 1 paths to 'lb:50051'...4709client # [ 43.790348] nix[887]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4710worker2 # [ 43.792502] nix-grpc-daemon[789]: ts=2026-09-20T12:43:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:558024711worker2 # [ 43.801312] nix-daemon[857]: accepted connection from pid 789, user nix-grpc-daemon (trusted)4712worker2 # [ 43.817085] nix-grpc-daemon[789]: ts=2026-09-20T12:43:22Z level=info event=niks3_push_started pid=9094713worker2 # [ 44.053658] nix-grpc-daemon[909]: time=2026-09-20T12:43:22.317Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""4714worker2 # [ 44.231468] nix-daemon[857]: accepted connection from pid 921, user nix-grpc-daemon (trusted)4715worker2 # [ 44.250827] nix-daemon[857]: reaped child process 924, status = succeeded4716worker2 # [ 44.404741] nix-daemon[857]: accepted connection from pid 927, user nix-grpc-daemon (trusted)4717worker2 # [ 44.421189] nix-daemon[857]: reaped child process 930, status = succeeded4718lb # [ 44.414494] niks3-server[1030]: 2026/09/20 12:43:22 INFO Received uploads request method=POST path=/api/pending_closures4719worker2 # [ 44.439449] nix-grpc-daemon[909]: time=2026-09-20T12:43:22.706Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4720worker2 # [ 44.441605] nix-grpc-daemon[909]: time=2026-09-20T12:43:22.709Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4721lb # [ 44.447874] niks3-server[1030]: 2026/09/20 12:43:22 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4722lb # [ 44.456527] niks3-server[1030]: 2026/09/20 12:43:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4723lb # [ 44.461390] niks3-server[1030]: 2026/09/20 12:43:22 INFO Signed narinfos id=9 count=14724worker2 # [ 44.480490] nix-grpc-daemon[909]: time=2026-09-20T12:43:22.747Z level=INFO msg="Uploading 1 narinfos"4725lb # [ 44.470949] niks3-server[1030]: 2026/09/20 12:43:22 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4726lb # [ 44.480222] niks3-server[1030]: 2026/09/20 12:43:22 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4727lb # [ 44.486040] niks3-server[1030]: 2026/09/20 12:43:22 INFO Completed upload id=94728worker2 # [ 44.503187] nix-grpc-daemon[909]: time=2026-09-20T12:43:22.770Z level=INFO msg="Upload complete. (435ms)"4729worker2 # [ 44.505820] nix-grpc-daemon[789]: ts=2026-09-20T12:43:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55802 duration_s=0 paths=1 nar_bytes_in=4324730lb # [ 44.490583] niks3-server[1030]: 2026/09/20 12:43:22 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4731worker2 # [ 44.511306] nix-grpc-daemon[789]: ts=2026-09-20T12:43:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:558024732worker2 # [ 44.517607] nix-daemon[857]: accepted connection from pid 789, user nix-grpc-daemon (trusted)4733worker2 # [ 44.520286] nix-daemon[857]: reaped child process 907, status = succeeded4734worker2 # [ 44.527073] nix-daemon[857]: accepted connection from pid 789, user nix-grpc-daemon (trusted)4735client # [ 44.523273] nix[887]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4736client # [ 44.630973] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4737client # Running as unit: dedup2.service; invocation ID: 6804b35d8f4c4b79acf703163dec962c4738client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.06 seconds)4739worker1 # [ 44.879853] nix-grpc-daemon[784]: ts=2026-09-20T12:43:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:438804740client # [ 44.913421] nix[903]: don't know how to build these paths:4741client # [ 44.915286] nix[903]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4742worker2 # [ 44.924639] nix-grpc-daemon[789]: ts=2026-09-20T12:43:23Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04743worker2 # [ 44.932644] nix-grpc-daemon[789]: ts=2026-09-20T12:43:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:558024744client # [ 44.930831] nix[903]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4745client: must succeed: sleep 24746lb # [ 46.813398] envoy[909]: conn peer=[2001:db8:1::1]:43870 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9498 tx=3810 ms=69684747lb # [ 46.815893] envoy[909]: conn peer=[2001:db8:1::1]:42482 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=479 ms=554748lb # [ 46.817993] envoy[909]: conn peer=[2001:db8:1::1]:42498 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4152 tx=1686 ms=20214749client: (finished: must succeed: sleep 2, in 2.04 seconds)4750??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4751 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394752client: waiting for success: ! systemctl is-active dedup1 dedup24753??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4754 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394755worker2 # [ 48.160185] nix-daemon[857]: reaped child process 934, status = succeeded4756worker2 # [ 48.321774] nix-daemon[857]: accepted connection from pid 965, user nix-grpc-daemon (trusted)4757worker2 # [ 48.337353] nix-daemon[857]: reaped child process 968, status = succeeded4758lb # [ 48.337963] niks3-server[1030]: 2026/09/20 12:43:26 INFO Received uploads request method=POST path=/api/pending_closures4759worker2 # [ 48.364646] nix-grpc-daemon[909]: time=2026-09-20T12:43:26.631Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4760worker2 # [ 48.367432] nix-grpc-daemon[909]: time=2026-09-20T12:43:26.634Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4761lb # [ 48.378447] niks3-server[1030]: 2026/09/20 12:43:26 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4762lb # [ 48.387988] niks3-server[1030]: 2026/09/20 12:43:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4763lb # [ 48.392601] niks3-server[1030]: 2026/09/20 12:43:26 INFO Signed narinfos id=10 count=14764worker2 # [ 48.409792] nix-grpc-daemon[909]: time=2026-09-20T12:43:26.676Z level=INFO msg="Uploading 1 narinfos"4765lb # [ 48.398838] niks3-server[1030]: 2026/09/20 12:43:26 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4766lb # [ 48.403826] niks3-server[1030]: 2026/09/20 12:43:26 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4767lb # [ 48.412185] niks3-server[1030]: 2026/09/20 12:43:26 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4768worker2 # [ 48.435932] nix-grpc-daemon[909]: time=2026-09-20T12:43:26.703Z level=INFO msg="Upload complete. (292ms)"4769lb # [ 48.419207] niks3-server[1030]: 2026/09/20 12:43:26 INFO Completed upload id=104770lb # [ 48.422201] niks3-server[1030]: 2026/09/20 12:43:26 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4771worker2 # [ 48.441211] nix-grpc-daemon[789]: ts=2026-09-20T12:43:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55802 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14772worker2 # [ 48.444878] nix-grpc-daemon[789]: ts=2026-09-20T12:43:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55802 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14773worker2 # [ 48.451974] nix-daemon[857]: reaped child process 932, status = succeeded4774client # [ 48.474083] systemd[1]: dedup1.service: Deactivated successfully.4775client # [ 48.475995] systemd[1]: dedup1.service: Consumed 114ms CPU time over 4.905s wall clock time, 39.3M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.4776client # [ 48.479434] systemd[1]: dedup2.service: Deactivated successfully.4777client # [ 48.481291] systemd[1]: dedup2.service: Consumed 134ms CPU time over 3.850s wall clock time, 31.1M memory peak, 7.3K incoming IP traffic, 6.4K outgoing IP traffic.4778client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.10 seconds)4779client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4780client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4781worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4782worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.04 seconds)4783worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4784worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4785worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4786worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4787worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4788worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4789(finished: subtest: two clients wanting the same drv build it once, in 5.82 seconds)4790subtest: build hook: nix-daemon with builders = grpc://lb4791client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log4792client # [ 49.531719] systemd[1]: Started Nix Daemon.4793client # [ 49.716456] nix-daemon[945]: accepted connection from pid 942, user root (trusted)4794worker1 # [ 49.870307] nix-grpc-daemon[784]: ts=2026-09-20T12:43:28Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:438804795worker1 # [ 49.879513] nix-grpc-daemon[784]: ts=2026-09-20T12:43:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438804796worker2 # [ 49.924753] nix-grpc-daemon[789]: ts=2026-09-20T12:43:28Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04797worker2 # [ 49.929336] nix-grpc-daemon[789]: ts=2026-09-20T12:43:28Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=14798worker1 # [ 49.939830] nix-grpc-daemon[784]: ts=2026-09-20T12:43:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438804799worker1 # [ 49.953964] nix-grpc-daemon[784]: ts=2026-09-20T12:43:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438804800worker1 # [ 49.965383] nix-grpc-daemon[784]: ts=2026-09-20T12:43:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:438804801worker1 # [ 49.974283] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4802worker1 # [ 50.168811] nix-daemon[842]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)4803worker1 # [ 50.187416] nix-daemon[842]: reaped child process 1041, status = succeeded4804worker1 # [ 50.360456] nix-daemon[842]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)4805worker1 # [ 50.379892] nix-daemon[842]: reaped child process 1046, status = succeeded4806lb # [ 50.402779] niks3-server[1030]: 2026/09/20 12:43:28 INFO Received uploads request method=POST path=/api/pending_closures4807worker1 # [ 50.400139] nix-grpc-daemon[851]: time=2026-09-20T12:43:28.671Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4808worker1 # [ 50.402360] nix-grpc-daemon[851]: time=2026-09-20T12:43:28.673Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4809lb # [ 50.444700] niks3-server[1030]: 2026/09/20 12:43:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4810lb # [ 50.451557] niks3-server[1030]: 2026/09/20 12:43:28 INFO Signed narinfos id=11 count=14811worker1 # [ 50.443482] nix-grpc-daemon[851]: time=2026-09-20T12:43:28.715Z level=INFO msg="Uploading 1 narinfos"4812lb # [ 50.463953] niks3-server[1030]: 2026/09/20 12:43:28 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4813lb # [ 50.477705] niks3-server[1030]: 2026/09/20 12:43:28 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4814lb # [ 50.495377] niks3-server[1030]: 2026/09/20 12:43:28 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4815lb # [ 50.514520] niks3-server[1030]: 2026/09/20 12:43:28 INFO Completed upload id=114816worker1 # [ 50.502859] nix-grpc-daemon[851]: time=2026-09-20T12:43:28.774Z level=INFO msg="Upload complete. (518ms)"4817worker1 # [ 50.507198] nix-grpc-daemon[784]: ts=2026-09-20T12:43:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=0 paths=1 nar_bytes_in=5124818worker1 # [ 50.511258] nix-grpc-daemon[784]: ts=2026-09-20T12:43:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438804819worker1 # [ 50.522165] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4820lb # [ 50.534667] niks3-server[1030]: 2026/09/20 12:43:28 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4821worker1 # [ 50.535337] nix-daemon[842]: reaped child process 1036, status = succeeded4822worker1 # [ 50.542137] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4823worker1 # [ 51.972653] nix-daemon[842]: reaped child process 1050, status = succeeded4824worker1 # [ 52.151527] nix-daemon[842]: accepted connection from pid 1065, user nix-grpc-daemon (trusted)4825worker1 # [ 52.176591] nix-daemon[842]: reaped child process 1068, status = succeeded4826lb # [ 52.198685] niks3-server[1030]: 2026/09/20 12:43:30 INFO Received uploads request method=POST path=/api/pending_closures4827worker1 # [ 52.236254] nix-grpc-daemon[851]: time=2026-09-20T12:43:30.507Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4828worker1 # [ 52.241306] nix-grpc-daemon[851]: time=2026-09-20T12:43:30.510Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4829lb # [ 52.276958] niks3-server[1030]: 2026/09/20 12:43:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4830lb # [ 52.279627] niks3-server[1030]: 2026/09/20 12:43:30 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4831lb # [ 52.282818] niks3-server[1030]: 2026/09/20 12:43:30 INFO Signed narinfos id=12 count=14832worker1 # [ 52.271039] nix-grpc-daemon[851]: time=2026-09-20T12:43:30.542Z level=INFO msg="Uploading 1 narinfos"4833lb # [ 52.286613] niks3-server[1030]: 2026/09/20 12:43:30 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4834lb # [ 52.293774] niks3-server[1030]: 2026/09/20 12:43:30 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4835lb # [ 52.297432] niks3-server[1030]: 2026/09/20 12:43:30 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4836lb # [ 52.303752] niks3-server[1030]: 2026/09/20 12:43:30 INFO Completed upload id=124837lb # [ 52.306217] niks3-server[1030]: 2026/09/20 12:43:30 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4838worker1 # [ 52.293723] nix-grpc-daemon[851]: time=2026-09-20T12:43:30.565Z level=INFO msg="Upload complete. (337ms)"4839worker1 # [ 52.299319] nix-grpc-daemon[784]: ts=2026-09-20T12:43:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=14840worker2 # [ 52.332590] nix-grpc-daemon[789]: ts=2026-09-20T12:43:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:558024841worker1 # [ 52.310101] nix-daemon[842]: reaped child process 1048, status = succeeded4842worker2 # [ 52.342788] nix-grpc-daemon[789]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4843worker2 # [ 52.375253] nix-grpc-daemon[789]: ts=2026-09-20T12:43:30Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:558024844worker2 # [ 52.379173] nix-grpc-daemon[789]: ts=2026-09-20T12:43:30Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55802 duration_s=0 paths=1 nar_bytes_out=1284845worker1 # [ 52.639919] nix-grpc-daemon[784]: ts=2026-09-20T12:43:30Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:438804846worker2 # [ 52.671992] nix-grpc-daemon[789]: ts=2026-09-20T12:43:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:558024847worker2 # [ 52.679207] nix-grpc-daemon[909]: time=2026-09-20T12:43:30.946Z level=INFO msg="All 1 paths already cached"4848worker2 # [ 52.691310] nix-grpc-daemon[789]: ts=2026-09-20T12:43:30Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04849worker2 # [ 52.694137] nix-grpc-daemon[789]: ts=2026-09-20T12:43:30Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=14850worker1 # [ 52.667990] nix-grpc-daemon[784]: ts=2026-09-20T12:43:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438804851worker1 # [ 52.681333] nix-grpc-daemon[784]: ts=2026-09-20T12:43:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438804852worker1 # [ 52.693398] nix-grpc-daemon[851]: time=2026-09-20T12:43:30.965Z level=INFO msg="All 1 paths already cached"4853worker1 # [ 52.701536] nix-grpc-daemon[784]: ts=2026-09-20T12:43:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:438804854worker1 # [ 52.711446] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4855worker1 # [ 52.912591] nix-daemon[842]: accepted connection from pid 1072, user nix-grpc-daemon (trusted)4856worker1 # [ 52.932175] nix-daemon[842]: reaped child process 1075, status = succeeded4857worker1 # [ 53.104257] nix-daemon[842]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)4858worker1 # [ 53.122632] nix-daemon[842]: reaped child process 1080, status = succeeded4859lb # [ 53.149081] niks3-server[1030]: 2026/09/20 12:43:31 INFO Received uploads request method=POST path=/api/pending_closures4860worker1 # [ 53.270363] nix-grpc-daemon[851]: time=2026-09-20T12:43:31.541Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4861worker1 # [ 53.272402] nix-grpc-daemon[851]: time=2026-09-20T12:43:31.541Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4862lb # [ 53.296961] niks3-server[1030]: 2026/09/20 12:43:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4863lb # [ 53.301320] niks3-server[1030]: 2026/09/20 12:43:31 INFO Signed narinfos id=13 count=14864worker1 # [ 53.290176] nix-grpc-daemon[851]: time=2026-09-20T12:43:31.561Z level=INFO msg="Uploading 1 narinfos"4865lb # [ 53.308492] niks3-server[1030]: 2026/09/20 12:43:31 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4866lb # [ 53.314116] niks3-server[1030]: 2026/09/20 12:43:31 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4867lb # [ 53.318915] niks3-server[1030]: 2026/09/20 12:43:31 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4868lb # [ 53.325772] niks3-server[1030]: 2026/09/20 12:43:31 INFO Completed upload id=134869worker1 # [ 53.313864] nix-grpc-daemon[851]: time=2026-09-20T12:43:31.585Z level=INFO msg="Upload complete. (586ms)"4870lb # [ 53.331518] niks3-server[1030]: 2026/09/20 12:43:31 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4871worker1 # [ 53.318549] nix-grpc-daemon[784]: ts=2026-09-20T12:43:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=0 paths=1 nar_bytes_in=6244872worker1 # [ 53.323243] nix-grpc-daemon[784]: ts=2026-09-20T12:43:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438804873worker1 # [ 53.334140] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4874worker1 # [ 53.339535] nix-daemon[842]: reaped child process 1070, status = succeeded4875worker1 # [ 53.349234] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4876worker1 # [ 54.372756] nix-daemon[842]: reaped child process 1084, status = succeeded4877worker1 # [ 54.498137] nix-daemon[842]: accepted connection from pid 1099, user nix-grpc-daemon (trusted)4878worker1 # [ 54.515269] nix-daemon[842]: reaped child process 1102, status = succeeded4879lb # [ 54.536996] niks3-server[1030]: 2026/09/20 12:43:32 INFO Received uploads request method=POST path=/api/pending_closures4880worker1 # [ 54.530680] nix-grpc-daemon[851]: time=2026-09-20T12:43:32.802Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4881worker1 # [ 54.533616] nix-grpc-daemon[851]: time=2026-09-20T12:43:32.804Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4882lb # [ 54.566972] niks3-server[1030]: 2026/09/20 12:43:32 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4883lb # [ 54.569564] niks3-server[1030]: 2026/09/20 12:43:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4884lb # [ 54.574462] niks3-server[1030]: 2026/09/20 12:43:32 INFO Signed narinfos id=14 count=14885worker1 # [ 54.564733] nix-grpc-daemon[851]: time=2026-09-20T12:43:32.836Z level=INFO msg="Uploading 1 narinfos"4886lb # [ 54.578536] niks3-server[1030]: 2026/09/20 12:43:32 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4887lb # [ 54.585061] niks3-server[1030]: 2026/09/20 12:43:32 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4888lb # [ 54.591431] niks3-server[1030]: 2026/09/20 12:43:32 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4889lb # [ 54.596320] niks3-server[1030]: 2026/09/20 12:43:32 INFO Completed upload id=144890worker1 # [ 54.584447] nix-grpc-daemon[851]: time=2026-09-20T12:43:32.856Z level=INFO msg="Upload complete. (223ms)"4891lb # [ 54.599760] niks3-server[1030]: 2026/09/20 12:43:32 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4892worker1 # [ 54.588462] nix-grpc-daemon[784]: ts=2026-09-20T12:43:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=14893worker2 # [ 54.622978] nix-grpc-daemon[789]: ts=2026-09-20T12:43:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:558024894worker1 # [ 54.597061] nix-daemon[842]: reaped child process 1082, status = succeeded4895worker2 # [ 54.630280] nix-grpc-daemon[789]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4896worker2 # [ 54.648478] nix-grpc-daemon[789]: ts=2026-09-20T12:43:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:558024897worker2 # [ 54.650882] nix-grpc-daemon[789]: ts=2026-09-20T12:43:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55802 duration_s=0 paths=1 nar_bytes_out=1764898worker2 # [ 54.893683] nix-grpc-daemon[789]: ts=2026-09-20T12:43:33Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:558024899worker2 # [ 54.899915] nix-grpc-daemon[789]: ts=2026-09-20T12:43:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:558024900worker2 # [ 54.928272] nix-grpc-daemon[909]: time=2026-09-20T12:43:33.194Z level=INFO msg="All 2 paths already cached"4901worker2 # [ 54.945285] nix-grpc-daemon[789]: ts=2026-09-20T12:43:33Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04902worker2 # [ 54.949516] nix-grpc-daemon[789]: ts=2026-09-20T12:43:33Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=14903worker1 # [ 54.969985] nix-grpc-daemon[784]: ts=2026-09-20T12:43:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438804904worker1 # [ 54.979574] nix-grpc-daemon[784]: ts=2026-09-20T12:43:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438804905worker1 # [ 54.989326] nix-grpc-daemon[851]: time=2026-09-20T12:43:33.261Z level=INFO msg="All 2 paths already cached"4906worker1 # [ 54.994659] nix-grpc-daemon[784]: ts=2026-09-20T12:43:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:438804907worker1 # [ 55.001104] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4908worker1 # [ 55.146902] nix-daemon[842]: accepted connection from pid 1106, user nix-grpc-daemon (trusted)4909worker1 # [ 55.164114] nix-daemon[842]: reaped child process 1109, status = succeeded4910worker1 # [ 55.297797] nix-daemon[842]: accepted connection from pid 1111, user nix-grpc-daemon (trusted)4911worker1 # [ 55.314688] nix-daemon[842]: reaped child process 1114, status = succeeded4912lb # [ 55.336425] niks3-server[1030]: 2026/09/20 12:43:33 INFO Received uploads request method=POST path=/api/pending_closures4913worker1 # [ 55.329190] nix-grpc-daemon[851]: time=2026-09-20T12:43:33.600Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4914worker1 # [ 55.330641] nix-grpc-daemon[851]: time=2026-09-20T12:43:33.601Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4915lb # [ 55.352040] niks3-server[1030]: 2026/09/20 12:43:33 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4916lb # [ 55.356071] niks3-server[1030]: 2026/09/20 12:43:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4917lb # [ 55.359259] niks3-server[1030]: 2026/09/20 12:43:33 INFO Signed narinfos id=15 count=14918worker1 # [ 55.347722] nix-grpc-daemon[851]: time=2026-09-20T12:43:33.619Z level=INFO msg="Uploading 1 narinfos"4919lb # [ 55.362811] niks3-server[1030]: 2026/09/20 12:43:33 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4920lb # [ 55.369903] niks3-server[1030]: 2026/09/20 12:43:33 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4921lb # [ 55.374289] niks3-server[1030]: 2026/09/20 12:43:33 INFO Completed upload id=154922worker1 # [ 55.362362] nix-grpc-daemon[851]: time=2026-09-20T12:43:33.634Z level=INFO msg="Upload complete. (353ms)"4923lb # [ 55.376246] niks3-server[1030]: 2026/09/20 12:43:33 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4924worker1 # [ 55.366124] nix-grpc-daemon[784]: ts=2026-09-20T12:43:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=0 paths=1 nar_bytes_in=7524925worker1 # [ 55.369813] nix-grpc-daemon[784]: ts=2026-09-20T12:43:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438804926worker1 # [ 55.382714] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4927worker1 # [ 55.390993] nix-daemon[842]: reaped child process 1104, status = succeeded4928worker1 # [ 55.395405] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4929lb # [ 56.814254] envoy[909]: conn peer=[2001:db8:1::1]:42954 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2972 tx=1371 ms=47004930lb # [ 56.815832] envoy[909]: conn peer=[2001:db8:1::1]:42962 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1085 ms=35564931lb # [ 56.817421] envoy[909]: conn peer=[2001:db8:1::1]:42970 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3415 tx=1749 ms=25344932lb # [ 56.818972] envoy[909]: conn peer=[2001:db8:1::1]:42980 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=574933lb # [ 56.820401] envoy[909]: conn peer=[2001:db8:1::1]:42988 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3850 tx=1974 ms=20344934lb # [ 56.821818] envoy[909]: conn peer=[2001:db8:1::1]:48344 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=524935worker1 # [ 56.815726] nix-daemon[842]: reaped child process 1118, status = succeeded4936worker1 # [ 56.936434] nix-daemon[842]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)4937worker1 # [ 56.954909] nix-daemon[842]: reaped child process 1136, status = succeeded4938lb # [ 56.975629] niks3-server[1030]: 2026/09/20 12:43:35 INFO Received uploads request method=POST path=/api/pending_closures4939worker1 # [ 56.968678] nix-grpc-daemon[851]: time=2026-09-20T12:43:35.240Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4940worker1 # [ 56.970316] nix-grpc-daemon[851]: time=2026-09-20T12:43:35.242Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4941lb # [ 57.008075] niks3-server[1030]: 2026/09/20 12:43:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4942lb # [ 57.010572] niks3-server[1030]: 2026/09/20 12:43:35 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4943lb # [ 57.012955] niks3-server[1030]: 2026/09/20 12:43:35 INFO Signed narinfos id=16 count=14944worker1 # [ 57.002250] nix-grpc-daemon[851]: time=2026-09-20T12:43:35.274Z level=INFO msg="Uploading 1 narinfos"4945lb # [ 57.017869] niks3-server[1030]: 2026/09/20 12:43:35 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4946lb # [ 57.020643] niks3-server[1030]: 2026/09/20 12:43:35 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4947lb # [ 57.026258] niks3-server[1030]: 2026/09/20 12:43:35 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4948lb # [ 57.032506] niks3-server[1030]: 2026/09/20 12:43:35 INFO Completed upload id=164949worker1 # [ 57.020588] nix-grpc-daemon[851]: time=2026-09-20T12:43:35.292Z level=INFO msg="Upload complete. (211ms)"4950lb # [ 57.034498] niks3-server[1030]: 2026/09/20 12:43:35 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4951worker1 # [ 57.025298] nix-grpc-daemon[784]: ts=2026-09-20T12:43:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=14952worker1 # [ 57.033976] nix-daemon[842]: reaped child process 1116, status = succeeded4953worker2 # [ 57.100904] nix-grpc-daemon[789]: ts=2026-09-20T12:43:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:558024954worker2 # [ 57.109966] nix-grpc-daemon[789]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4955worker2 # [ 57.130876] nix-grpc-daemon[789]: ts=2026-09-20T12:43:35Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:558024956worker2 # [ 57.133699] nix-grpc-daemon[789]: ts=2026-09-20T12:43:35Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55802 duration_s=0 paths=1 nar_bytes_out=2324957client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.88 seconds)4958client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4959client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)4960client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4961client # [ 57.297622] nix-daemon[945]: reaped child process 947, status = succeeded4962client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4963client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4964client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4965(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.98 seconds)4966subtest: an input only one worker has still reaches the builder4967client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4968client # this derivation will be built:4969client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4970client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4971client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.77 seconds)4972client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4973client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.19 seconds)4974worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4975worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.19 seconds)4976worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4977worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)4978client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24979client # [ 58.709804] nix-daemon[945]: accepted connection from pid 1028, user root (trusted)4980client # this derivation will be built:4981client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4982worker2 # [ 58.893340] nix-grpc-daemon[789]: ts=2026-09-20T12:43:37Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:558024983worker1 # [ 58.867930] nix-grpc-daemon[784]: ts=2026-09-20T12:43:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438804984client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...4985worker1 # [ 59.035872] nix-daemon[842]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)4986worker1 # [ 59.050876] nix-daemon[842]: reaped child process 1146, status = succeeded4987lb # [ 59.075218] niks3-server[1030]: 2026/09/20 12:43:37 INFO Received uploads request method=POST path=/api/pending_closures4988worker1 # [ 59.068684] nix-grpc-daemon[851]: time=2026-09-20T12:43:37.340Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4989worker1 # [ 59.070167] nix-grpc-daemon[851]: time=2026-09-20T12:43:37.340Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4990lb # [ 59.091830] niks3-server[1030]: 2026/09/20 12:43:37 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4991lb # [ 59.097527] niks3-server[1030]: 2026/09/20 12:43:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4992worker1 # [ 59.089562] nix-grpc-daemon[851]: time=2026-09-20T12:43:37.361Z level=INFO msg="Uploading 1 narinfos"4993lb # [ 59.101883] niks3-server[1030]: 2026/09/20 12:43:37 INFO Signed narinfos id=17 count=14994lb # [ 59.110358] niks3-server[1030]: 2026/09/20 12:43:37 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4995lb # [ 59.302179] niks3-server[1030]: 2026/09/20 12:43:37 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4996lb # [ 59.317049] niks3-server[1030]: 2026/09/20 12:43:37 INFO Completed upload id=174997worker1 # [ 59.305275] nix-grpc-daemon[851]: time=2026-09-20T12:43:37.577Z level=INFO msg="Upload complete. (435ms)"4998lb # [ 59.320640] niks3-server[1030]: 2026/09/20 12:43:37 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4999worker2 # [ 59.347618] nix-grpc-daemon[789]: ts=2026-09-20T12:43:37Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=05000worker2 # [ 59.350319] nix-grpc-daemon[789]: ts=2026-09-20T12:43:37Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=15001worker2 # [ 59.392879] nix-grpc-daemon[789]: ts=2026-09-20T12:43:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:558025002worker2 # [ 59.400931] nix-grpc-daemon[789]: ts=2026-09-20T12:43:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:558025003client # copying 2 paths to 'lb:50051'...5004worker2 # [ 59.408209] nix-grpc-daemon[789]: ts=2026-09-20T12:43:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:558025005client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...5006client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...5007worker2 # [ 59.417342] nix-daemon[857]: accepted connection from pid 789, user nix-grpc-daemon (trusted)5008worker2 # [ 59.577392] nix-daemon[857]: accepted connection from pid 995, user nix-grpc-daemon (trusted)5009worker2 # [ 59.591957] nix-daemon[857]: reaped child process 998, status = succeeded5010worker2 # [ 59.731460] nix-daemon[857]: accepted connection from pid 1000, user nix-grpc-daemon (trusted)5011worker2 # [ 59.744528] nix-daemon[857]: reaped child process 1003, status = succeeded5012lb # [ 59.738829] niks3-server[1030]: 2026/09/20 12:43:38 INFO Received uploads request method=POST path=/api/pending_closures5013lb # [ 59.775105] niks3-server[1030]: 2026/09/20 12:43:38 INFO Received uploads request method=POST path=/api/pending_closures5014worker2 # [ 59.812762] nix-grpc-daemon[909]: time=2026-09-20T12:43:38.079Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5015worker2 # [ 59.815512] nix-grpc-daemon[909]: time=2026-09-20T12:43:38.081Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"5016worker2 # [ 59.817114] nix-grpc-daemon[909]: time=2026-09-20T12:43:38.082Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"5017lb # [ 59.831166] niks3-server[1030]: 2026/09/20 12:43:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign5018lb # [ 59.834331] niks3-server[1030]: 2026/09/20 12:43:38 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst5019lb # [ 59.840115] niks3-server[1030]: 2026/09/20 12:43:38 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst5020lb # [ 59.843039] niks3-server[1030]: 2026/09/20 12:43:38 INFO Signed narinfos id=18 count=15021lb # [ 59.845579] niks3-server[1030]: 2026/09/20 12:43:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign5022lb # [ 59.849071] niks3-server[1030]: 2026/09/20 12:43:38 INFO Signed narinfos id=19 count=25023worker2 # [ 59.866698] nix-grpc-daemon[909]: time=2026-09-20T12:43:38.133Z level=INFO msg="Uploading 3 narinfos"5024lb # [ 59.852162] niks3-server[1030]: 2026/09/20 12:43:38 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls5025lb # [ 59.869939] niks3-server[1030]: 2026/09/20 12:43:38 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls5026lb # [ 59.873689] niks3-server[1030]: 2026/09/20 12:43:38 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete5027lb # [ 59.881544] niks3-server[1030]: 2026/09/20 12:43:38 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5028lb # [ 59.911052] niks3-server[1030]: 2026/09/20 12:43:38 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5029lb # [ 59.932066] niks3-server[1030]: 2026/09/20 12:43:38 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5030lb # [ 59.953700] niks3-server[1030]: 2026/09/20 12:43:38 INFO Completed upload id=185031lb # [ 59.956257] niks3-server[1030]: 2026/09/20 12:43:38 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5032lb # [ 60.473256] niks3-server[1030]: 2026/09/20 12:43:38 INFO Completed upload id=195033worker2 # [ 60.492232] nix-grpc-daemon[909]: time=2026-09-20T12:43:38.759Z level=INFO msg="Upload complete. (1.066s)"5034worker2 # [ 60.496362] nix-grpc-daemon[789]: ts=2026-09-20T12:43:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55802 duration_s=1 paths=2 nar_bytes_in=9765035worker2 # [ 60.501211] nix-grpc-daemon[789]: ts=2026-09-20T12:43:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:558025036worker2 # [ 60.517295] nix-daemon[857]: accepted connection from pid 789, user nix-grpc-daemon (trusted)5037worker2 # [ 60.520861] nix-daemon[857]: reaped child process 993, status = succeeded5038worker2 # [ 60.534263] nix-grpc-daemon[789]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...5039client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5040client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5041worker2 # [ 60.544637] nix-daemon[857]: accepted connection from pid 789, user nix-grpc-daemon (trusted)5042worker2 # [ 61.360574] nix-daemon[857]: reaped child process 1008, status = succeeded5043worker2 # [ 61.497151] nix-daemon[857]: accepted connection from pid 1023, user nix-grpc-daemon (trusted)5044worker2 # [ 61.512296] nix-daemon[857]: reaped child process 1026, status = succeeded5045lb # [ 61.507953] niks3-server[1030]: 2026/09/20 12:43:39 INFO Received uploads request method=POST path=/api/pending_closures5046worker2 # [ 61.533348] nix-grpc-daemon[909]: time=2026-09-20T12:43:39.800Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5047lb # [ 61.532320] niks3-server[1030]: 2026/09/20 12:43:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5048lb # [ 61.537761] niks3-server[1030]: 2026/09/20 12:43:39 INFO Signed narinfos id=20 count=15049worker2 # [ 61.557319] nix-grpc-daemon[909]: time=2026-09-20T12:43:39.824Z level=INFO msg="Uploading 1 narinfos"5050lb # [ 61.540317] niks3-server[1030]: 2026/09/20 12:43:39 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5051lb # [ 61.552694] niks3-server[1030]: 2026/09/20 12:43:39 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5052lb # [ 61.561610] niks3-server[1030]: 2026/09/20 12:43:39 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5053lb # [ 61.566116] niks3-server[1030]: 2026/09/20 12:43:39 INFO Completed upload id=205054worker2 # [ 61.584907] nix-grpc-daemon[909]: time=2026-09-20T12:43:39.852Z level=INFO msg="Upload complete. (233ms)"5055lb # [ 61.569065] niks3-server[1030]: 2026/09/20 12:43:39 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5056worker2 # [ 61.588430] nix-grpc-daemon[789]: ts=2026-09-20T12:43:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55802 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=15057worker2 # [ 61.597415] nix-daemon[857]: reaped child process 1005, status = succeeded5058client # copying 1 paths...5059worker1 # [ 61.607302] nix-grpc-daemon[784]: ts=2026-09-20T12:43:39Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:438805060worker1 # [ 61.617553] nix-grpc-daemon[784]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5061client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5062worker2 # [ 61.676949] nix-grpc-daemon[789]: ts=2026-09-20T12:43:39Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:558025063worker2 # [ 61.679124] nix-grpc-daemon[789]: ts=2026-09-20T12:43:39Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55802 duration_s=0 paths=1 nar_bytes_out=1205064client # [ 61.738663] nix-daemon[945]: reaped child process 1031, status = succeeded5065client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.22 seconds)5066client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&25067client # [ 61.932120] nix-daemon[945]: accepted connection from pid 1050, user root (trusted)5068client # this derivation will be built:5069client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5070worker2 # [ 62.165734] nix-grpc-daemon[789]: ts=2026-09-20T12:43:40Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:558025071worker2 # [ 62.169211] nix-grpc-daemon[789]: ts=2026-09-20T12:43:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:558025072client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...5073worker2 # [ 62.277942] nix-grpc-daemon[909]: time=2026-09-20T12:43:40.545Z level=INFO msg="All 1 paths already cached"5074worker2 # [ 62.295589] nix-grpc-daemon[789]: ts=2026-09-20T12:43:40Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05075worker2 # [ 62.298178] nix-grpc-daemon[789]: ts=2026-09-20T12:43:40Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=15076worker1 # [ 62.272752] nix-grpc-daemon[784]: ts=2026-09-20T12:43:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438805077worker1 # [ 62.289540] nix-grpc-daemon[784]: ts=2026-09-20T12:43:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:438805078client # copying 1 paths to 'lb:50051'...5079client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5080worker1 # [ 62.310550] nix-grpc-daemon[784]: ts=2026-09-20T12:43:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:438805081worker1 # [ 62.324192] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5082worker1 # [ 62.343533] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 1/5)5083worker1 # [ 62.379992] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 118 ms (attempt 2/5)5084worker1 # [ 62.501386] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 131 ms (attempt 3/5)5085worker1 # [ 62.637210] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 378 ms (attempt 4/5)5086worker1 # [ 63.015983] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5087worker1 # [ 63.019800] nix-grpc-daemon[784]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5088worker1 # [ 63.199369] nix-daemon[842]: accepted connection from pid 1155, user nix-grpc-daemon (trusted)5089worker1 # [ 63.219576] nix-daemon[842]: reaped child process 1158, status = succeeded5090worker1 # [ 63.383354] nix-daemon[842]: accepted connection from pid 1160, user nix-grpc-daemon (trusted)5091worker1 # [ 63.401487] nix-daemon[842]: reaped child process 1163, status = succeeded5092lb # [ 63.424602] niks3-server[1030]: 2026/09/20 12:43:41 INFO Received uploads request method=POST path=/api/pending_closures5093worker1 # [ 64.013255] nix-grpc-daemon[851]: time=2026-09-20T12:43:42.284Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5094worker1 # [ 64.014744] nix-grpc-daemon[851]: time=2026-09-20T12:43:42.284Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5095lb # [ 64.042661] niks3-server[1030]: 2026/09/20 12:43:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5096lb # [ 64.046063] niks3-server[1030]: 2026/09/20 12:43:42 INFO Signed narinfos id=21 count=15097worker1 # [ 64.034364] nix-grpc-daemon[851]: time=2026-09-20T12:43:42.306Z level=INFO msg="Uploading 1 narinfos"5098lb # [ 64.055618] niks3-server[1030]: 2026/09/20 12:43:42 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5099lb # [ 64.057939] niks3-server[1030]: 2026/09/20 12:43:42 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5100lb # [ 64.071647] niks3-server[1030]: 2026/09/20 12:43:42 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5101lb # [ 64.096984] niks3-server[1030]: 2026/09/20 12:43:42 INFO Completed upload id=215102worker1 # [ 64.084714] nix-grpc-daemon[851]: time=2026-09-20T12:43:42.356Z level=INFO msg="Upload complete. (1.049s)"5103worker1 # [ 64.088554] nix-grpc-daemon[784]: ts=2026-09-20T12:43:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=1 paths=1 nar_bytes_in=5605104worker1 # [ 64.092591] nix-grpc-daemon[784]: ts=2026-09-20T12:43:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:438805105lb # [ 64.106168] niks3-server[1030]: 2026/09/20 12:43:42 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5106worker1 # [ 64.101079] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5107client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5108worker1 # [ 64.118238] nix-daemon[842]: accepted connection from pid 784, user nix-grpc-daemon (trusted)5109client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5110worker1 # [ 64.122454] nix-daemon[842]: reaped child process 1149, status = succeeded5111worker1 # [ 65.144499] nix-daemon[842]: reaped child process 1167, status = succeeded5112worker1 # [ 65.326152] nix-daemon[842]: accepted connection from pid 1182, user nix-grpc-daemon (trusted)5113worker1 # [ 65.343303] nix-daemon[842]: reaped child process 1185, status = succeeded5114lb # [ 65.367540] niks3-server[1030]: 2026/09/20 12:43:43 INFO Received uploads request method=POST path=/api/pending_closures5115worker1 # [ 65.360753] nix-grpc-daemon[851]: time=2026-09-20T12:43:43.632Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5116lb # [ 65.388851] niks3-server[1030]: 2026/09/20 12:43:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5117worker1 # [ 65.379580] nix-grpc-daemon[851]: time=2026-09-20T12:43:43.651Z level=INFO msg="Uploading 1 narinfos"5118lb # [ 65.391339] niks3-server[1030]: 2026/09/20 12:43:43 INFO Signed narinfos id=22 count=15119lb # [ 65.395245] niks3-server[1030]: 2026/09/20 12:43:43 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5120lb # [ 65.399251] niks3-server[1030]: 2026/09/20 12:43:43 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5121lb # [ 65.406637] niks3-server[1030]: 2026/09/20 12:43:43 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5122lb # [ 65.411312] niks3-server[1030]: 2026/09/20 12:43:43 INFO Completed upload id=225123worker1 # [ 65.399690] nix-grpc-daemon[851]: time=2026-09-20T12:43:43.671Z level=INFO msg="Upload complete. (266ms)"5124lb # [ 65.413296] niks3-server[1030]: 2026/09/20 12:43:43 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5125worker1 # [ 65.403580] nix-grpc-daemon[784]: ts=2026-09-20T12:43:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=15126worker1 # [ 65.412049] nix-daemon[842]: reaped child process 1165, status = succeeded5127client # copying 1 paths...5128worker1 # [ 65.448721] nix-grpc-daemon[784]: ts=2026-09-20T12:43:43Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:438805129client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5130worker1 # [ 65.463827] nix-grpc-daemon[784]: ts=2026-09-20T12:43:43Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:438805131worker1 # [ 65.467068] nix-grpc-daemon[784]: ts=2026-09-20T12:43:43Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43880 duration_s=0 paths=1 nar_bytes_out=1205132client # [ 65.595541] nix-daemon[945]: reaped child process 1053, status = succeeded5133client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.86 seconds)5134client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25135client # [ 65.795331] nix-daemon[945]: accepted connection from pid 1072, user root (trusted)5136client # this derivation will be built:5137client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5138worker2 # [ 65.962644] nix-grpc-daemon[789]: ts=2026-09-20T12:43:44Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:558025139worker2 # [ 65.966263] nix-grpc-daemon[789]: ts=2026-09-20T12:43:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:558025140client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...5141worker2 # [ 65.972616] nix-grpc-daemon[909]: time=2026-09-20T12:43:44.239Z level=INFO msg="All 1 paths already cached"5142worker2 # [ 65.984119] nix-grpc-daemon[789]: ts=2026-09-20T12:43:44Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05143worker2 # [ 65.986770] nix-grpc-daemon[789]: ts=2026-09-20T12:43:44Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15144worker2 # [ 65.990156] nix-grpc-daemon[789]: ts=2026-09-20T12:43:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:558025145worker2 # [ 65.998292] nix-grpc-daemon[789]: ts=2026-09-20T12:43:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:558025146worker2 # [ 66.008286] nix-grpc-daemon[909]: time=2026-09-20T12:43:44.275Z level=INFO msg="All 1 paths already cached"5147client # copying 1 paths to 'lb:50051'...5148client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5149worker2 # [ 66.014108] nix-grpc-daemon[789]: ts=2026-09-20T12:43:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:558025150worker2 # [ 66.021256] nix-daemon[857]: accepted connection from pid 789, user nix-grpc-daemon (trusted)5151worker2 # [ 66.164668] nix-daemon[857]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)5152worker2 # [ 66.180404] nix-daemon[857]: reaped child process 1037, status = succeeded5153worker2 # [ 66.349166] nix-daemon[857]: accepted connection from pid 1039, user nix-grpc-daemon (trusted)5154worker2 # [ 66.366105] nix-daemon[857]: reaped child process 1042, status = succeeded5155lb # [ 66.360561] niks3-server[1030]: 2026/09/20 12:43:44 INFO Received uploads request method=POST path=/api/pending_closures5156worker2 # [ 66.436524] nix-grpc-daemon[909]: time=2026-09-20T12:43:44.704Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5157worker2 # [ 66.438370] nix-grpc-daemon[909]: time=2026-09-20T12:43:44.705Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5158lb # [ 66.441375] niks3-server[1030]: 2026/09/20 12:43:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5159lb # [ 66.446246] niks3-server[1030]: 2026/09/20 12:43:44 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5160lb # [ 66.449385] niks3-server[1030]: 2026/09/20 12:43:44 INFO Signed narinfos id=23 count=15161worker2 # [ 66.470288] nix-grpc-daemon[909]: time=2026-09-20T12:43:44.737Z level=INFO msg="Uploading 1 narinfos"5162lb # [ 66.465358] niks3-server[1030]: 2026/09/20 12:43:44 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5163lb # [ 66.475540] niks3-server[1030]: 2026/09/20 12:43:44 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5164lb # [ 66.488776] niks3-server[1030]: 2026/09/20 12:43:44 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5165lb # [ 66.500666] niks3-server[1030]: 2026/09/20 12:43:44 INFO Completed upload id=235166worker2 # [ 66.520276] nix-grpc-daemon[909]: time=2026-09-20T12:43:44.787Z level=INFO msg="Upload complete. (492ms)"5167worker2 # [ 66.526396] nix-grpc-daemon[789]: ts=2026-09-20T12:43:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55802 duration_s=0 paths=1 nar_bytes_in=5605168worker2 # [ 66.532605] nix-grpc-daemon[789]: ts=2026-09-20T12:43:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:558025169worker2 # [ 66.547246] nix-daemon[857]: accepted connection from pid 789, user nix-grpc-daemon (trusted)5170worker2 # [ 66.559260] nix-daemon[857]: reaped child process 1032, status = succeeded5171client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5172client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5173worker2 # [ 66.571141] nix-daemon[857]: accepted connection from pid 789, user nix-grpc-daemon (trusted)5174lb # [ 66.814770] envoy[909]: conn peer=[2001:db8:1::1]:48356 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=535175lb # [ 66.816596] envoy[909]: conn peer=[2001:db8:1::1]:48348 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4341 tx=2197 ms=22925176lb # [ 66.818330] envoy[909]: conn peer=[2001:db8:1::1]:48362 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3841 tx=1877 ms=27945177lb # [ 66.820079] envoy[909]: conn peer=[2001:db8:1::1]:48368 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=115178lb # [ 66.821734] envoy[909]: conn peer=[2001:db8:1::1]:48372 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3719 tx=1821 ms=33835179lb # [ 66.823413] envoy[909]: conn peer=[2001:db8:1::1]:46748 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=545180worker2 # [ 67.596959] nix-daemon[857]: reaped child process 1046, status = succeeded5181worker2 # [ 67.737774] nix-daemon[857]: accepted connection from pid 1061, user nix-grpc-daemon (trusted)5182worker2 # [ 67.752136] nix-daemon[857]: reaped child process 1064, status = succeeded5183lb # [ 67.748469] niks3-server[1030]: 2026/09/20 12:43:46 INFO Received uploads request method=POST path=/api/pending_closures5184worker2 # [ 67.771910] nix-grpc-daemon[909]: time=2026-09-20T12:43:46.039Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5185lb # [ 67.768719] niks3-server[1030]: 2026/09/20 12:43:46 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5186lb # [ 67.773260] niks3-server[1030]: 2026/09/20 12:43:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5187lb # [ 67.776335] niks3-server[1030]: 2026/09/20 12:43:46 INFO Signed narinfos id=24 count=15188worker2 # [ 67.795041] nix-grpc-daemon[909]: time=2026-09-20T12:43:46.062Z level=INFO msg="Uploading 1 narinfos"5189lb # [ 67.783933] niks3-server[1030]: 2026/09/20 12:43:46 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5190lb # [ 67.789905] niks3-server[1030]: 2026/09/20 12:43:46 INFO Completed upload id=245191worker2 # [ 67.806545] nix-grpc-daemon[909]: time=2026-09-20T12:43:46.074Z level=INFO msg="Upload complete. (223ms)"5192lb # [ 67.792818] niks3-server[1030]: 2026/09/20 12:43:46 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5193worker2 # [ 67.811081] nix-grpc-daemon[789]: ts=2026-09-20T12:43:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55802 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=15194lb # [ 67.795808] niks3-server[1030]: 2026/09/20 12:43:46 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5195worker2 # [ 67.817742] nix-daemon[857]: reaped child process 1044, status = succeeded5196client # copying 1 paths...5197worker1 # [ 67.828216] nix-grpc-daemon[784]: ts=2026-09-20T12:43:46Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:438805198worker1 # [ 67.839103] nix-grpc-daemon[784]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5199client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5200worker2 # [ 67.896627] nix-grpc-daemon[789]: ts=2026-09-20T12:43:46Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:558025201worker2 # [ 67.898462] nix-grpc-daemon[789]: ts=2026-09-20T12:43:46Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:55802 duration_s=0 paths=1 nar_bytes_out=1205202client # [ 67.952376] nix-daemon[945]: reaped child process 1075, status = succeeded5203client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.35 seconds)5204(finished: subtest: an input only one worker has still reaches the builder, in 10.62 seconds)5205subtest: upload whose reference the worker lacks is completed from the cache5206client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5207client # this derivation will be built:5208client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5209client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5210client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.37 seconds)5211client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5212client # this derivation will be built:5213client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5214client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5215client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.38 seconds)5216client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5217client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.17 seconds)5218worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5219worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.20 seconds)5220worker2 # [ 69.141533] systemd[1]: Stopping Nix worker-protocol over gRPC...5221worker2 # [ 69.266656] nix-grpc-daemon[789]: ts=2026-09-20T12:43:47Z level=info event=signal_exit5222worker2 # [ 69.529880] nix-grpc-daemon[789]: ts=2026-09-20T12:43:47Z level=info event=scheduler_yield5223lb # [ 69.516979] niks3-server[1030]: 2026/09/20 12:43:47 INFO lead: released remote=192.168.1.4:364945224worker2 # [ 69.534313] nix-grpc-daemon[789]: ts=2026-09-20T12:43:47Z level=info event=scheduler_restarting addr=lb:500515225worker2 # [ 69.538480] nix-grpc-daemon[789]: ts=2026-09-20T12:43:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:557965226worker1 # [ 69.511975] nix-grpc-daemon[784]: ts=2026-09-20T12:43:47Z level=info event=scheduler_restarting addr=lb:500515227worker2 # [ 69.543706] nix-grpc-daemon[789]: ts=2026-09-20T12:43:47Z level=info event=worker_gone addr=192.168.1.4:500515228worker2 # [ 69.546810] nix-grpc-daemon[789]: ts=2026-09-20T12:43:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:557965229worker2 # [ 69.550121] nix-grpc-daemon[789]: ts=2026-09-20T12:43:47Z level=info event=worker_gone addr=192.168.1.3:500515230worker2 # [ 69.735534] nix-grpc-daemon[789]: ts=2026-09-20T12:43:48Z level=info event=scheduler_connected addr=lb:500515231worker1 # [ 69.713311] nix-grpc-daemon[784]: ts=2026-09-20T12:43:47Z level=info event=scheduler_connected addr=lb:500515232worker2 # [ 69.740335] nix-grpc-daemon[789]: ts=2026-09-20T12:43:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5233worker1 # [ 69.715708] nix-grpc-daemon[784]: ts=2026-09-20T12:43:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5234worker2 # [ 69.941120] nix-grpc-daemon[789]: ts=2026-09-20T12:43:48Z level=info event=scheduler_connected addr=lb:500515235worker2 # [ 69.943162] nix-grpc-daemon[789]: ts=2026-09-20T12:43:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5236worker1 # [ 69.916758] nix-grpc-daemon[784]: ts=2026-09-20T12:43:48Z level=info event=scheduler_connected addr=lb:500515237worker1 # [ 69.919585] nix-grpc-daemon[784]: ts=2026-09-20T12:43:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5238worker2 # [ 70.144044] nix-grpc-daemon[789]: ts=2026-09-20T12:43:48Z level=info event=scheduler_connected addr=lb:500515239worker2 # [ 70.146364] nix-grpc-daemon[789]: ts=2026-09-20T12:43:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5240worker1 # [ 70.120864] nix-grpc-daemon[784]: ts=2026-09-20T12:43:48Z level=info event=scheduler_connected addr=lb:500515241worker1 # [ 70.124104] nix-grpc-daemon[784]: ts=2026-09-20T12:43:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5242worker2 # [ 70.347560] nix-grpc-daemon[789]: ts=2026-09-20T12:43:48Z level=info event=scheduler_connected addr=lb:500515243worker2 # [ 70.349627] nix-grpc-daemon[789]: ts=2026-09-20T12:43:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5244worker1 # [ 70.325130] nix-grpc-daemon[784]: ts=2026-09-20T12:43:48Z level=info event=scheduler_connected addr=lb:500515245worker1 # [ 70.327742] nix-grpc-daemon[784]: ts=2026-09-20T12:43:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5246worker2 # [ 70.530559] nix-grpc-daemon[789]: ts=2026-09-20T12:43:48Z level=info event=scheduler_restarting5247worker2 # [ 70.555987] nix-grpc-daemon[789]: ts=2026-09-20T12:43:48Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5248worker1 # [ 70.529860] nix-grpc-daemon[784]: ts=2026-09-20T12:43:48Z level=info event=scheduler_connected addr=lb:500515249worker1 # [ 70.531863] nix-grpc-daemon[784]: ts=2026-09-20T12:43:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5250worker2 # [ 70.608221] nix-daemon[857]: reaped child process 859, status = succeeded5251worker1 # [ 70.730864] nix-grpc-daemon[784]: ts=2026-09-20T12:43:49Z level=info event=scheduler_connected addr=lb:500515252worker1 # [ 70.733673] nix-grpc-daemon[784]: ts=2026-09-20T12:43:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5253worker1 # [ 70.934567] nix-grpc-daemon[784]: ts=2026-09-20T12:43:49Z level=info event=scheduler_connected addr=lb:500515254worker1 # [ 70.937442] nix-grpc-daemon[784]: ts=2026-09-20T12:43:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5255worker1 # [ 71.138476] nix-grpc-daemon[784]: ts=2026-09-20T12:43:49Z level=info event=scheduler_connected addr=lb:500515256worker1 # [ 71.142397] nix-grpc-daemon[784]: ts=2026-09-20T12:43:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5257worker1 # [ 71.343028] nix-grpc-daemon[784]: ts=2026-09-20T12:43:49Z level=info event=scheduler_connected addr=lb:500515258worker1 # [ 71.345351] nix-grpc-daemon[784]: ts=2026-09-20T12:43:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5259worker2 # [ 71.407757] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5260worker2 # [ 71.409793] systemd[1]: Stopped Nix worker-protocol over gRPC.5261worker2 # [ 71.413599] systemd[1]: nix-grpc-daemon.service: Consumed 1.523s CPU time over 54.438s wall clock time, 50.2M memory peak, 56K incoming IP traffic, 135.3K outgoing IP traffic.5262worker2 # [ 71.421375] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5263worker2 # [ 71.423756] systemd[1]: Closed Nix worker-protocol over gRPC.5264worker2 # [ 71.425943] systemd[1]: nix-grpc-daemon.socket: Consumed 310us CPU time over 1min 2.330s wall clock time, 256K memory peak, 74.9K incoming IP traffic, 61.2K outgoing IP traffic.5265lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5266lb: must succeed: curl -sf localhost:9901/clusters5267lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5268lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5269client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25270worker1 # [ 71.546577] nix-grpc-daemon[784]: ts=2026-09-20T12:43:49Z level=info event=scheduler_connected addr=lb:500515271worker1 # [ 71.549749] nix-grpc-daemon[784]: ts=2026-09-20T12:43:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5272worker1 # [ 71.706174] nix-grpc-daemon[784]: ts=2026-09-20T12:43:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:438805273worker1 # [ 71.715584] nix-grpc-daemon[784]: ts=2026-09-20T12:43:49Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:438805274client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5275lb # [ 71.752659] niks3-server[1030]: 2026/09/20 12:43:50 INFO lead: acquired remote=192.168.1.3:588665276worker1 # [ 71.740702] nix-grpc-daemon[784]: ts=2026-09-20T12:43:50Z level=info event=scheduler_take_over5277client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.27 seconds)5278worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5279worker1 # [ 71.750938] nix-grpc-daemon[784]: ts=2026-09-20T12:43:50Z level=info event=scheduler_connected addr=lb:500515280worker1 # [ 71.754193] nix-grpc-daemon[784]: ts=2026-09-20T12:43:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5281worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5282worker2 # [ 71.850444] systemd[1]: Listening on Nix worker-protocol over gRPC.5283worker1 # [ 71.878737] systemd[1]: Stopping Nix worker-protocol over gRPC...5284worker1 # [ 71.954792] nix-grpc-daemon[784]: ts=2026-09-20T12:43:50Z level=info event=scheduler_connected addr=lb:500515285worker1 # [ 71.957256] nix-grpc-daemon[784]: ts=2026-09-20T12:43:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5286worker1 # [ 72.124801] nix-grpc-daemon[784]: ts=2026-09-20T12:43:50Z level=info event=signal_exit5287worker1 # [ 72.158406] nix-grpc-daemon[784]: ts=2026-09-20T12:43:50Z level=info event=scheduler_connected addr=lb:500515288worker1 # [ 72.161459] nix-grpc-daemon[784]: ts=2026-09-20T12:43:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5289worker1 # [ 72.362759] nix-grpc-daemon[784]: ts=2026-09-20T12:43:50Z level=info event=scheduler_connected addr=lb:500515290worker1 # [ 72.364949] nix-grpc-daemon[784]: ts=2026-09-20T12:43:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5291worker1 # [ 72.380358] nix-grpc-daemon[784]: ts=2026-09-20T12:43:50Z level=info event=scheduler_yield5292lb # [ 72.394281] niks3-server[1030]: 2026/09/20 12:43:50 INFO lead: released remote=192.168.1.3:588665293worker2 # [ 72.429653] systemd[1]: Starting scheduler-token.service...5294worker2 # [ 72.512588] systemd[1]: scheduler-token.service: Deactivated successfully.5295worker2 # [ 72.515405] systemd[1]: Finished scheduler-token.service.5296worker2 # [ 72.518300] systemd[1]: scheduler-token.service: Consumed 32ms CPU time over 85ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5297worker2 # [ 72.526225] systemd[1]: Starting Nix worker-protocol over gRPC...5298worker1 # [ 72.566762] nix-grpc-daemon[784]: ts=2026-09-20T12:43:50Z level=info event=scheduler_connected addr=lb:500515299worker1 # [ 72.569546] nix-grpc-daemon[784]: ts=2026-09-20T12:43:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5300worker2 # [ 72.757914] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:51Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5301worker2 # [ 72.761380] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5302worker2 # [ 72.767482] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15303worker2 # [ 72.777586] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5304worker2 # [ 72.784414] systemd[1]: Started Nix worker-protocol over gRPC.5305lb # [ 72.778531] niks3-server[1030]: 2026/09/20 12:43:51 INFO lead: acquired remote=192.168.1.4:381325306worker2 # [ 72.795435] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:51Z level=info event=scheduler_take_over5307worker1 # [ 72.770789] nix-grpc-daemon[784]: ts=2026-09-20T12:43:51Z level=info event=scheduler_connected addr=lb:500515308worker1 # [ 72.773927] nix-grpc-daemon[784]: ts=2026-09-20T12:43:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5309worker2 # [ 72.807420] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:51Z level=info event=scheduler_connected addr=lb:500515310worker2 # [ 72.818240] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:51Z level=info event=oidc_jwks provider=mock keys=15311worker2 # [ 72.820267] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:51Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:566405312worker2 # [ 72.822832] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05313worker1 # [ 72.974802] nix-grpc-daemon[784]: ts=2026-09-20T12:43:51Z level=info event=scheduler_connected addr=lb:500515314worker2 # [ 73.005934] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:51Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:566405315worker2 # [ 73.008547] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05316worker1 # [ 73.381328] nix-grpc-daemon[784]: ts=2026-09-20T12:43:51Z level=info event=scheduler_restarting5317worker2 # [ 73.418267] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:51Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:566405318worker2 # [ 73.420663] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:51Z level=info event=worker_gone addr=192.168.1.3:500515319worker1 # [ 73.401759] nix-grpc-daemon[784]: ts=2026-09-20T12:43:51Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5320worker1 # [ 73.416564] nix-daemon[842]: reaped child process 844, status = succeeded5321worker1 # [ 74.251165] nix-grpc-daemon[784]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5322worker1 # [ 74.253359] nix-grpc-daemon[784]: E0000 00:00:1789908232.522011 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5323worker1 # [ 74.256126] nix-grpc-daemon[784]: E0000 00:00:1789908232.522604 827 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5324worker1 # [ 75.318889] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5325worker1 # [ 75.323518] systemd[1]: Stopped Nix worker-protocol over gRPC.5326worker1 # [ 75.324898] systemd[1]: nix-grpc-daemon.service: Consumed 3.230s CPU time over 58.527s wall clock time, 57.9M memory peak, 87.5K incoming IP traffic, 164.4K outgoing IP traffic.5327worker1 # [ 75.333775] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5328worker1 # [ 75.336813] systemd[1]: Closed Nix worker-protocol over gRPC.5329worker1 # [ 75.339641] systemd[1]: nix-grpc-daemon.socket: Consumed 336us CPU time over 1min 6.197s wall clock time, 256K memory peak, 74.5K incoming IP traffic, 61.3K outgoing IP traffic.5330lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5331lb: must succeed: curl -sf localhost:9901/clusters5332lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5333lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5334client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25335worker2 # [ 75.688436] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:566425336worker2 # [ 75.697652] nix-daemon[857]: accepted connection from pid 1088, user nix-grpc-daemon (trusted)5337worker2 # [ 75.712426] nix-grpc-daemon[1088]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 1/5)5338worker2 # [ 75.724500] nix-grpc-daemon[1088]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 145 ms (attempt 2/5)5339worker2 # [ 75.873319] nix-grpc-daemon[1088]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 321 ms (attempt 3/5)5340worker2 # [ 76.197926] nix-grpc-daemon[1088]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 359 ms (attempt 4/5)5341worker2 # [ 76.561605] nix-grpc-daemon[1088]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5342client # copying 2 paths...5343client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5344client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5345worker2 # [ 76.580576] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:566425346worker2 # [ 76.589147] nix-daemon[857]: accepted connection from pid 1088, user nix-grpc-daemon (trusted)5347worker2 # [ 76.605691] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:54Z level=info event=niks3_push_started pid=11445348lb # [ 76.816615] envoy[909]: conn peer=[2001:db8:1::1]:46764 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3700 tx=1893 ms=19435349lb # [ 76.819287] envoy[909]: conn peer=[2001:db8:1::1]:46772 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=95350lb # [ 76.821591] envoy[909]: conn peer=[2001:db8:1::4]:45186 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=45531 tx=2271 ms=532655351lb # [ 76.824841] envoy[909]: conn peer=[2001:db8:1::1]:46784 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=265352lb # [ 76.827274] envoy[909]: conn peer=[2001:db8:1::3]:51668 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=14069 tx=2862 ms=552005353worker2 # [ 76.859875] nix-grpc-daemon[1144]: time=2026-09-20T12:43:55.126Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""5354worker2 # [ 77.064392] nix-daemon[857]: accepted connection from pid 1157, user nix-grpc-daemon (trusted)5355worker2 # [ 77.086581] nix-daemon[857]: reaped child process 1160, status = succeeded5356lb # [ 77.080931] niks3-server[1030]: 2026/09/20 12:43:55 INFO Received uploads request method=POST path=/api/pending_closures5357lb # [ 77.088070] niks3-server[1030]: 2026/09/20 12:43:55 INFO Received uploads request method=POST path=/api/pending_closures5358worker2 # [ 77.112218] nix-grpc-daemon[1144]: time=2026-09-20T12:43:55.378Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5359worker2 # [ 77.114320] nix-grpc-daemon[1144]: time=2026-09-20T12:43:55.378Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5360worker2 # [ 77.116614] nix-grpc-daemon[1144]: time=2026-09-20T12:43:55.378Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5361lb # [ 77.131454] niks3-server[1030]: 2026/09/20 12:43:55 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5362lb # [ 77.157249] niks3-server[1030]: 2026/09/20 12:43:55 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5363lb # [ 77.163501] niks3-server[1030]: 2026/09/20 12:43:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5364lb # [ 77.166757] niks3-server[1030]: 2026/09/20 12:43:55 INFO Signed narinfos id=26 count=25365lb # [ 77.169794] niks3-server[1030]: 2026/09/20 12:43:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5366lb # [ 77.177145] niks3-server[1030]: 2026/09/20 12:43:55 INFO Signed narinfos id=25 count=15367worker2 # [ 77.199139] nix-grpc-daemon[1144]: time=2026-09-20T12:43:55.465Z level=INFO msg="Uploading 3 narinfos"5368lb # [ 77.183667] niks3-server[1030]: 2026/09/20 12:43:55 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5369lb # [ 77.217896] niks3-server[1030]: 2026/09/20 12:43:55 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5370lb # [ 77.229889] niks3-server[1030]: 2026/09/20 12:43:55 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5371lb # [ 77.238244] niks3-server[1030]: 2026/09/20 12:43:55 INFO Completed upload id=265372lb # [ 77.240828] niks3-server[1030]: 2026/09/20 12:43:55 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5373lb # [ 77.245071] niks3-server[1030]: 2026/09/20 12:43:55 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5374lb # [ 77.252180] niks3-server[1030]: 2026/09/20 12:43:55 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5375lb # [ 77.254641] niks3-server[1030]: 2026/09/20 12:43:55 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5376lb # [ 77.260661] niks3-server[1030]: 2026/09/20 12:43:55 INFO Completed upload id=255377worker2 # [ 77.277780] nix-grpc-daemon[1144]: time=2026-09-20T12:43:55.545Z level=INFO msg="Upload complete. (411ms)"5378worker2 # [ 77.281349] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56642 duration_s=0 paths=2 nar_bytes_in=3125379worker2 # [ 77.289521] nix-daemon[857]: reaped child process 1142, status = succeeded5380client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.86 seconds)5381worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5382worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5383worker1 # [ 77.342496] systemd[1]: Listening on Nix worker-protocol over gRPC.5384worker1 # [ 77.347100] systemd[1]: Starting Nix worker-protocol over gRPC...5385worker1 # [ 77.551556] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:55Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5386worker1 # [ 77.554328] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5387worker1 # [ 77.559295] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15388worker1 # [ 77.567755] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5389worker1 # [ 77.569800] systemd[1]: Started Nix worker-protocol over gRPC.5390lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5391lb: must succeed: curl -sf localhost:9901/clusters5392worker1 # [ 77.588950] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:55Z level=info event=scheduler_connected addr=lb:500515393worker2 # [ 77.620663] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:55Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:566405394worker2 # [ 77.623499] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:55Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05395lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5396lb: must succeed: curl -sf localhost:9901/clusters5397lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5398lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.13 seconds)5399(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.78 seconds)5400subtest: scheduler down: the other node takes the lock and keeps it5401lb: must succeed: curl -sf localhost:9901/clusters5402lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5403lb: must succeed: curl -sf localhost:9901/clusters5404lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5405lb: must succeed: curl -sf localhost:9901/clusters5406lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5407lb: must succeed: curl -sf localhost:9901/clusters5408lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5409worker2 # [ 79.026542] systemd[1]: Stopping Nix worker-protocol over gRPC...5410worker2 # [ 79.785516] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:58Z level=info event=signal_exit5411worker2 # [ 79.999269] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:58Z level=info event=scheduler_yield5412lb # [ 79.986846] niks3-server[1030]: 2026/09/20 12:43:58 INFO lead: released remote=192.168.1.4:381325413worker1 # [ 79.976648] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:58Z level=info event=scheduler_restarting addr=lb:500515414worker2 # [ 80.006412] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:566405415worker2 # [ 80.010715] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:58Z level=info event=worker_gone addr=192.168.1.3:500515416worker2 # [ 80.012701] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:58Z level=info event=scheduler_restarting addr=lb:500515417worker2 # [ 80.014617] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:566405418worker2 # [ 80.016655] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:58Z level=info event=worker_gone addr=192.168.1.4:500515419worker1 # [ 80.177050] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:58Z level=info event=scheduler_connected addr=lb:500515420worker2 # [ 80.208717] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:58Z level=info event=scheduler_connected addr=lb:500515421worker1 # [ 80.180355] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5422worker2 # [ 80.211853] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5423worker1 # [ 80.381342] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:58Z level=info event=scheduler_connected addr=lb:500515424worker2 # [ 80.413158] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:58Z level=info event=scheduler_connected addr=lb:500515425worker1 # [ 80.384556] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5426worker2 # [ 80.416356] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5427worker1 # [ 80.585391] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:58Z level=info event=scheduler_connected addr=lb:500515428worker1 # [ 80.587970] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5429worker2 # [ 80.617284] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:58Z level=info event=scheduler_connected addr=lb:500515430worker2 # [ 80.619882] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5431worker1 # [ 80.788874] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:59Z level=info event=scheduler_connected addr=lb:500515432worker1 # [ 80.791999] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5433worker2 # [ 80.822385] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:59Z level=info event=scheduler_connected addr=lb:500515434worker2 # [ 80.823979] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5435worker2 # [ 81.002228] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:59Z level=info event=scheduler_restarting5436worker2 # [ 81.021649] nix-daemon[857]: reaped child process 1137, status = succeeded5437worker1 # [ 80.994088] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:59Z level=info event=scheduler_connected addr=lb:500515438worker1 # [ 80.995787] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5439worker2 # [ 81.030851] nix-grpc-daemon[1088]: ts=2026-09-20T12:43:59Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5440worker1 # [ 81.195209] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:59Z level=info event=scheduler_connected addr=lb:500515441worker1 # [ 81.198158] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5442worker1 # [ 81.399097] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:59Z level=info event=scheduler_connected addr=lb:500515443worker1 # [ 81.402135] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5444worker1 # [ 81.603161] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:59Z level=info event=scheduler_connected addr=lb:500515445worker1 # [ 81.606076] nix-grpc-daemon[1209]: ts=2026-09-20T12:43:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5446worker2 # [ 81.823275] nix-grpc-daemon[1088]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5447worker2 # [ 81.825308] nix-grpc-daemon[1088]: E0000 00:00:1789908240.089439 1131 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5448worker2 # [ 81.828223] nix-grpc-daemon[1088]: E0000 00:00:1789908240.090770 1131 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5449worker1 # [ 81.807179] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:00Z level=info event=scheduler_connected addr=lb:500515450worker1 # [ 81.810218] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5451worker1 # [ 82.011356] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:00Z level=info event=scheduler_connected addr=lb:500515452worker1 # [ 82.014092] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5453worker1 # [ 82.214930] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:00Z level=info event=scheduler_connected addr=lb:500515454worker1 # [ 82.217160] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5455worker1 # [ 82.417972] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:00Z level=info event=scheduler_connected addr=lb:500515456worker1 # [ 82.420646] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5457worker1 # [ 82.581741] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:00Z level=info event=scheduler_take_over5458lb # [ 82.593884] niks3-server[1030]: 2026/09/20 12:44:00 INFO lead: acquired remote=192.168.1.3:458025459worker1 # [ 82.621446] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:00Z level=info event=scheduler_connected addr=lb:500515460worker1 # [ 82.623639] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5461worker2 # [ 82.802993] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5462worker2 # [ 82.806428] systemd[1]: Stopped Nix worker-protocol over gRPC.5463worker2 # [ 82.808228] systemd[1]: nix-grpc-daemon.service: Consumed 509ms CPU time over 10.276s wall clock time, 30.6M memory peak, 19.5K incoming IP traffic, 26.6K outgoing IP traffic.5464worker2 # [ 82.815728] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5465worker2 # [ 82.818540] systemd[1]: Closed Nix worker-protocol over gRPC.5466worker2 # [ 82.820800] systemd[1]: nix-grpc-daemon.socket: Consumed 517us CPU time over 10.973s wall clock time, 256K memory peak, 21.5K incoming IP traffic, 16K outgoing IP traffic.5467worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5468worker1 # [ 82.824552] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:01Z level=info event=scheduler_connected addr=lb:500515469worker1 # [ 82.827190] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5470worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.06 seconds)5471worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5472worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5473worker1 # [ 83.029519] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:01Z level=info event=scheduler_connected addr=lb:500515474worker1 # [ 83.031466] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5475worker1 # [ 83.230158] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:01Z level=info event=scheduler_connected addr=lb:500515476worker1 # [ 83.232776] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5477worker1 # [ 83.433427] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:01Z level=info event=scheduler_connected addr=lb:500515478worker1 # [ 83.438236] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:01Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:420025479worker1 # [ 83.440407] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:01Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05480worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5481worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)5482client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&25483worker1 # [ 84.145325] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:420045484worker1 # [ 84.152653] nix-daemon[842]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5485client # don't know how to build these paths:5486client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5487worker1 # [ 84.164356] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:420045488worker1 # [ 84.170978] nix-grpc-daemon[1209]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 47 ms (attempt 1/5)5489worker1 # [ 84.220794] nix-grpc-daemon[1209]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 28 ms (attempt 2/5)5490worker1 # [ 84.251690] nix-grpc-daemon[1209]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 154 ms (attempt 3/5)5491worker1 # [ 84.409206] nix-grpc-daemon[1209]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 4/5)5492worker1 # [ 84.415202] nix-grpc-daemon[1209]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5493worker1 # [ 84.436361] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:02Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05494worker1 # [ 84.439548] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:02Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15495worker1 # [ 84.484379] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:420045496worker1 # [ 84.494688] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:420045497client # copying 1 paths to 'lb:50051'...5498client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5499worker1 # [ 84.503365] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:420045500worker1 # [ 84.510160] nix-daemon[842]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5501worker1 # [ 84.528124] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:02Z level=info event=niks3_push_started pid=12795502worker1 # [ 84.726254] nix-grpc-daemon[1279]: time=2026-09-20T12:44:02.997Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""5503worker1 # [ 84.889104] nix-daemon[842]: accepted connection from pid 1292, user nix-grpc-daemon (trusted)5504worker1 # [ 84.904324] nix-daemon[842]: reaped child process 1295, status = succeeded5505worker1 # [ 85.090248] nix-daemon[842]: accepted connection from pid 1297, user nix-grpc-daemon (trusted)5506worker1 # [ 85.117620] nix-daemon[842]: reaped child process 1300, status = succeeded5507lb # [ 85.142763] niks3-server[1030]: 2026/09/20 12:44:03 INFO Received uploads request method=POST path=/api/pending_closures5508worker1 # [ 85.137092] nix-grpc-daemon[1279]: time=2026-09-20T12:44:03.409Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5509worker1 # [ 85.139708] nix-grpc-daemon[1279]: time=2026-09-20T12:44:03.411Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5510lb # [ 85.177630] niks3-server[1030]: 2026/09/20 12:44:03 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5511lb # [ 85.180929] niks3-server[1030]: 2026/09/20 12:44:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5512lb # [ 85.184069] niks3-server[1030]: 2026/09/20 12:44:03 INFO Signed narinfos id=27 count=15513worker1 # [ 85.172302] nix-grpc-daemon[1279]: time=2026-09-20T12:44:03.443Z level=INFO msg="Uploading 1 narinfos"5514lb # [ 85.191839] niks3-server[1030]: 2026/09/20 12:44:03 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5515lb # [ 85.196148] niks3-server[1030]: 2026/09/20 12:44:03 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5516lb # [ 85.199530] niks3-server[1030]: 2026/09/20 12:44:03 INFO Completed upload id=275517worker1 # [ 85.187938] nix-grpc-daemon[1279]: time=2026-09-20T12:44:03.459Z level=INFO msg="Upload complete. (458ms)"5518lb # [ 85.202314] niks3-server[1030]: 2026/09/20 12:44:03 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5519worker1 # [ 85.192591] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42004 duration_s=0 paths=1 nar_bytes_in=5205520worker1 # [ 85.197570] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:420045521worker1 # [ 85.210694] nix-daemon[842]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5522worker1 # [ 85.219402] nix-daemon[842]: reaped child process 1277, status = succeeded5523client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5524client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5525worker1 # [ 85.225625] nix-daemon[842]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5526client # farm-a> LOG-farm-a-on-standby5527worker1 # [ 86.452224] nix-daemon[842]: reaped child process 1304, status = succeeded5528worker1 # [ 86.607277] nix-daemon[842]: accepted connection from pid 1319, user nix-grpc-daemon (trusted)5529worker1 # [ 86.625199] nix-daemon[842]: reaped child process 1322, status = succeeded5530lb # [ 86.648934] niks3-server[1030]: 2026/09/20 12:44:04 INFO Received uploads request method=POST path=/api/pending_closures5531worker1 # [ 86.649891] nix-grpc-daemon[1279]: time=2026-09-20T12:44:04.921Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5532worker1 # [ 86.655301] nix-grpc-daemon[1279]: time=2026-09-20T12:44:04.924Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5533lb # [ 86.684793] niks3-server[1030]: 2026/09/20 12:44:04 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5534lb # [ 86.689437] niks3-server[1030]: 2026/09/20 12:44:04 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5535lb # [ 86.693065] niks3-server[1030]: 2026/09/20 12:44:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5536lb # [ 86.696267] niks3-server[1030]: 2026/09/20 12:44:04 INFO Signed narinfos id=28 count=15537worker1 # [ 86.686640] nix-grpc-daemon[1279]: time=2026-09-20T12:44:04.957Z level=INFO msg="Uploading 1 narinfos"5538lb # [ 86.699706] niks3-server[1030]: 2026/09/20 12:44:04 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5539lb # [ 86.705152] niks3-server[1030]: 2026/09/20 12:44:05 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5540lb # [ 86.711557] niks3-server[1030]: 2026/09/20 12:44:05 INFO Completed upload id=285541worker1 # [ 86.700087] nix-grpc-daemon[1279]: time=2026-09-20T12:44:04.972Z level=INFO msg="Upload complete. (259ms)"5542lb # [ 86.713404] niks3-server[1030]: 2026/09/20 12:44:05 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5543worker1 # [ 86.709954] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42004 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15544worker1 # [ 86.720470] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:04Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05545worker1 # [ 86.723531] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:04Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15546worker1 # [ 86.730223] nix-daemon[842]: reaped child process 1302, status = succeeded5547worker1 # [ 86.764808] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:420045548worker1 # [ 86.775349] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:420045549worker1 # [ 86.785574] nix-grpc-daemon[1279]: time=2026-09-20T12:44:05.057Z level=INFO msg="All 1 paths already cached"5550client # copying 1 paths to 'lb:50051'...5551client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5552worker1 # [ 86.791453] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:420045553worker1 # [ 86.799151] nix-daemon[842]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5554lb # [ 86.817242] envoy[909]: conn peer=[2001:db8:1::1]:54060 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1007 tx=305 ms=16065555lb # [ 86.820468] envoy[909]: conn peer=[2001:db8:1::4]:54936 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4478 tx=326 ms=82235556worker1 # [ 86.989326] nix-daemon[842]: accepted connection from pid 1328, user nix-grpc-daemon (trusted)5557worker1 # [ 87.007883] nix-daemon[842]: reaped child process 1331, status = succeeded5558worker1 # [ 87.195794] nix-daemon[842]: accepted connection from pid 1333, user nix-grpc-daemon (trusted)5559worker1 # [ 87.215266] nix-daemon[842]: reaped child process 1336, status = succeeded5560lb # [ 87.237753] niks3-server[1030]: 2026/09/20 12:44:05 INFO Received uploads request method=POST path=/api/pending_closures5561worker1 # [ 87.231697] nix-grpc-daemon[1279]: time=2026-09-20T12:44:05.503Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5562worker1 # [ 87.233517] nix-grpc-daemon[1279]: time=2026-09-20T12:44:05.505Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5563lb # [ 87.263920] niks3-server[1030]: 2026/09/20 12:44:05 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5564lb # [ 87.269047] niks3-server[1030]: 2026/09/20 12:44:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5565lb # [ 87.273750] niks3-server[1030]: 2026/09/20 12:44:05 INFO Signed narinfos id=29 count=15566worker1 # [ 87.262584] nix-grpc-daemon[1279]: time=2026-09-20T12:44:05.534Z level=INFO msg="Uploading 1 narinfos"5567lb # [ 87.279156] niks3-server[1030]: 2026/09/20 12:44:05 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5568lb # [ 87.288408] niks3-server[1030]: 2026/09/20 12:44:05 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5569lb # [ 87.293723] niks3-server[1030]: 2026/09/20 12:44:05 INFO Completed upload id=295570worker1 # [ 87.282044] nix-grpc-daemon[1279]: time=2026-09-20T12:44:05.554Z level=INFO msg="Upload complete. (474ms)"5571lb # [ 87.296659] niks3-server[1030]: 2026/09/20 12:44:05 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5572worker1 # [ 87.286151] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42004 duration_s=0 paths=1 nar_bytes_in=6405573worker1 # [ 87.289827] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:420045574worker1 # [ 87.299157] nix-daemon[842]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5575worker1 # [ 87.308620] nix-daemon[842]: reaped child process 1326, status = succeeded5576client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5577client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5578worker1 # [ 87.317153] nix-daemon[842]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5579client # farm-b> LOG-farm-b-on-standby5580worker1 # [ 88.344553] nix-daemon[842]: reaped child process 1340, status = succeeded5581worker1 # [ 88.479357] nix-daemon[842]: accepted connection from pid 1355, user nix-grpc-daemon (trusted)5582worker1 # [ 88.498628] nix-daemon[842]: reaped child process 1358, status = succeeded5583lb # [ 88.522987] niks3-server[1030]: 2026/09/20 12:44:06 INFO Received uploads request method=POST path=/api/pending_closures5584worker1 # [ 88.517794] nix-grpc-daemon[1279]: time=2026-09-20T12:44:06.789Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5585worker1 # [ 88.520515] nix-grpc-daemon[1279]: time=2026-09-20T12:44:06.791Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5586lb # [ 88.552037] niks3-server[1030]: 2026/09/20 12:44:06 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5587lb # [ 88.559393] niks3-server[1030]: 2026/09/20 12:44:06 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5588lb # [ 88.566455] niks3-server[1030]: 2026/09/20 12:44:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5589lb # [ 88.570859] niks3-server[1030]: 2026/09/20 12:44:06 INFO Signed narinfos id=30 count=15590worker1 # [ 88.559772] nix-grpc-daemon[1279]: time=2026-09-20T12:44:06.831Z level=INFO msg="Uploading 1 narinfos"5591lb # [ 88.576068] niks3-server[1030]: 2026/09/20 12:44:06 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5592lb # [ 88.587570] niks3-server[1030]: 2026/09/20 12:44:06 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5593lb # [ 88.592570] niks3-server[1030]: 2026/09/20 12:44:06 INFO Completed upload id=305594worker1 # [ 88.582752] nix-grpc-daemon[1279]: time=2026-09-20T12:44:06.854Z level=INFO msg="Upload complete. (254ms)"5595lb # [ 88.595228] niks3-server[1030]: 2026/09/20 12:44:06 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5596worker1 # [ 88.587555] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42004 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15597worker1 # [ 88.596376] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:06Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05598worker1 # [ 88.598749] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:06Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15599worker1 # [ 88.604559] nix-daemon[842]: reaped child process 1338, status = succeeded5600worker1 # [ 88.642329] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:420045601worker1 # [ 88.653091] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:420045602worker1 # [ 88.664399] nix-grpc-daemon[1279]: time=2026-09-20T12:44:06.936Z level=INFO msg="All 2 paths already cached"5603client # copying 1 paths to 'lb:50051'...5604client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5605worker1 # [ 88.672082] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:420045606worker1 # [ 88.680139] nix-daemon[842]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5607worker1 # [ 88.862121] nix-daemon[842]: accepted connection from pid 1364, user nix-grpc-daemon (trusted)5608worker1 # [ 88.880640] nix-daemon[842]: reaped child process 1367, status = succeeded5609worker1 # [ 89.070481] nix-daemon[842]: accepted connection from pid 1369, user nix-grpc-daemon (trusted)5610worker1 # [ 89.088570] nix-daemon[842]: reaped child process 1372, status = succeeded5611lb # [ 89.110618] niks3-server[1030]: 2026/09/20 12:44:07 INFO Received uploads request method=POST path=/api/pending_closures5612worker1 # [ 89.105550] nix-grpc-daemon[1279]: time=2026-09-20T12:44:07.377Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5613worker1 # [ 89.107279] nix-grpc-daemon[1279]: time=2026-09-20T12:44:07.377Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5614lb # [ 89.134131] niks3-server[1030]: 2026/09/20 12:44:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5615lb # [ 89.137586] niks3-server[1030]: 2026/09/20 12:44:07 INFO Signed narinfos id=31 count=15616worker1 # [ 89.125960] nix-grpc-daemon[1279]: time=2026-09-20T12:44:07.397Z level=INFO msg="Uploading 1 narinfos"5617lb # [ 89.139669] niks3-server[1030]: 2026/09/20 12:44:07 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5618lb # [ 89.148814] niks3-server[1030]: 2026/09/20 12:44:07 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5619lb # [ 89.157679] niks3-server[1030]: 2026/09/20 12:44:07 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5620lb # [ 89.163310] niks3-server[1030]: 2026/09/20 12:44:07 INFO Completed upload id=315621worker1 # [ 89.153387] nix-grpc-daemon[1279]: time=2026-09-20T12:44:07.425Z level=INFO msg="Upload complete. (463ms)"5622lb # [ 89.166068] niks3-server[1030]: 2026/09/20 12:44:07 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5623worker1 # [ 89.156672] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42004 duration_s=0 paths=1 nar_bytes_in=7685624worker1 # [ 89.159886] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:420045625worker1 # [ 89.169198] nix-daemon[842]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5626worker1 # [ 89.175157] nix-daemon[842]: reaped child process 1362, status = succeeded5627client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5628worker1 # [ 89.180745] nix-daemon[842]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5629client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5630client # farm-top> LOG-farm-top-on-standby5631worker1 # [ 90.801395] nix-daemon[842]: reaped child process 1376, status = succeeded5632worker1 # [ 90.981339] nix-daemon[842]: accepted connection from pid 1391, user nix-grpc-daemon (trusted)5633worker1 # [ 91.003326] nix-daemon[842]: reaped child process 1394, status = succeeded5634lb # [ 91.027911] niks3-server[1030]: 2026/09/20 12:44:09 INFO Received uploads request method=POST path=/api/pending_closures5635worker1 # [ 91.023618] nix-grpc-daemon[1279]: time=2026-09-20T12:44:09.295Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5636worker1 # [ 91.027690] nix-grpc-daemon[1279]: time=2026-09-20T12:44:09.297Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5637lb # [ 91.058312] niks3-server[1030]: 2026/09/20 12:44:09 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5638lb # [ 91.063982] niks3-server[1030]: 2026/09/20 12:44:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5639lb # [ 91.068984] niks3-server[1030]: 2026/09/20 12:44:09 INFO Signed narinfos id=32 count=15640worker1 # [ 91.059353] nix-grpc-daemon[1279]: time=2026-09-20T12:44:09.331Z level=INFO msg="Uploading 1 narinfos"5641lb # [ 91.074994] niks3-server[1030]: 2026/09/20 12:44:09 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5642lb # [ 91.079541] niks3-server[1030]: 2026/09/20 12:44:09 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5643lb # [ 91.086115] niks3-server[1030]: 2026/09/20 12:44:09 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5644lb # [ 91.092724] niks3-server[1030]: 2026/09/20 12:44:09 INFO Completed upload id=325645worker1 # [ 91.080817] nix-grpc-daemon[1279]: time=2026-09-20T12:44:09.352Z level=INFO msg="Upload complete. (289ms)"5646lb # [ 91.096520] niks3-server[1030]: 2026/09/20 12:44:09 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5647worker1 # [ 91.084894] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42004 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15648worker1 # [ 91.094048] nix-daemon[842]: reaped child process 1374, status = succeeded5649client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 7.17 seconds)5650client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath5651client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.23 seconds)5652worker2 # [ 91.430184] systemd[1]: Listening on Nix worker-protocol over gRPC.5653worker2 # [ 91.434761] systemd[1]: Starting scheduler-token.service...5654worker2 # [ 91.496060] systemd[1]: scheduler-token.service: Deactivated successfully.5655worker2 # [ 91.497431] systemd[1]: Finished scheduler-token.service.5656worker2 # [ 91.499569] systemd[1]: scheduler-token.service: Consumed 24ms CPU time over 61ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5657worker2 # [ 91.505547] systemd[1]: Starting Nix worker-protocol over gRPC...5658worker2 # [ 91.670730] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:09Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5659worker2 # [ 91.673833] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5660worker2 # [ 91.680439] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15661worker2 # [ 91.690113] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:09Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5662worker2 # [ 91.701865] systemd[1]: Started Nix worker-protocol over gRPC.5663worker2 # [ 91.713411] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:09Z level=info event=scheduler_connected addr=lb:500515664lb: must succeed: curl -sf localhost:9901/clusters5665worker1 # [ 91.695318] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:09Z level=info event=oidc_jwks provider=mock keys=15666worker1 # [ 91.698852] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:09Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:420025667worker1 # [ 91.701471] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:09Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05668lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5669worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5670worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5671lb: must succeed: curl -sf localhost:9901/clusters5672lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5673lb: must succeed: curl -sf localhost:9901/clusters5674lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5675worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5676worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5677(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.24 seconds)5678subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5679client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5680client # [ 92.020924] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5681client # Running as unit: rs.service; invocation ID: ec2c0d95366041a08833f5ade3eeb2775682client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.06 seconds)5683client # [ 92.242598] nix[1175]: don't know how to build these paths:5684worker1 # [ 92.215321] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:420045685client # [ 92.243875] nix[1175]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5686worker1 # [ 92.228733] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:10Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05687worker1 # [ 92.231678] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:10Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15688worker1 # [ 92.272613] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:420045689worker1 # [ 92.283616] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:420045690client # [ 92.319143] nix[1175]: copying 1 paths to 'lb:50051'...5691client # [ 92.319979] nix[1175]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5692worker1 # [ 92.293576] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:420045693worker1 # [ 92.304458] nix-daemon[842]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5694worker1 # [ 92.471446] nix-daemon[842]: accepted connection from pid 1407, user nix-grpc-daemon (trusted)5695worker1 # [ 92.490484] nix-daemon[842]: reaped child process 1410, status = succeeded5696worker1 # [ 92.667268] nix-daemon[842]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5697worker1 # [ 92.682843] nix-daemon[842]: reaped child process 1415, status = succeeded5698lb # [ 92.707606] niks3-server[1030]: 2026/09/20 12:44:11 INFO Received uploads request method=POST path=/api/pending_closures5699worker1 # [ 92.701055] nix-grpc-daemon[1279]: time=2026-09-20T12:44:10.972Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5700worker1 # [ 92.703247] nix-grpc-daemon[1279]: time=2026-09-20T12:44:10.974Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5701lb # [ 92.725368] niks3-server[1030]: 2026/09/20 12:44:11 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5702lb # [ 92.730819] niks3-server[1030]: 2026/09/20 12:44:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5703lb # [ 92.732946] niks3-server[1030]: 2026/09/20 12:44:11 INFO Signed narinfos id=33 count=15704worker1 # [ 92.722876] nix-grpc-daemon[1279]: time=2026-09-20T12:44:10.994Z level=INFO msg="Uploading 1 narinfos"5705lb # [ 92.739503] niks3-server[1030]: 2026/09/20 12:44:11 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5706lb # [ 92.745408] niks3-server[1030]: 2026/09/20 12:44:11 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5707lb # [ 92.749497] niks3-server[1030]: 2026/09/20 12:44:11 INFO Completed upload id=335708worker1 # [ 92.737657] nix-grpc-daemon[1279]: time=2026-09-20T12:44:11.009Z level=INFO msg="Upload complete. (422ms)"5709worker1 # [ 92.741131] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42004 duration_s=0 paths=1 nar_bytes_in=4165710lb # [ 92.754650] niks3-server[1030]: 2026/09/20 12:44:11 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5711worker1 # [ 92.744613] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:420045712worker1 # [ 92.754620] nix-daemon[842]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5713worker1 # [ 92.757893] nix-daemon[842]: reaped child process 1405, status = succeeded5714client # [ 92.790782] nix[1175]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5715worker1 # [ 92.765268] nix-daemon[842]: accepted connection from pid 1209, user nix-grpc-daemon (trusted)5716lb: must succeed: curl -sf localhost:9901/clusters5717lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5718lb: must succeed: curl -sf localhost:9901/clusters5719lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5720lb: must succeed: curl -sf localhost:9901/clusters5721lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5722lb: must succeed: curl -sf localhost:9901/clusters5723lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5724worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5725worker2 # [ 94.811549] systemd-journald[289]: Received client request to rotate journal, rotating.5726worker2 # [ 94.824552] systemd-journald[289]: Vacuuming done, freed 0B of archived journals from /var/log/journal/e4107af9a3364f4689bd6bcdb4ccd335.5727worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.05 seconds)5728worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5729worker1 # [ 94.714745] systemd[1]: Stopping Nix worker-protocol over gRPC...5730worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)5731??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5732 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735733client: must succeed: sleep 5.05734worker1 # [ 95.584060] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:13Z level=info event=draining5735lb # [ 96.817668] envoy[909]: conn peer=[2001:db8:1::1]:48254 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9620 tx=3881 ms=69605736client: (finished: must succeed: sleep 5.0, in 5.03 seconds)5737worker1 # [ 99.993488] nix-daemon[842]: reaped child process 1419, status = succeeded5738worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5739worker1 # [ 100.151460] nix-daemon[842]: accepted connection from pid 1459, user nix-grpc-daemon (trusted)5740worker1 # [ 100.167148] nix-daemon[842]: reaped child process 1462, status = succeeded5741lb # [ 100.190324] niks3-server[1030]: 2026/09/20 12:44:18 INFO Received uploads request method=POST path=/api/pending_closures5742worker1 # [ 100.189084] nix-grpc-daemon[1279]: time=2026-09-20T12:44:18.460Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5743worker1 # [ 100.193707] nix-grpc-daemon[1279]: time=2026-09-20T12:44:18.462Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5744lb # [ 100.229841] niks3-server[1030]: 2026/09/20 12:44:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5745lb # [ 100.232737] niks3-server[1030]: 2026/09/20 12:44:18 INFO Signed narinfos id=34 count=15746worker1 # [ 100.223087] nix-grpc-daemon[1279]: time=2026-09-20T12:44:18.494Z level=INFO msg="Uploading 1 narinfos"5747lb # [ 100.243556] niks3-server[1030]: 2026/09/20 12:44:18 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5748lb # [ 100.249470] niks3-server[1030]: 2026/09/20 12:44:18 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5749lb # [ 100.259902] niks3-server[1030]: 2026/09/20 12:44:18 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5750lb # [ 100.267021] niks3-server[1030]: 2026/09/20 12:44:18 INFO Completed upload id=345751worker1 # [ 100.254964] nix-grpc-daemon[1279]: time=2026-09-20T12:44:18.526Z level=INFO msg="Upload complete. (272ms)"5752lb # [ 100.268971] niks3-server[1030]: 2026/09/20 12:44:18 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5753lb # [ 100.273690] niks3-server[1030]: 2026/09/20 12:44:18 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5754worker1 # [ 100.260663] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42004 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15755worker1 # [ 100.270731] nix-daemon[842]: reaped child process 1417, status = succeeded5756client # [ 100.324828] systemd[1]: rs.service: Deactivated successfully.5757client # [ 100.328139] systemd[1]: rs.service: Consumed 157ms CPU time over 8.306s wall clock time, 39.1M memory peak, 8.3K incoming IP traffic, 8.8K outgoing IP traffic.5758worker1 # [ 100.584553] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:18Z level=info event=signal_exit5759worker1 # [ 100.799332] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:19Z level=info event=scheduler_yield5760lb # [ 100.813204] niks3-server[1030]: 2026/09/20 12:44:19 INFO lead: released remote=192.168.1.3:458025761worker1 # [ 100.804509] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:19Z level=info event=scheduler_restarting addr=lb:500515762worker2 # [ 100.835192] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:19Z level=info event=scheduler_restarting addr=lb:500515763worker1 # [ 100.807577] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:420025764worker1 # [ 100.809576] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:19Z level=info event=worker_gone addr=192.168.1.4:500515765worker1 # [ 100.811346] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:420025766worker1 # [ 100.813228] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:19Z level=info event=worker_gone addr=192.168.1.3:500515767worker1 # [ 101.005667] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:19Z level=info event=scheduler_connected addr=lb:500515768worker2 # [ 101.035656] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:19Z level=info event=scheduler_connected addr=lb:500515769worker1 # [ 101.009626] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5770worker2 # [ 101.038926] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5771worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.10 seconds)5772client: waiting for success: ! systemctl is-active rs5773client: (finished: waiting for success: ! systemctl is-active rs, in 0.05 seconds)5774client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5775client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5776client: must fail: journalctl -u rs | grep -q 'reconnecting'5777worker2 # [ 101.240287] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:19Z level=info event=scheduler_connected addr=lb:500515778worker1 # [ 101.210987] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:19Z level=info event=scheduler_connected addr=lb:500515779worker2 # [ 101.244596] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5780worker1 # [ 101.216262] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5781client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5782lb: must succeed: curl -sf localhost:9901/clusters5783lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5784worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5785worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5786worker2 # [ 101.446591] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:19Z level=info event=scheduler_connected addr=lb:500515787worker1 # [ 101.418899] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:19Z level=info event=scheduler_connected addr=lb:500515788worker2 # [ 101.449578] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5789worker1 # [ 101.420785] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5790worker1 # [ 101.620194] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:19Z level=info event=scheduler_connected addr=lb:500515791worker2 # [ 101.651173] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:19Z level=info event=scheduler_connected addr=lb:500515792worker1 # [ 101.623179] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5793worker2 # [ 101.654307] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5794lb # [ 101.685599] niks3-server[1030]: 2026/09/20 12:44:19 INFO lead: acquired remote=192.168.1.4:575085795worker2 # [ 101.702588] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:19Z level=info event=scheduler_take_over5796worker1 # [ 101.803174] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:20Z level=info event=scheduler_restarting5797worker1 # [ 101.822681] nix-daemon[842]: reaped child process 1270, status = succeeded5798worker2 # [ 101.856526] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:20Z level=info event=scheduler_connected addr=lb:500515799worker2 # [ 101.858714] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5800worker1 # [ 101.831725] nix-grpc-daemon[1209]: ts=2026-09-20T12:44:20Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5801worker2 # [ 102.058065] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:20Z level=info event=scheduler_connected addr=lb:500515802worker2 # [ 102.060928] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5803worker2 # [ 102.262388] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:20Z level=info event=scheduler_connected addr=lb:500515804worker2 # [ 102.265175] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5805worker1 # [ 102.357171] nix-grpc-daemon[1209]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5806worker1 # [ 102.359249] nix-grpc-daemon[1209]: E0000 00:00:1789908260.628997 1252 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5807lb: must succeed: curl -sf localhost:9901/clusters5808worker1 # [ 102.361971] nix-grpc-daemon[1209]: E0000 00:00:1789908260.629182 1252 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5809lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5810worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5811worker2 # [ 102.466294] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:20Z level=info event=scheduler_connected addr=lb:500515812worker2 # [ 102.469047] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5813worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5814worker2 # [ 102.669908] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:20Z level=info event=scheduler_connected addr=lb:500515815worker2 # [ 102.672042] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5816worker2 # [ 102.874070] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:21Z level=info event=scheduler_connected addr=lb:500515817worker2 # [ 102.884132] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:21Z level=info event=oidc_jwks provider=mock keys=15818worker2 # [ 102.886280] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:21Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:489585819worker2 # [ 102.888315] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:21Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05820worker1 # [ 103.383594] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5821worker1 # [ 103.386874] systemd[1]: Stopped Nix worker-protocol over gRPC.5822worker1 # [ 103.388439] systemd[1]: nix-grpc-daemon.service: Consumed 1.660s CPU time over 26.036s wall clock time, 33.7M memory peak, 49.3K incoming IP traffic, 101.4K outgoing IP traffic.5823worker1 # [ 103.403199] systemd[1]: Starting Nix worker-protocol over gRPC...5824lb: must succeed: curl -sf localhost:9901/clusters5825lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5826worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5827worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)5828worker1 # [ 103.627423] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:21Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5829worker1 # [ 103.631217] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:21Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5830worker1 # [ 103.634900] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:21Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15831worker1 # [ 103.643183] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:21Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5832worker1 # [ 103.648125] systemd[1]: Started Nix worker-protocol over gRPC.5833worker1 # [ 103.661139] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:21Z level=info event=scheduler_connected addr=lb:500515834worker2 # [ 103.692670] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:21Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:489585835worker2 # [ 103.695538] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:21Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05836lb: must succeed: curl -sf localhost:9901/clusters5837lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5838worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5839worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)5840(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.76 seconds)5841subtest: scheduler restart mid-build: build finishes, no double build5842client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5843client # [ 104.773870] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5844client # Running as unit: mid.service; invocation ID: 61b7d265b5f849dc99d76d2fb5bd10975845client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.04 seconds)5846worker2 # [ 105.016629] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:489605847worker2 # [ 105.023864] nix-daemon[857]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)5848client # [ 105.030717] nix[1211]: don't know how to build these paths:5849client # [ 105.031806] nix[1211]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5850worker2 # [ 105.039519] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:23Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05851worker2 # [ 105.041665] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:23Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15852worker2 # [ 105.088306] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:489605853worker2 # [ 105.095557] nix-grpc-daemon[1184]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 30 ms (attempt 1/5)5854worker2 # [ 105.128478] nix-grpc-daemon[1184]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 2/5)5855worker2 # [ 105.133557] nix-grpc-daemon[1184]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 283 ms (attempt 3/5)5856worker2 # [ 105.419675] nix-grpc-daemon[1184]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 168 ms (attempt 4/5)5857worker2 # [ 105.591553] nix-grpc-daemon[1184]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5858worker2 # [ 105.606148] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:489605859client # [ 105.611281] nix[1211]: copying 1 paths to 'lb:50051'...5860client # [ 105.614047] nix[1211]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5861worker2 # [ 105.617249] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:489605862worker2 # [ 105.624127] nix-daemon[857]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)5863worker2 # [ 105.640385] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:23Z level=info event=niks3_push_started pid=12995864worker2 # [ 105.830924] nix-grpc-daemon[1299]: time=2026-09-20T12:44:24.097Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""5865worker2 # [ 106.003154] nix-daemon[857]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5866worker2 # [ 106.026659] nix-daemon[857]: reaped child process 1319, status = succeeded5867worker2 # [ 106.165347] nix-daemon[857]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)5868worker2 # [ 106.180458] nix-daemon[857]: reaped child process 1324, status = succeeded5869lb # [ 106.177141] niks3-server[1030]: 2026/09/20 12:44:24 INFO Received uploads request method=POST path=/api/pending_closures5870worker2 # [ 106.199921] nix-grpc-daemon[1299]: time=2026-09-20T12:44:24.467Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5871worker2 # [ 106.201914] nix-grpc-daemon[1299]: time=2026-09-20T12:44:24.469Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5872lb # [ 106.210161] niks3-server[1030]: 2026/09/20 12:44:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5873lb # [ 106.218784] niks3-server[1030]: 2026/09/20 12:44:24 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5874lb # [ 106.223186] niks3-server[1030]: 2026/09/20 12:44:24 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5875lb # [ 106.230418] niks3-server[1030]: 2026/09/20 12:44:24 INFO Signed narinfos id=35 count=15876worker2 # [ 106.247853] nix-grpc-daemon[1299]: time=2026-09-20T12:44:24.514Z level=INFO msg="Uploading 1 narinfos"5877lb # [ 106.239314] niks3-server[1030]: 2026/09/20 12:44:24 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5878lb # [ 106.250327] niks3-server[1030]: 2026/09/20 12:44:24 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5879lb # [ 106.256599] niks3-server[1030]: 2026/09/20 12:44:24 INFO Completed upload id=355880worker2 # [ 106.273598] nix-grpc-daemon[1299]: time=2026-09-20T12:44:24.541Z level=INFO msg="Upload complete. (435ms)"5881worker2 # [ 106.278471] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48960 duration_s=0 paths=1 nar_bytes_in=4245882worker2 # [ 106.283409] nix-grpc-daemon[1184]: ts=2026-09-20T12:44:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:489605883worker2 # [ 106.295918] nix-daemon[857]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)5884worker2 # [ 106.302248] nix-daemon[857]: reaped child process 1297, status = succeeded5885worker2 # [ 106.306624] nix-daemon[857]: accepted connection from pid 1184, user nix-grpc-daemon (trusted)5886client # [ 106.304147] nix[1211]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5887lb # [ 106.818160] envoy[909]: conn peer=[2001:db8:1::1]:48262 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2917 tx=1307 ms=80625888lb # [ 106.821069] envoy[909]: conn peer=[2001:db8:1::3]:43666 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5568 tx=1298 ms=242425889lb: must succeed: curl -sf localhost:9901/clusters5890lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5891lb: must succeed: curl -sf localhost:9901/clusters5892lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5893worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5894worker2 # [ 107.402547] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1184 (nix-grpc-daemon) on client request.5895worker2 # [ 107.406451] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5896lb # [ 107.395740] niks3-server[1030]: 2026/09/20 12:44:25 INFO lead: released remote=192.168.1.4:575085897worker1 # [ 107.392285] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5898client # [ 107.419752] nix[1211]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5899client # [ 107.421888] nix[1211]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5900worker2 # [ 107.436397] systemd[1]: Starting scheduler-token.service...5901worker2 # [ 107.437934] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5902worker2 # [ 107.441657] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5903worker2 # [ 107.445674] systemd[1]: nix-grpc-daemon.service: Consumed 532ms CPU time over 15.932s wall clock time, 31.1M memory peak, 17.4K incoming IP traffic, 32.5K outgoing IP traffic.5904worker2 # [ 107.470644] nix-daemon[857]: reaped child process 1290, status = succeeded5905worker2 # [ 107.472444] nix-daemon[857]: reaped child process 1326, status = succeeded5906worker2 # [ 107.487418] nix-daemon[1328]: unexpected Nix daemon error: error: interrupted by the user5907worker2 # [ 107.495916] nix-daemon[857]: reaped child process 1328, status = failed with exit code 15908worker2 # [ 107.536680] systemd[1]: scheduler-token.service: Deactivated successfully.5909worker2 # [ 107.538086] systemd[1]: Finished scheduler-token.service.5910worker2 # [ 107.539611] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 100ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5911worker2 # [ 107.543061] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5912worker2 # [ 107.550848] systemd[1]: Starting scheduler-token.service...5913worker1 # [ 107.592981] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:25Z level=info event=scheduler_connected addr=lb:500515914worker2 # [ 107.628707] systemd[1]: scheduler-token.service: Deactivated successfully.5915worker2 # [ 107.630738] systemd[1]: Finished scheduler-token.service.5916worker2 # [ 107.632235] systemd[1]: scheduler-token.service: Consumed 26ms CPU time over 79ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5917worker2 # [ 107.638281] systemd[1]: Starting Nix worker-protocol over gRPC...5918worker2 # [ 107.769968] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:26Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5919worker2 # [ 107.772244] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5920worker2 # [ 107.776476] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:26Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15921worker2 # [ 107.783066] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:26Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5922worker2 # [ 107.787201] systemd[1]: Started Nix worker-protocol over gRPC.5923lb # [ 107.778240] niks3-server[1030]: 2026/09/20 12:44:26 INFO lead: acquired remote=192.168.1.4:390585924worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.44 seconds)5925client: must succeed: sleep 5.05926worker2 # [ 107.799356] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:26Z level=info event=scheduler_take_over5927worker1 # [ 107.772140] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5928worker2 # [ 107.804076] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:26Z level=info event=scheduler_connected addr=lb:500515929worker2 # [ 107.809587] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:26Z level=info event=oidc_jwks provider=mock keys=15930worker2 # [ 107.810919] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:26Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:489645931worker2 # [ 107.812794] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:26Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05932worker2 # [ 107.934120] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:26Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05933worker2 # [ 107.937597] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:26Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15934worker2 # [ 107.983172] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:489945935worker2 # [ 107.991346] nix-daemon[857]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5936worker2 # [ 108.002457] nix-daemon[857]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5937worker1 # [ 107.973065] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:26Z level=info event=scheduler_connected addr=lb:500515938worker2 # [ 108.005049] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:26Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:489645939worker2 # [ 108.009067] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:26Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05940client # [ 108.016766] nix[1211]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5941worker2 # [ 108.020817] nix-daemon[857]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5942client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5943client: waiting for success: ! systemctl is-active mid5944worker2 # [ 113.240253] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:31Z level=info event=niks3_push_started pid=14455945worker2 # [ 113.255908] nix-daemon[857]: reaped child process 1421, status = succeeded5946worker2 # [ 113.426890] nix-grpc-daemon[1445]: time=2026-09-20T12:44:31.693Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""5947worker2 # [ 113.611861] nix-daemon[857]: accepted connection from pid 1458, user nix-grpc-daemon (trusted)5948worker2 # [ 113.633278] nix-daemon[857]: reaped child process 1461, status = succeeded5949lb # [ 113.630511] niks3-server[1030]: 2026/09/20 12:44:31 INFO Received uploads request method=POST path=/api/pending_closures5950worker2 # [ 113.655427] nix-grpc-daemon[1445]: time=2026-09-20T12:44:31.922Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5951worker2 # [ 113.657271] nix-grpc-daemon[1445]: time=2026-09-20T12:44:31.924Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5952lb # [ 113.671540] niks3-server[1030]: 2026/09/20 12:44:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5953lb # [ 113.674919] niks3-server[1030]: 2026/09/20 12:44:31 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5954lb # [ 113.679946] niks3-server[1030]: 2026/09/20 12:44:31 INFO Signed narinfos id=36 count=15955worker2 # [ 113.699651] nix-grpc-daemon[1445]: time=2026-09-20T12:44:31.966Z level=INFO msg="Uploading 1 narinfos"5956lb # [ 113.685408] niks3-server[1030]: 2026/09/20 12:44:31 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5957lb # [ 113.701211] niks3-server[1030]: 2026/09/20 12:44:31 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5958lb # [ 113.734094] niks3-server[1030]: 2026/09/20 12:44:32 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5959worker2 # [ 113.774058] nix-grpc-daemon[1445]: time=2026-09-20T12:44:32.041Z level=INFO msg="Upload complete. (343ms)"5960lb # [ 113.757426] niks3-server[1030]: 2026/09/20 12:44:32 INFO Completed upload id=365961worker2 # [ 113.778127] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48994 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15962worker2 # [ 113.787302] nix-daemon[857]: reaped child process 1419, status = succeeded5963lb # [ 113.770886] niks3-server[1030]: 2026/09/20 12:44:32 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5964client # [ 113.813541] systemd[1]: mid.service: Deactivated successfully.5965client # [ 113.816912] systemd[1]: mid.service: Consumed 163ms CPU time over 9.041s wall clock time, 39.3M memory peak, 9.7K incoming IP traffic, 10.8K outgoing IP traffic.5966client: (finished: waiting for success: ! systemctl is-active mid, in 1.10 seconds)5967client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5968client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)5969(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 9.47 seconds)5970subtest: interrupting the client stops the build on the worker5971client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5972client # [ 114.241906] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5973client # Running as unit: intr.service; invocation ID: ab0688e5f76047028848fd82a46b00255974client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.05 seconds)5975worker1 # [ 114.432316] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:601725976worker1 # [ 114.440867] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)5977client # [ 114.478232] nix[1247]: don't know how to build these paths:5978client # [ 114.479354] nix[1247]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5979worker2 # [ 114.495175] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:32Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05980worker2 # [ 114.498252] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:32Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15981worker1 # [ 114.514784] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601725982worker1 # [ 114.524300] nix-grpc-daemon[1472]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 1/5)5983worker1 # [ 114.527721] nix-grpc-daemon[1472]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 2/5)5984worker1 # [ 114.542201] nix-grpc-daemon[1472]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 133 ms (attempt 3/5)5985worker1 # [ 114.675679] nix-grpc-daemon[1472]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 548 ms (attempt 4/5)5986worker1 # [ 115.227932] nix-grpc-daemon[1472]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5987worker1 # [ 115.240837] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601725988client # [ 115.274124] nix[1247]: copying 1 paths to 'lb:50051'...5989client # [ 115.276626] nix[1247]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5990worker1 # [ 115.251084] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:601725991worker1 # [ 115.259092] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)5992worker1 # [ 115.280827] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:33Z level=info event=niks3_push_started pid=15565993worker1 # [ 115.520282] nix-grpc-daemon[1556]: time=2026-09-20T12:44:33.791Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""5994worker1 # [ 115.701993] nix-daemon[842]: accepted connection from pid 1573, user nix-grpc-daemon (trusted)5995worker1 # [ 115.727724] nix-daemon[842]: reaped child process 1576, status = succeeded5996worker1 # [ 115.882877] nix-daemon[842]: accepted connection from pid 1578, user nix-grpc-daemon (trusted)5997worker1 # [ 115.900890] nix-daemon[842]: reaped child process 1581, status = succeeded5998lb # [ 115.924247] niks3-server[1030]: 2026/09/20 12:44:34 INFO Received uploads request method=POST path=/api/pending_closures5999worker1 # [ 115.920099] nix-grpc-daemon[1556]: time=2026-09-20T12:44:34.191Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6000worker1 # [ 115.921559] nix-grpc-daemon[1556]: time=2026-09-20T12:44:34.191Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"6001lb # [ 115.952799] niks3-server[1030]: 2026/09/20 12:44:34 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst6002lb # [ 115.957261] niks3-server[1030]: 2026/09/20 12:44:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign6003lb # [ 115.960089] niks3-server[1030]: 2026/09/20 12:44:34 INFO Signed narinfos id=37 count=16004worker1 # [ 115.948392] nix-grpc-daemon[1556]: time=2026-09-20T12:44:34.220Z level=INFO msg="Uploading 1 narinfos"6005lb # [ 115.966277] niks3-server[1030]: 2026/09/20 12:44:34 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls6006lb # [ 115.970158] niks3-server[1030]: 2026/09/20 12:44:34 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete6007lb # [ 115.976696] niks3-server[1030]: 2026/09/20 12:44:34 INFO Completed upload id=376008worker1 # [ 115.964823] nix-grpc-daemon[1556]: time=2026-09-20T12:44:34.236Z level=INFO msg="Upload complete. (440ms)"6009lb # [ 115.979085] niks3-server[1030]: 2026/09/20 12:44:34 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo6010worker1 # [ 115.968584] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=0 paths=1 nar_bytes_in=4246011worker1 # [ 115.972743] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726012worker1 # [ 115.982077] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6013worker1 # [ 115.984893] nix-daemon[842]: reaped child process 1554, status = succeeded6014client # [ 116.017166] nix[1247]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...6015worker1 # [ 115.991199] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6016lb # [ 116.818359] envoy[909]: conn peer=[2001:db8:1::4]:53838 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=9471 tx=675 ms=157126017lb # [ 116.820602] envoy[909]: conn peer=[2001:db8:1::1]:58578 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3865 tx=1655 ms=87836018client: must succeed: systemctl kill -s INT intr6019client # [ 117.707624] systemd[1]: intr.service: Sent signal SIGINT to main process 1247 (nix) on client request.6020client # [ 117.711403] nix[1247]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)6021client: (finished: must succeed: systemctl kill -s INT intr, in 0.03 seconds)6022worker1 # [ 117.687768] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:35Z level=info event=revoked_running drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv6023client # [ 117.716296] nix[1247]: error: interrupted by the user6024client # [ 117.739264] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE6025client # [ 117.741566] systemd[1]: intr.service: Failed with result 'exit-code'.6026client # [ 117.744089] systemd[1]: intr.service: Consumed 139ms CPU time over 3.499s wall clock time, 37.3M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic.6027worker1 # [ 117.815701] nix-daemon[842]: reaped child process 1583, status = succeeded6028worker1 # [ 117.819346] nix-daemon[1585]: unexpected Nix daemon error: error: interrupted by the user6029worker1 # [ 117.825578] nix-daemon[842]: reaped child process 1585, status = failed with exit code 16030(finished: subtest: interrupting the client stops the build on the worker, in 4.69 seconds)6031subtest: a deploy mid-build drains: the build finishes, the new generation takes over6032client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw6033client # [ 118.922826] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.6034client # Running as unit: sw.service; invocation ID: 481a471807bb47778eddbf43775e50506035client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.04 seconds)6036worker2 # [ 119.089116] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:489946037client # [ 119.087940] nix[1268]: don't know how to build these paths:6038client # [ 119.089402] nix[1268]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6039worker2 # [ 119.096984] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:37Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=06040worker2 # [ 119.099262] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:37Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=16041worker2 # [ 119.140882] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:489946042worker2 # [ 119.146665] nix-grpc-daemon[1366]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 29 ms (attempt 1/5)6043worker2 # [ 119.178167] nix-grpc-daemon[1366]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 143 ms (attempt 2/5)6044worker2 # [ 119.323841] nix-grpc-daemon[1366]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 259 ms (attempt 3/5)6045worker2 # [ 119.585635] nix-grpc-daemon[1366]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 699 ms (attempt 4/5)6046worker2 # [ 120.289223] nix-grpc-daemon[1366]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6047worker2 # [ 120.305411] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:489946048client # [ 120.310449] nix[1268]: copying 1 paths to 'lb:50051'...6049worker2 # [ 120.313824] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:489946050client # [ 120.312066] nix[1268]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...6051worker2 # [ 120.322240] nix-daemon[857]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6052worker2 # [ 120.515336] nix-daemon[857]: accepted connection from pid 1504, user nix-grpc-daemon (trusted)6053worker2 # [ 120.537276] nix-daemon[857]: reaped child process 1507, status = succeeded6054worker2 # [ 120.680060] nix-daemon[857]: accepted connection from pid 1509, user nix-grpc-daemon (trusted)6055worker2 # [ 120.695404] nix-daemon[857]: reaped child process 1512, status = succeeded6056lb # [ 120.686642] niks3-server[1030]: 2026/09/20 12:44:38 INFO Received uploads request method=POST path=/api/pending_closures6057worker2 # [ 120.709938] nix-grpc-daemon[1445]: time=2026-09-20T12:44:38.977Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6058worker2 # [ 120.712383] nix-grpc-daemon[1445]: time=2026-09-20T12:44:38.979Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"6059lb # [ 120.711529] niks3-server[1030]: 2026/09/20 12:44:39 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst6060lb # [ 120.719357] niks3-server[1030]: 2026/09/20 12:44:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign6061lb # [ 120.722647] niks3-server[1030]: 2026/09/20 12:44:39 INFO Signed narinfos id=38 count=16062worker2 # [ 120.739991] nix-grpc-daemon[1445]: time=2026-09-20T12:44:39.007Z level=INFO msg="Uploading 1 narinfos"6063lb # [ 120.727282] niks3-server[1030]: 2026/09/20 12:44:39 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls6064lb # [ 120.737639] niks3-server[1030]: 2026/09/20 12:44:39 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete6065lb # [ 120.743424] niks3-server[1030]: 2026/09/20 12:44:39 INFO Completed upload id=386066worker2 # [ 120.760507] nix-grpc-daemon[1445]: time=2026-09-20T12:44:39.027Z level=INFO msg="Upload complete. (430ms)"6067worker2 # [ 120.763087] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48994 duration_s=0 paths=1 nar_bytes_in=4166068lb # [ 120.746795] niks3-server[1030]: 2026/09/20 12:44:39 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo6069worker2 # [ 120.766912] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:489946070worker2 # [ 120.775896] nix-daemon[857]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6071worker2 # [ 120.777542] nix-daemon[857]: reaped child process 1502, status = succeeded6072client # [ 120.780466] nix[1268]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...6073worker2 # [ 120.784071] nix-daemon[857]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6074worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&26075worker2 # Checking switch inhibitors... done6076worker2 # [ 123.038147] nixos[1547]: switching to system configuration /nix/store/gzvb2ckwmbk59ym95x79msvcana0arax-nixos-system-worker2-test6077worker2 # activating the configuration...6078worker2 # [ 123.041418] systemd[1]: Stopped target Local File Systems.6079worker2 # [ 123.042363] systemd[1]: Stopped target Remote File Systems.6080worker2 # setting up /etc...6081worker2 # [ 123.637652] systemd[1]: Reload requested from client PID 1547 ('.switch-to-conf') (unit backdoor.service)...6082worker2 # [ 123.639318] systemd[1]: Reloading...6083worker2 # [ 124.223209] systemd[1]: Reloading finished in 582 ms.6084worker2 # restarting sysinit-reactivation.target6085worker2 # [ 124.277549] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....6086worker2 # [ 124.412383] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..6087worker2 # [ 124.413605] systemd[1]: Reached target Reactivate sysinit units.6088worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service6089worker2 # [ 124.418746] systemd[1]: Reloading D-Bus System Message Bus...6090worker2 # [ 124.419915] dbus-broker-launch[536]: Caught SIGHUP, trigger reload.6091worker2 # [ 124.423252] systemd[1]: Reloading Nix worker-protocol over gRPC...6092worker2 # [ 124.452698] dbus-broker-launch[536]: Looking up NSS user entry for 'systemd-timesync'...6093worker2 # [ 124.455122] dbus-broker-launch[536]: NSS returned no entry for 'systemd-timesync'6094worker2 # [ 124.456546] dbus-broker-launch[536]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"6095worker2 # [ 124.462384] systemd[1]: Reloaded Nix worker-protocol over gRPC.6096worker2 # [ 124.485511] systemd[1]: Reloaded D-Bus System Message Bus.6097worker2 # [ 124.489064] systemd[1]: Reached target Local File Systems.6098worker2 # [ 124.489865] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore6099worker2 # [ 124.495488] systemd[1]: Starting Create SUID/SGID Wrappers...6100worker2 # [ 124.496433] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.6101worker2 # [ 124.499572] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc676102worker2 # [ 124.501580] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore6103worker2 # [ 124.503379] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6104worker2 # [ 124.504892] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6105worker2 # [ 124.514469] systemd[1]: Reached target Remote File Systems.6106worker2 # [ 124.520467] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os6107worker2 # [ 124.521703] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki6108worker2 # [ 124.791481] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:43Z level=info event=draining6109worker2 # [ 124.870468] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.6110worker2 # [ 124.876443] systemd[1]: Finished Create SUID/SGID Wrappers.6111worker2 # [ 124.878913] systemd[1]: Starting linger-users.service...6112worker2 # [ 124.919962] systemd[1]: linger-users.service: Deactivated successfully.6113worker2 # [ 124.921233] systemd[1]: Finished linger-users.service.6114worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service6115worker2 # [ 125.178474] nixos[1547]: finished switching to system configuration /nix/store/gzvb2ckwmbk59ym95x79msvcana0arax-nixos-system-worker2-test6116worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 2.82 seconds)6117worker2: must succeed: pgrep -f 'read -t [9]0 x'6118worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)6119client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&26120worker1 # [ 125.393643] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:601726121client # don't know how to build these paths:6122client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6123worker1 # [ 125.402443] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601726124worker2 # [ 125.444772] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:43Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06125worker2 # [ 125.446527] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:43Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=16126worker1 # [ 125.459639] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726127worker1 # [ 125.471146] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601726128client # copying 1 paths to 'lb:50051'...6129worker1 # [ 125.481102] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:601726130client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6131worker1 # [ 125.493651] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6132worker1 # [ 125.668634] nix-daemon[842]: accepted connection from pid 1639, user nix-grpc-daemon (trusted)6133worker1 # [ 125.685818] nix-daemon[842]: reaped child process 1642, status = succeeded6134worker1 # [ 125.847712] nix-daemon[842]: accepted connection from pid 1644, user nix-grpc-daemon (trusted)6135worker1 # [ 125.866518] nix-daemon[842]: reaped child process 1647, status = succeeded6136lb # [ 125.891506] niks3-server[1030]: 2026/09/20 12:44:44 INFO Received uploads request method=POST path=/api/pending_closures6137worker1 # [ 125.895551] nix-grpc-daemon[1556]: time=2026-09-20T12:44:44.166Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6138worker1 # [ 125.897309] nix-grpc-daemon[1556]: time=2026-09-20T12:44:44.166Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6139lb # [ 125.919721] niks3-server[1030]: 2026/09/20 12:44:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6140lb # [ 125.921922] niks3-server[1030]: 2026/09/20 12:44:44 INFO Signed narinfos id=39 count=16141worker1 # [ 125.911496] nix-grpc-daemon[1556]: time=2026-09-20T12:44:44.183Z level=INFO msg="Uploading 1 narinfos"6142lb # [ 125.930364] niks3-server[1030]: 2026/09/20 12:44:44 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6143lb # [ 125.939622] niks3-server[1030]: 2026/09/20 12:44:44 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6144lb # [ 125.949509] niks3-server[1030]: 2026/09/20 12:44:44 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6145lb # [ 125.958552] niks3-server[1030]: 2026/09/20 12:44:44 INFO Completed upload id=396146worker1 # [ 125.946656] nix-grpc-daemon[1556]: time=2026-09-20T12:44:44.218Z level=INFO msg="Upload complete. (445ms)"6147worker1 # [ 125.950136] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=0 paths=1 nar_bytes_in=5286148worker1 # [ 125.952785] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726149lb # [ 125.966950] niks3-server[1030]: 2026/09/20 12:44:44 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6150worker1 # [ 125.958392] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6151worker1 # [ 125.968254] nix-daemon[842]: reaped child process 1637, status = succeeded6152client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6153client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6154worker1 # [ 125.972217] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6155lb # [ 126.819297] envoy[909]: conn peer=[2001:db8:1::1]:37874 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=755 ms=32746156client # farm-a> LOG-farm-a-during-drain6157worker1 # [ 127.004226] nix-daemon[842]: reaped child process 1651, status = succeeded6158worker1 # [ 127.159961] nix-daemon[842]: accepted connection from pid 1666, user nix-grpc-daemon (trusted)6159worker1 # [ 127.172904] nix-daemon[842]: reaped child process 1669, status = succeeded6160lb # [ 127.197813] niks3-server[1030]: 2026/09/20 12:44:45 INFO Received uploads request method=POST path=/api/pending_closures6161worker1 # [ 127.266432] nix-grpc-daemon[1556]: time=2026-09-20T12:44:45.537Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6162worker1 # [ 127.273804] nix-grpc-daemon[1556]: time=2026-09-20T12:44:45.540Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6163lb # [ 127.303293] niks3-server[1030]: 2026/09/20 12:44:45 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6164lb # [ 127.318551] niks3-server[1030]: 2026/09/20 12:44:45 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6165lb # [ 127.321967] niks3-server[1030]: 2026/09/20 12:44:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6166lb # [ 127.324381] niks3-server[1030]: 2026/09/20 12:44:45 INFO Signed narinfos id=40 count=16167worker1 # [ 127.315170] nix-grpc-daemon[1556]: time=2026-09-20T12:44:45.586Z level=INFO msg="Uploading 1 narinfos"6168lb # [ 127.332885] niks3-server[1030]: 2026/09/20 12:44:45 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6169lb # [ 127.340989] niks3-server[1030]: 2026/09/20 12:44:45 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6170lb # [ 127.347417] niks3-server[1030]: 2026/09/20 12:44:45 INFO Completed upload id=406171lb # [ 127.349537] niks3-server[1030]: 2026/09/20 12:44:45 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6172worker1 # [ 127.337273] nix-grpc-daemon[1556]: time=2026-09-20T12:44:45.609Z level=INFO msg="Upload complete. (354ms)"6173worker1 # [ 127.343683] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16174worker2 # [ 127.376432] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:45Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06175worker2 # [ 127.379241] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:45Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=16176worker1 # [ 127.360272] nix-daemon[842]: reaped child process 1649, status = succeeded6177worker1 # [ 127.394189] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726178worker1 # [ 127.410592] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601726179worker1 # [ 127.427908] nix-grpc-daemon[1556]: time=2026-09-20T12:44:45.699Z level=INFO msg="All 1 paths already cached"6180client # copying 1 paths to 'lb:50051'...6181client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6182worker1 # [ 127.434867] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:601726183worker1 # [ 127.446188] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6184worker1 # [ 127.613103] nix-daemon[842]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6185worker1 # [ 127.628429] nix-daemon[842]: reaped child process 1676, status = succeeded6186worker1 # [ 127.790364] nix-daemon[842]: accepted connection from pid 1678, user nix-grpc-daemon (trusted)6187worker1 # [ 127.806077] nix-daemon[842]: reaped child process 1681, status = succeeded6188lb # [ 127.829685] niks3-server[1030]: 2026/09/20 12:44:46 INFO Received uploads request method=POST path=/api/pending_closures6189worker1 # [ 127.827179] nix-grpc-daemon[1556]: time=2026-09-20T12:44:46.099Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6190worker1 # [ 127.828729] nix-grpc-daemon[1556]: time=2026-09-20T12:44:46.100Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6191lb # [ 127.868159] niks3-server[1030]: 2026/09/20 12:44:46 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6192lb # [ 127.876646] niks3-server[1030]: 2026/09/20 12:44:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6193worker1 # [ 127.871640] nix-grpc-daemon[1556]: time=2026-09-20T12:44:46.143Z level=INFO msg="Uploading 1 narinfos"6194lb # [ 127.883319] niks3-server[1030]: 2026/09/20 12:44:46 INFO Signed narinfos id=41 count=16195lb # [ 127.890269] niks3-server[1030]: 2026/09/20 12:44:46 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6196lb # [ 127.902246] niks3-server[1030]: 2026/09/20 12:44:46 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6197lb # [ 127.906974] niks3-server[1030]: 2026/09/20 12:44:46 INFO Completed upload id=416198worker1 # [ 127.894991] nix-grpc-daemon[1556]: time=2026-09-20T12:44:46.167Z level=INFO msg="Upload complete. (436ms)"6199worker1 # [ 127.897312] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=0 paths=1 nar_bytes_in=6406200lb # [ 127.909917] niks3-server[1030]: 2026/09/20 12:44:46 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6201worker1 # [ 127.900641] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726202worker1 # [ 127.906529] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6203worker1 # [ 127.913048] nix-daemon[842]: reaped child process 1671, status = succeeded6204client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6205worker1 # [ 127.919913] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6206client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6207client # farm-b> LOG-farm-b-during-drain6208worker1 # [ 129.141899] nix-daemon[842]: reaped child process 1685, status = succeeded6209worker1 # [ 129.263956] nix-daemon[842]: accepted connection from pid 1700, user nix-grpc-daemon (trusted)6210worker1 # [ 129.277616] nix-daemon[842]: reaped child process 1703, status = succeeded6211lb # [ 129.300858] niks3-server[1030]: 2026/09/20 12:44:47 INFO Received uploads request method=POST path=/api/pending_closures6212worker1 # [ 129.293704] nix-grpc-daemon[1556]: time=2026-09-20T12:44:47.565Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6213worker1 # [ 129.295863] nix-grpc-daemon[1556]: time=2026-09-20T12:44:47.567Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6214lb # [ 129.325313] niks3-server[1030]: 2026/09/20 12:44:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6215lb # [ 129.328374] niks3-server[1030]: 2026/09/20 12:44:47 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6216lb # [ 129.332377] niks3-server[1030]: 2026/09/20 12:44:47 INFO Signed narinfos id=42 count=16217worker1 # [ 129.322972] nix-grpc-daemon[1556]: time=2026-09-20T12:44:47.594Z level=INFO msg="Uploading 1 narinfos"6218lb # [ 129.336950] niks3-server[1030]: 2026/09/20 12:44:47 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6219lb # [ 129.344357] niks3-server[1030]: 2026/09/20 12:44:47 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6220lb # [ 129.346656] niks3-server[1030]: 2026/09/20 12:44:47 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6221lb # [ 129.350611] niks3-server[1030]: 2026/09/20 12:44:47 INFO Completed upload id=426222worker1 # [ 129.338554] nix-grpc-daemon[1556]: time=2026-09-20T12:44:47.610Z level=INFO msg="Upload complete. (212ms)"6223lb # [ 129.353683] niks3-server[1030]: 2026/09/20 12:44:47 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6224worker1 # [ 129.341724] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16225worker2 # [ 129.376213] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:47Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06226worker1 # [ 129.349034] nix-daemon[842]: reaped child process 1683, status = succeeded6227worker2 # [ 129.379122] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:47Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=16228worker1 # [ 129.390214] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726229worker1 # [ 129.398641] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601726230worker1 # [ 129.415544] nix-grpc-daemon[1556]: time=2026-09-20T12:44:47.687Z level=INFO msg="All 2 paths already cached"6231client # copying 1 paths to 'lb:50051'...6232client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6233worker1 # [ 129.420396] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:601726234worker1 # [ 129.426083] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6235worker1 # [ 129.571662] nix-daemon[842]: accepted connection from pid 1707, user nix-grpc-daemon (trusted)6236worker1 # [ 129.587211] nix-daemon[842]: reaped child process 1710, status = succeeded6237worker1 # [ 129.751573] nix-daemon[842]: accepted connection from pid 1712, user nix-grpc-daemon (trusted)6238worker1 # [ 129.766157] nix-daemon[842]: reaped child process 1715, status = succeeded6239lb # [ 129.788930] niks3-server[1030]: 2026/09/20 12:44:48 INFO Received uploads request method=POST path=/api/pending_closures6240worker1 # [ 129.782307] nix-grpc-daemon[1556]: time=2026-09-20T12:44:48.054Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6241worker1 # [ 129.783773] nix-grpc-daemon[1556]: time=2026-09-20T12:44:48.055Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6242lb # [ 129.811579] niks3-server[1030]: 2026/09/20 12:44:48 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6243lb # [ 129.815176] niks3-server[1030]: 2026/09/20 12:44:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6244lb # [ 129.817496] niks3-server[1030]: 2026/09/20 12:44:48 INFO Signed narinfos id=43 count=16245worker1 # [ 129.806702] nix-grpc-daemon[1556]: time=2026-09-20T12:44:48.078Z level=INFO msg="Uploading 1 narinfos"6246lb # [ 129.821763] niks3-server[1030]: 2026/09/20 12:44:48 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6247lb # [ 129.827267] niks3-server[1030]: 2026/09/20 12:44:48 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6248lb # [ 129.831217] niks3-server[1030]: 2026/09/20 12:44:48 INFO Completed upload id=436249worker1 # [ 129.819198] nix-grpc-daemon[1556]: time=2026-09-20T12:44:48.091Z level=INFO msg="Upload complete. (386ms)"6250lb # [ 129.832555] niks3-server[1030]: 2026/09/20 12:44:48 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6251worker1 # [ 129.821352] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=0 paths=1 nar_bytes_in=7686252worker1 # [ 129.824906] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726253worker1 # [ 129.831500] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6254worker1 # [ 129.834293] nix-daemon[842]: reaped child process 1705, status = succeeded6255client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6256client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6257worker1 # [ 129.839186] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6258client # farm-top> LOG-farm-top-during-drain6259worker1 # [ 130.460390] nix-daemon[842]: reaped child process 1719, status = succeeded6260worker1 # [ 130.585382] nix-daemon[842]: accepted connection from pid 1734, user nix-grpc-daemon (trusted)6261worker1 # [ 130.600577] nix-daemon[842]: reaped child process 1737, status = succeeded6262lb # [ 130.625408] niks3-server[1030]: 2026/09/20 12:44:48 INFO Received uploads request method=POST path=/api/pending_closures6263worker1 # [ 130.872614] nix-grpc-daemon[1556]: time=2026-09-20T12:44:49.144Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6264worker1 # [ 130.874370] nix-grpc-daemon[1556]: time=2026-09-20T12:44:49.146Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6265lb # [ 130.904224] niks3-server[1030]: 2026/09/20 12:44:49 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6266lb # [ 130.905968] niks3-server[1030]: 2026/09/20 12:44:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6267lb # [ 130.907885] niks3-server[1030]: 2026/09/20 12:44:49 INFO Signed narinfos id=44 count=16268worker1 # [ 130.897041] nix-grpc-daemon[1556]: time=2026-09-20T12:44:49.169Z level=INFO msg="Uploading 1 narinfos"6269lb # [ 130.915169] niks3-server[1030]: 2026/09/20 12:44:49 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6270lb # [ 130.920045] niks3-server[1030]: 2026/09/20 12:44:49 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6271lb # [ 130.934396] niks3-server[1030]: 2026/09/20 12:44:49 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6272lb # [ 130.947365] niks3-server[1030]: 2026/09/20 12:44:49 INFO Completed upload id=446273worker1 # [ 130.935314] nix-grpc-daemon[1556]: time=2026-09-20T12:44:49.207Z level=INFO msg="Upload complete. (489ms)"6274worker1 # [ 130.938408] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16275lb # [ 130.956604] niks3-server[1030]: 2026/09/20 12:44:49 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6276worker1 # [ 130.946770] nix-daemon[842]: reaped child process 1717, status = succeeded6277client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 5.76 seconds)6278client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath6279client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.14 seconds)6280worker2: must succeed: pkill -f 'read -t [9]0 x'6281worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6282client: waiting for success: ! systemctl is-active sw6283worker2 # [ 131.211086] nix-daemon[857]: reaped child process 1516, status = succeeded6284worker2 # [ 131.340576] nix-daemon[857]: accepted connection from pid 1693, user nix-grpc-daemon (trusted)6285worker2 # [ 131.359293] nix-daemon[857]: reaped child process 1696, status = succeeded6286lb # [ 131.348586] niks3-server[1030]: 2026/09/20 12:44:49 INFO Received uploads request method=POST path=/api/pending_closures6287worker2 # [ 131.369892] nix-grpc-daemon[1445]: time=2026-09-20T12:44:49.637Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6288worker2 # [ 131.372333] nix-grpc-daemon[1445]: time=2026-09-20T12:44:49.639Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6289lb # [ 131.369133] niks3-server[1030]: 2026/09/20 12:44:49 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6290lb # [ 131.371775] niks3-server[1030]: 2026/09/20 12:44:49 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6291lb # [ 131.375051] niks3-server[1030]: 2026/09/20 12:44:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6292lb # [ 131.377534] niks3-server[1030]: 2026/09/20 12:44:49 INFO Signed narinfos id=45 count=16293worker2 # [ 131.395152] nix-grpc-daemon[1445]: time=2026-09-20T12:44:49.662Z level=INFO msg="Uploading 1 narinfos"6294lb # [ 131.380723] niks3-server[1030]: 2026/09/20 12:44:49 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6295lb # [ 131.386216] niks3-server[1030]: 2026/09/20 12:44:49 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6296lb # [ 131.388880] niks3-server[1030]: 2026/09/20 12:44:49 INFO Completed upload id=456297worker2 # [ 131.405856] nix-grpc-daemon[1445]: time=2026-09-20T12:44:49.673Z level=INFO msg="Upload complete. (202ms)"6298lb # [ 131.391144] niks3-server[1030]: 2026/09/20 12:44:49 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6299worker2 # [ 131.408845] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48994 duration_s=10 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16300worker2 # [ 131.419146] nix-daemon[857]: reaped child process 1514, status = succeeded6301client # [ 131.452445] systemd[1]: sw.service: Deactivated successfully.6302client # [ 131.456134] systemd[1]: sw.service: Consumed 114ms CPU time over 12.532s wall clock time, 39.1M memory peak, 8.8K incoming IP traffic, 9K outgoing IP traffic.6303worker2 # [ 131.792473] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:50Z level=info event=signal_exit6304worker2 # [ 132.016126] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:50Z level=info event=scheduler_yield6305lb # [ 132.001706] niks3-server[1030]: 2026/09/20 12:44:50 INFO lead: released remote=192.168.1.4:390586306worker2 # [ 132.020998] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:50Z level=info event=scheduler_restarting addr=lb:500516307worker1 # [ 131.992985] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:50Z level=info event=scheduler_restarting addr=lb:500516308worker2 # [ 132.023756] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:489646309worker2 # [ 132.025197] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:50Z level=info event=worker_gone addr=192.168.1.4:500516310worker2 # [ 132.026416] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:489646311worker2 # [ 132.027717] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:50Z level=info event=worker_gone addr=192.168.1.3:500516312worker1 # [ 132.193145] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:50Z level=info event=scheduler_connected addr=lb:500516313worker1 # [ 132.195480] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6314worker2 # [ 132.222991] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:50Z level=info event=scheduler_connected addr=lb:500516315worker2 # [ 132.227653] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6316client: (finished: waiting for success: ! systemctl is-active sw, in 1.07 seconds)6317client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6318client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)6319worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6320worker2 # [ 132.361773] systemd[1]: Starting scheduler-token.service...6321worker2 # [ 132.415898] systemd[1]: scheduler-token.service: Deactivated successfully.6322worker2 # [ 132.417173] systemd[1]: Finished scheduler-token.service.6323worker2 # [ 132.418865] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 54ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6324worker1 # [ 132.396141] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:50Z level=info event=scheduler_connected addr=lb:500516325worker1 # [ 132.397952] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6326worker2 # [ 132.428935] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:50Z level=info event=scheduler_connected addr=lb:500516327worker2 # [ 132.430268] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6328worker1 # [ 132.598875] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:50Z level=info event=scheduler_connected addr=lb:500516329worker2 # [ 132.629851] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:50Z level=info event=scheduler_connected addr=lb:500516330worker1 # [ 132.601539] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6331worker2 # [ 132.631733] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6332worker1 # [ 132.802414] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:51Z level=info event=scheduler_connected addr=lb:500516333worker2 # [ 132.832692] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:51Z level=info event=scheduler_connected addr=lb:500516334worker1 # [ 132.804879] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6335worker2 # [ 132.834807] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6336worker2 # [ 133.018882] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:51Z level=info event=scheduler_restarting6337worker2 # [ 133.033385] nix-daemon[857]: reaped child process 1417, status = succeeded6338worker1 # [ 133.007232] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:51Z level=info event=scheduler_connected addr=lb:500516339worker1 # [ 133.009210] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6340worker2 # [ 133.041269] nix-grpc-daemon[1366]: ts=2026-09-20T12:44:51Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6341worker1 # [ 133.207689] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:51Z level=info event=scheduler_connected addr=lb:500516342worker1 # [ 133.209938] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6343worker1 # [ 133.410734] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:51Z level=info event=scheduler_connected addr=lb:500516344worker1 # [ 133.413283] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6345worker1 # [ 133.614088] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:51Z level=info event=scheduler_connected addr=lb:500516346worker1 # [ 133.616446] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6347worker1 # [ 133.653433] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:51Z level=info event=scheduler_take_over6348lb # [ 133.665973] niks3-server[1030]: 2026/09/20 12:44:51 INFO lead: acquired remote=192.168.1.3:413706349worker2 # [ 133.827611] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6350worker2 # [ 133.829296] systemd[1]: nix-grpc-daemon.service: Consumed 749ms CPU time over 26.384s wall clock time, 31.1M memory peak, 26.1K incoming IP traffic, 36.9K outgoing IP traffic.6351worker2 # [ 133.839340] systemd[1]: Starting Nix worker-protocol over gRPC...6352worker1 # [ 133.816994] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:52Z level=info event=scheduler_connected addr=lb:500516353worker1 # [ 133.819386] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6354worker2 # [ 134.016866] nix-grpc-daemon[1713]: ts=2026-09-20T12:44:52Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6355worker2 # [ 134.020200] nix-grpc-daemon[1713]: ts=2026-09-20T12:44:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6356worker2 # [ 134.023125] nix-grpc-daemon[1713]: ts=2026-09-20T12:44:52Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16357worker2 # [ 134.030062] nix-grpc-daemon[1713]: ts=2026-09-20T12:44:52Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6358worker2 # [ 134.034286] systemd[1]: Started Nix worker-protocol over gRPC.6359worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.76 seconds)6360worker1 # [ 134.020500] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:52Z level=info event=scheduler_connected addr=lb:500516361lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6362lb: must succeed: curl -sf localhost:9901/clusters6363worker1 # [ 134.022860] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6364worker2 # [ 134.053555] nix-grpc-daemon[1713]: ts=2026-09-20T12:44:52Z level=info event=scheduler_connected addr=lb:500516365worker2 # [ 134.055385] nix-grpc-daemon[1713]: ts=2026-09-20T12:44:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6366lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6367lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.05 seconds)6368lb: must succeed: curl -sf localhost:9901/clusters6369lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6370worker1 # [ 134.223855] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:52Z level=info event=scheduler_connected addr=lb:500516371worker1 # [ 134.226322] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6372worker2 # [ 134.257669] nix-grpc-daemon[1713]: ts=2026-09-20T12:44:52Z level=info event=scheduler_connected addr=lb:500516373worker2 # [ 134.260924] nix-grpc-daemon[1713]: ts=2026-09-20T12:44:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6374worker1 # [ 134.427101] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:52Z level=info event=scheduler_connected addr=lb:500516375worker1 # [ 134.429460] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6376worker2 # [ 134.459431] nix-grpc-daemon[1713]: ts=2026-09-20T12:44:52Z level=info event=scheduler_connected addr=lb:500516377worker2 # [ 134.464361] nix-grpc-daemon[1713]: ts=2026-09-20T12:44:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6378worker1 # [ 134.630079] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:52Z level=info event=scheduler_connected addr=lb:500516379worker1 # [ 134.636526] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:394586380worker2 # [ 134.665413] nix-grpc-daemon[1713]: ts=2026-09-20T12:44:52Z level=info event=scheduler_connected addr=lb:500516381worker1 # [ 134.639287] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06382worker1 # [ 134.644075] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:52Z level=info event=oidc_jwks provider=mock keys=16383worker1 # [ 134.645647] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:52Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:394586384worker1 # [ 134.647323] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06385lb: must succeed: curl -sf localhost:9901/clusters6386lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6387worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6388worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6389(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 16.37 seconds)6390subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6391client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16392worker1 # [ 135.465504] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:601726393worker2 # [ 135.506946] nix-grpc-daemon[1713]: ts=2026-09-20T12:44:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541766394worker2 # [ 135.519597] nix-daemon[857]: accepted connection from pid 1713, user nix-grpc-daemon (trusted)6395worker2 # [ 135.539246] nix-grpc-daemon[1713]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 1/5)6396worker2 # [ 135.626464] nix-grpc-daemon[1713]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 101 ms (attempt 2/5)6397worker2 # [ 135.731041] nix-grpc-daemon[1713]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 80 ms (attempt 3/5)6398worker2 # [ 135.814778] nix-grpc-daemon[1713]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 653 ms (attempt 4/5)6399worker2 # [ 136.471445] nix-grpc-daemon[1713]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6400worker1 # [ 136.486073] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:54Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06401worker1 # [ 136.488432] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:54Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16402worker1 # [ 136.490181] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:54Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06403worker1 # [ 136.491904] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:54Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06404worker1 # [ 136.530790] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726405worker1 # [ 136.537950] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601726406worker1 # [ 136.545243] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:601726407worker1 # [ 136.551778] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6408worker1 # [ 136.695607] nix-daemon[842]: accepted connection from pid 1746, user nix-grpc-daemon (trusted)6409worker1 # [ 136.714082] nix-daemon[842]: reaped child process 1749, status = succeeded6410lb # [ 136.818762] envoy[909]: conn peer=[2001:db8:1::1]:58790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9598 tx=3845 ms=55626411lb # [ 136.820915] envoy[909]: conn peer=[2001:db8:1::1]:37880 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2949 tx=1352 ms=123326412lb # [ 136.822672] envoy[909]: conn peer=[2001:db8:1::4]:48516 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4876 tx=516 ms=252386413worker1 # [ 136.863369] nix-daemon[842]: accepted connection from pid 1751, user nix-grpc-daemon (trusted)6414worker1 # [ 136.878891] nix-daemon[842]: reaped child process 1754, status = succeeded6415lb # [ 136.903047] niks3-server[1030]: 2026/09/20 12:44:55 INFO Received uploads request method=POST path=/api/pending_closures6416worker1 # [ 136.896827] nix-grpc-daemon[1556]: time=2026-09-20T12:44:55.168Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6417worker1 # [ 136.898950] nix-grpc-daemon[1556]: time=2026-09-20T12:44:55.170Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6418lb # [ 136.922487] niks3-server[1030]: 2026/09/20 12:44:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6419lb # [ 136.924820] niks3-server[1030]: 2026/09/20 12:44:55 INFO Signed narinfos id=46 count=16420worker1 # [ 136.912875] nix-grpc-daemon[1556]: time=2026-09-20T12:44:55.184Z level=INFO msg="Uploading 1 narinfos"6421lb # [ 136.928820] niks3-server[1030]: 2026/09/20 12:44:55 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6422lb # [ 136.933748] niks3-server[1030]: 2026/09/20 12:44:55 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6423lb # [ 136.938062] niks3-server[1030]: 2026/09/20 12:44:55 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6424lb # [ 136.941681] niks3-server[1030]: 2026/09/20 12:44:55 INFO Completed upload id=466425worker1 # [ 136.929609] nix-grpc-daemon[1556]: time=2026-09-20T12:44:55.201Z level=INFO msg="Upload complete. (372ms)"6426lb # [ 136.944682] niks3-server[1030]: 2026/09/20 12:44:55 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6427worker1 # [ 136.932638] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=0 paths=1 nar_bytes_in=5046428worker1 # [ 136.935425] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726429worker1 # [ 136.943676] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6430worker1 # [ 136.947550] nix-daemon[842]: reaped child process 1744, status = succeeded6431worker1 # [ 136.954816] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6432worker1 # [ 137.977558] nix-daemon[842]: reaped child process 1758, status = succeeded6433worker1 # [ 138.123148] nix-daemon[842]: accepted connection from pid 1773, user nix-grpc-daemon (trusted)6434worker1 # [ 138.139628] nix-daemon[842]: reaped child process 1776, status = succeeded6435lb # [ 138.164237] niks3-server[1030]: 2026/09/20 12:44:56 INFO Received uploads request method=POST path=/api/pending_closures6436worker1 # [ 138.156986] nix-grpc-daemon[1556]: time=2026-09-20T12:44:56.428Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6437worker1 # [ 138.158873] nix-grpc-daemon[1556]: time=2026-09-20T12:44:56.430Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6438lb # [ 138.185391] niks3-server[1030]: 2026/09/20 12:44:56 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6439lb # [ 138.192056] niks3-server[1030]: 2026/09/20 12:44:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6440lb # [ 138.193995] niks3-server[1030]: 2026/09/20 12:44:56 INFO Signed narinfos id=47 count=16441worker1 # [ 138.182272] nix-grpc-daemon[1556]: time=2026-09-20T12:44:56.454Z level=INFO msg="Uploading 1 narinfos"6442lb # [ 138.201023] niks3-server[1030]: 2026/09/20 12:44:56 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6443lb # [ 138.204119] niks3-server[1030]: 2026/09/20 12:44:56 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6444lb # [ 138.208813] niks3-server[1030]: 2026/09/20 12:44:56 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6445lb # [ 138.211428] niks3-server[1030]: 2026/09/20 12:44:56 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6446lb # [ 138.220177] niks3-server[1030]: 2026/09/20 12:44:56 INFO Completed upload id=476447worker1 # [ 138.208248] nix-grpc-daemon[1556]: time=2026-09-20T12:44:56.480Z level=INFO msg="Upload complete. (247ms)"6448worker1 # [ 138.213589] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=16449worker1 # [ 138.217874] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:56Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16450worker1 # [ 138.221197] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726451worker1 # [ 138.222738] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:56Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06452worker1 # [ 138.229446] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601726453worker1 # [ 138.232708] nix-daemon[842]: reaped child process 1756, status = succeeded6454worker1 # [ 138.236668] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:601726455worker1 # [ 138.240903] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6456worker1 # [ 138.401612] nix-daemon[842]: accepted connection from pid 1782, user nix-grpc-daemon (trusted)6457worker1 # [ 138.417427] nix-daemon[842]: reaped child process 1785, status = succeeded6458worker1 # [ 138.555828] nix-daemon[842]: accepted connection from pid 1787, user nix-grpc-daemon (trusted)6459worker1 # [ 138.570807] nix-daemon[842]: reaped child process 1790, status = succeeded6460lb # [ 138.593182] niks3-server[1030]: 2026/09/20 12:44:56 INFO Received uploads request method=POST path=/api/pending_closures6461worker1 # [ 138.595412] nix-grpc-daemon[1556]: time=2026-09-20T12:44:56.867Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6462worker1 # [ 138.597510] nix-grpc-daemon[1556]: time=2026-09-20T12:44:56.869Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6463lb # [ 138.622334] niks3-server[1030]: 2026/09/20 12:44:56 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6464lb # [ 138.624180] niks3-server[1030]: 2026/09/20 12:44:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6465lb # [ 138.627738] niks3-server[1030]: 2026/09/20 12:44:56 INFO Signed narinfos id=48 count=16466worker1 # [ 138.615580] nix-grpc-daemon[1556]: time=2026-09-20T12:44:56.887Z level=INFO msg="Uploading 1 narinfos"6467lb # [ 138.629126] niks3-server[1030]: 2026/09/20 12:44:56 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6468lb # [ 138.634588] niks3-server[1030]: 2026/09/20 12:44:56 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6469lb # [ 138.637783] niks3-server[1030]: 2026/09/20 12:44:56 INFO Completed upload id=486470worker1 # [ 138.625675] nix-grpc-daemon[1556]: time=2026-09-20T12:44:56.897Z level=INFO msg="Upload complete. (378ms)"6471worker1 # [ 138.627768] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=0 paths=1 nar_bytes_in=5046472lb # [ 138.640448] niks3-server[1030]: 2026/09/20 12:44:56 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6473worker1 # [ 138.630671] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726474worker1 # [ 138.639803] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6475worker1 # [ 138.642632] nix-daemon[842]: reaped child process 1780, status = succeeded6476worker1 # [ 138.646736] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6477worker1 # [ 139.662538] nix-daemon[842]: reaped child process 1794, status = succeeded6478worker1 # [ 139.812513] nix-daemon[842]: accepted connection from pid 1809, user nix-grpc-daemon (trusted)6479worker1 # [ 139.827712] nix-daemon[842]: reaped child process 1812, status = succeeded6480lb # [ 139.850160] niks3-server[1030]: 2026/09/20 12:44:58 INFO Received uploads request method=POST path=/api/pending_closures6481worker1 # [ 139.842574] nix-grpc-daemon[1556]: time=2026-09-20T12:44:58.114Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6482worker1 # [ 139.844314] nix-grpc-daemon[1556]: time=2026-09-20T12:44:58.116Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6483lb # [ 139.875179] niks3-server[1030]: 2026/09/20 12:44:58 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6484lb # [ 139.878787] niks3-server[1030]: 2026/09/20 12:44:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6485lb # [ 139.880921] niks3-server[1030]: 2026/09/20 12:44:58 INFO Signed narinfos id=49 count=16486worker1 # [ 139.868824] nix-grpc-daemon[1556]: time=2026-09-20T12:44:58.140Z level=INFO msg="Uploading 1 narinfos"6487lb # [ 139.883707] niks3-server[1030]: 2026/09/20 12:44:58 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6488lb # [ 139.888874] niks3-server[1030]: 2026/09/20 12:44:58 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6489lb # [ 139.890501] niks3-server[1030]: 2026/09/20 12:44:58 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6490lb # [ 139.894230] niks3-server[1030]: 2026/09/20 12:44:58 INFO Completed upload id=496491lb # [ 139.895669] niks3-server[1030]: 2026/09/20 12:44:58 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6492worker1 # [ 139.883826] nix-grpc-daemon[1556]: time=2026-09-20T12:44:58.155Z level=INFO msg="Upload complete. (229ms)"6493worker1 # [ 139.886906] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=16494worker1 # [ 139.890884] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:58Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16495worker1 # [ 139.893655] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726496worker1 # [ 139.895545] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:58Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06497worker1 # [ 139.902243] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601726498worker1 # [ 139.904932] nix-daemon[842]: reaped child process 1792, status = succeeded6499worker1 # [ 139.907921] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:601726500worker1 # [ 139.911521] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6501worker1 # [ 140.052099] nix-daemon[842]: accepted connection from pid 1818, user nix-grpc-daemon (trusted)6502worker1 # [ 140.064741] nix-daemon[842]: reaped child process 1821, status = succeeded6503worker1 # [ 140.202572] nix-daemon[842]: accepted connection from pid 1823, user nix-grpc-daemon (trusted)6504worker1 # [ 140.216281] nix-daemon[842]: reaped child process 1826, status = succeeded6505lb # [ 140.238667] niks3-server[1030]: 2026/09/20 12:44:58 INFO Received uploads request method=POST path=/api/pending_closures6506worker1 # [ 140.230959] nix-grpc-daemon[1556]: time=2026-09-20T12:44:58.503Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6507worker1 # [ 140.232954] nix-grpc-daemon[1556]: time=2026-09-20T12:44:58.504Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6508lb # [ 140.255354] niks3-server[1030]: 2026/09/20 12:44:58 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6509lb # [ 140.261337] niks3-server[1030]: 2026/09/20 12:44:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6510lb # [ 140.263781] niks3-server[1030]: 2026/09/20 12:44:58 INFO Signed narinfos id=50 count=16511worker1 # [ 140.251932] nix-grpc-daemon[1556]: time=2026-09-20T12:44:58.523Z level=INFO msg="Uploading 1 narinfos"6512lb # [ 140.266788] niks3-server[1030]: 2026/09/20 12:44:58 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6513lb # [ 140.270855] niks3-server[1030]: 2026/09/20 12:44:58 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6514lb # [ 140.273865] niks3-server[1030]: 2026/09/20 12:44:58 INFO Completed upload id=506515worker1 # [ 140.261788] nix-grpc-daemon[1556]: time=2026-09-20T12:44:58.533Z level=INFO msg="Upload complete. (344ms)"6516worker1 # [ 140.263762] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=0 paths=1 nar_bytes_in=5046517lb # [ 140.276477] niks3-server[1030]: 2026/09/20 12:44:58 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6518worker1 # [ 140.266682] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726519worker1 # [ 140.273060] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6520worker1 # [ 140.278160] nix-daemon[842]: reaped child process 1816, status = succeeded6521worker1 # [ 140.281827] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6522worker1 # [ 141.298726] nix-daemon[842]: reaped child process 1830, status = succeeded6523worker1 # [ 141.451105] nix-daemon[842]: accepted connection from pid 1845, user nix-grpc-daemon (trusted)6524worker1 # [ 141.464932] nix-daemon[842]: reaped child process 1848, status = succeeded6525lb # [ 141.488072] niks3-server[1030]: 2026/09/20 12:44:59 INFO Received uploads request method=POST path=/api/pending_closures6526worker1 # [ 141.480068] nix-grpc-daemon[1556]: time=2026-09-20T12:44:59.751Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6527worker1 # [ 141.482632] nix-grpc-daemon[1556]: time=2026-09-20T12:44:59.753Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6528lb # [ 141.504682] niks3-server[1030]: 2026/09/20 12:44:59 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6529lb # [ 141.509608] niks3-server[1030]: 2026/09/20 12:44:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6530lb # [ 141.511549] niks3-server[1030]: 2026/09/20 12:44:59 INFO Signed narinfos id=51 count=16531worker1 # [ 141.500875] nix-grpc-daemon[1556]: time=2026-09-20T12:44:59.772Z level=INFO msg="Uploading 1 narinfos"6532lb # [ 141.515279] niks3-server[1030]: 2026/09/20 12:44:59 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6533lb # [ 141.518896] niks3-server[1030]: 2026/09/20 12:44:59 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6534lb # [ 141.522889] niks3-server[1030]: 2026/09/20 12:44:59 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6535lb # [ 141.526079] niks3-server[1030]: 2026/09/20 12:44:59 INFO Completed upload id=516536worker1 # [ 141.513655] nix-grpc-daemon[1556]: time=2026-09-20T12:44:59.785Z level=INFO msg="Upload complete. (224ms)"6537lb # [ 141.527517] niks3-server[1030]: 2026/09/20 12:44:59 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6538worker1 # [ 141.516088] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=16539worker1 # [ 141.520417] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:59Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16540worker1 # [ 141.522792] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726541worker1 # [ 141.528746] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:59Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06542worker1 # [ 141.533376] nix-daemon[842]: reaped child process 1828, status = succeeded6543worker1 # [ 141.567250] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601726544worker1 # [ 141.576414] nix-grpc-daemon[1556]: time=2026-09-20T12:44:59.848Z level=INFO msg="All 1 paths already cached"6545worker1 # [ 141.581542] nix-grpc-daemon[1472]: ts=2026-09-20T12:44:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:601726546worker1 # [ 141.586484] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6547worker1 # [ 141.755323] nix-daemon[842]: accepted connection from pid 1854, user nix-grpc-daemon (trusted)6548worker1 # [ 141.772045] nix-daemon[842]: reaped child process 1857, status = succeeded6549worker1 # [ 141.925355] nix-daemon[842]: accepted connection from pid 1859, user nix-grpc-daemon (trusted)6550worker1 # [ 141.941205] nix-daemon[842]: reaped child process 1862, status = succeeded6551lb # [ 141.967279] niks3-server[1030]: 2026/09/20 12:45:00 INFO Received uploads request method=POST path=/api/pending_closures6552worker1 # [ 141.960216] nix-grpc-daemon[1556]: time=2026-09-20T12:45:00.232Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6553worker1 # [ 141.961779] nix-grpc-daemon[1556]: time=2026-09-20T12:45:00.232Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6554lb # [ 141.980141] niks3-server[1030]: 2026/09/20 12:45:00 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6555lb # [ 141.984741] niks3-server[1030]: 2026/09/20 12:45:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6556lb # [ 141.987449] niks3-server[1030]: 2026/09/20 12:45:00 INFO Signed narinfos id=52 count=16557worker1 # [ 141.977077] nix-grpc-daemon[1556]: time=2026-09-20T12:45:00.249Z level=INFO msg="Uploading 1 narinfos"6558lb # [ 141.990737] niks3-server[1030]: 2026/09/20 12:45:00 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6559lb # [ 141.996208] niks3-server[1030]: 2026/09/20 12:45:00 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6560lb # [ 141.999239] niks3-server[1030]: 2026/09/20 12:45:00 INFO Completed upload id=526561worker1 # [ 141.988451] nix-grpc-daemon[1556]: time=2026-09-20T12:45:00.260Z level=INFO msg="Upload complete. (394ms)"6562lb # [ 142.000926] niks3-server[1030]: 2026/09/20 12:45:00 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6563worker1 # [ 141.990932] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=0 paths=1 nar_bytes_in=6246564worker1 # [ 141.994211] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726565worker1 # [ 142.000302] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6566worker1 # [ 142.006962] nix-daemon[842]: reaped child process 1852, status = succeeded6567worker1 # [ 142.011445] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6568worker1 # [ 143.241685] nix-daemon[842]: reaped child process 1866, status = succeeded6569worker1 # [ 143.388249] nix-daemon[842]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6570worker1 # [ 143.403663] nix-daemon[842]: reaped child process 1884, status = succeeded6571lb # [ 143.428243] niks3-server[1030]: 2026/09/20 12:45:01 INFO Received uploads request method=POST path=/api/pending_closures6572worker1 # [ 143.421095] nix-grpc-daemon[1556]: time=2026-09-20T12:45:01.692Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6573worker1 # [ 143.422788] nix-grpc-daemon[1556]: time=2026-09-20T12:45:01.694Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6574lb # [ 143.462168] niks3-server[1030]: 2026/09/20 12:45:01 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6575lb # [ 143.475717] niks3-server[1030]: 2026/09/20 12:45:01 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6576lb # [ 143.487566] niks3-server[1030]: 2026/09/20 12:45:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6577lb # [ 143.489912] niks3-server[1030]: 2026/09/20 12:45:01 INFO Signed narinfos id=53 count=16578worker1 # [ 143.479351] nix-grpc-daemon[1556]: time=2026-09-20T12:45:01.751Z level=INFO msg="Uploading 1 narinfos"6579lb # [ 143.492910] niks3-server[1030]: 2026/09/20 12:45:01 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6580lb # [ 143.497452] niks3-server[1030]: 2026/09/20 12:45:01 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6581lb # [ 143.502390] niks3-server[1030]: 2026/09/20 12:45:01 INFO Completed upload id=536582worker1 # [ 143.490476] nix-grpc-daemon[1556]: time=2026-09-20T12:45:01.762Z level=INFO msg="Upload complete. (270ms)"6583lb # [ 143.503932] niks3-server[1030]: 2026/09/20 12:45:01 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6584worker1 # [ 143.498375] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=16585worker1 # [ 143.505475] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:01Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16586worker1 # [ 143.508328] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726587worker1 # [ 143.510057] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:01Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06588worker1 # [ 143.517614] nix-daemon[842]: reaped child process 1864, status = succeeded6589worker1 # [ 143.518989] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601726590worker1 # [ 143.527855] nix-grpc-daemon[1556]: time=2026-09-20T12:45:01.800Z level=INFO msg="All 1 paths already cached"6591worker1 # [ 143.531434] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:601726592worker1 # [ 143.535439] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6593worker1 # [ 143.693217] nix-daemon[842]: accepted connection from pid 1890, user nix-grpc-daemon (trusted)6594worker1 # [ 143.708721] nix-daemon[842]: reaped child process 1893, status = succeeded6595worker1 # [ 143.845305] nix-daemon[842]: accepted connection from pid 1895, user nix-grpc-daemon (trusted)6596worker1 # [ 143.859310] nix-daemon[842]: reaped child process 1898, status = succeeded6597lb # [ 143.886580] niks3-server[1030]: 2026/09/20 12:45:02 INFO Received uploads request method=POST path=/api/pending_closures6598worker1 # [ 143.883400] nix-grpc-daemon[1556]: time=2026-09-20T12:45:02.155Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6599worker1 # [ 143.885238] nix-grpc-daemon[1556]: time=2026-09-20T12:45:02.155Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6600lb # [ 143.910618] niks3-server[1030]: 2026/09/20 12:45:02 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6601lb # [ 143.923682] niks3-server[1030]: 2026/09/20 12:45:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6602worker1 # [ 143.916526] nix-grpc-daemon[1556]: time=2026-09-20T12:45:02.188Z level=INFO msg="Uploading 1 narinfos"6603lb # [ 143.929925] niks3-server[1030]: 2026/09/20 12:45:02 INFO Signed narinfos id=54 count=16604lb # [ 143.934985] niks3-server[1030]: 2026/09/20 12:45:02 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6605lb # [ 143.945782] niks3-server[1030]: 2026/09/20 12:45:02 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6606worker1 # [ 143.939634] nix-grpc-daemon[1556]: time=2026-09-20T12:45:02.211Z level=INFO msg="Upload complete. (397ms)"6607lb # [ 143.951771] niks3-server[1030]: 2026/09/20 12:45:02 INFO Completed upload id=546608worker1 # [ 143.941759] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=0 paths=1 nar_bytes_in=6246609lb # [ 143.954926] niks3-server[1030]: 2026/09/20 12:45:02 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6610worker1 # [ 143.945950] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726611worker1 # [ 143.953059] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6612worker1 # [ 143.955893] nix-daemon[842]: reaped child process 1888, status = succeeded6613worker1 # [ 143.961163] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6614worker1 # [ 145.379742] nix-daemon[842]: reaped child process 1902, status = succeeded6615worker1 # [ 145.512596] nix-daemon[842]: accepted connection from pid 1917, user nix-grpc-daemon (trusted)6616worker1 # [ 145.529428] nix-daemon[842]: reaped child process 1920, status = succeeded6617lb # [ 145.554961] niks3-server[1030]: 2026/09/20 12:45:03 INFO Received uploads request method=POST path=/api/pending_closures6618worker1 # [ 145.547760] nix-grpc-daemon[1556]: time=2026-09-20T12:45:03.819Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6619worker1 # [ 145.550759] nix-grpc-daemon[1556]: time=2026-09-20T12:45:03.821Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6620lb # [ 145.577706] niks3-server[1030]: 2026/09/20 12:45:03 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6621lb # [ 145.580697] niks3-server[1030]: 2026/09/20 12:45:03 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6622lb # [ 145.586753] niks3-server[1030]: 2026/09/20 12:45:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6623lb # [ 145.588767] niks3-server[1030]: 2026/09/20 12:45:03 INFO Signed narinfos id=55 count=16624worker1 # [ 145.578199] nix-grpc-daemon[1556]: time=2026-09-20T12:45:03.850Z level=INFO msg="Uploading 1 narinfos"6625lb # [ 145.596622] niks3-server[1030]: 2026/09/20 12:45:03 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6626lb # [ 145.599699] niks3-server[1030]: 2026/09/20 12:45:03 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6627lb # [ 145.602067] niks3-server[1030]: 2026/09/20 12:45:03 INFO Completed upload id=556628worker1 # [ 145.591345] nix-grpc-daemon[1556]: time=2026-09-20T12:45:03.863Z level=INFO msg="Upload complete. (222ms)"6629lb # [ 145.604049] niks3-server[1030]: 2026/09/20 12:45:03 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6630worker1 # [ 145.596647] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=16631worker1 # [ 145.599940] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:03Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16632worker1 # [ 145.602267] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726633worker1 # [ 145.605148] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:03Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06634worker1 # [ 145.611340] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601726635worker1 # [ 145.615333] nix-daemon[842]: reaped child process 1900, status = succeeded6636worker1 # [ 145.619264] nix-grpc-daemon[1556]: time=2026-09-20T12:45:03.891Z level=INFO msg="All 1 paths already cached"6637worker1 # [ 145.622882] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:601726638worker1 # [ 145.630984] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6639worker1 # [ 145.779599] nix-daemon[842]: accepted connection from pid 1926, user nix-grpc-daemon (trusted)6640worker1 # [ 145.794916] nix-daemon[842]: reaped child process 1929, status = succeeded6641worker1 # [ 145.959215] nix-daemon[842]: accepted connection from pid 1931, user nix-grpc-daemon (trusted)6642worker1 # [ 145.974404] nix-daemon[842]: reaped child process 1934, status = succeeded6643lb # [ 145.999439] niks3-server[1030]: 2026/09/20 12:45:04 INFO Received uploads request method=POST path=/api/pending_closures6644worker1 # [ 145.997399] nix-grpc-daemon[1556]: time=2026-09-20T12:45:04.269Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6645worker1 # [ 145.998785] nix-grpc-daemon[1556]: time=2026-09-20T12:45:04.269Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6646lb # [ 146.029126] niks3-server[1030]: 2026/09/20 12:45:04 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6647lb # [ 146.038852] niks3-server[1030]: 2026/09/20 12:45:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6648worker1 # [ 146.032604] nix-grpc-daemon[1556]: time=2026-09-20T12:45:04.304Z level=INFO msg="Uploading 1 narinfos"6649lb # [ 146.044694] niks3-server[1030]: 2026/09/20 12:45:04 INFO Signed narinfos id=56 count=16650lb # [ 146.048830] niks3-server[1030]: 2026/09/20 12:45:04 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6651lb # [ 146.058060] niks3-server[1030]: 2026/09/20 12:45:04 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6652lb # [ 146.062219] niks3-server[1030]: 2026/09/20 12:45:04 INFO Completed upload id=566653worker1 # [ 146.050304] nix-grpc-daemon[1556]: time=2026-09-20T12:45:04.322Z level=INFO msg="Upload complete. (413ms)"6654lb # [ 146.063905] niks3-server[1030]: 2026/09/20 12:45:04 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6655worker1 # [ 146.054129] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=0 paths=1 nar_bytes_in=6246656worker1 # [ 146.057180] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726657worker1 # [ 146.065840] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6658worker1 # [ 146.070508] nix-daemon[842]: reaped child process 1924, status = succeeded6659worker1 # [ 146.079205] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6660worker1 # [ 147.299737] nix-daemon[842]: reaped child process 1938, status = succeeded6661worker1 # [ 147.430813] nix-daemon[842]: accepted connection from pid 1953, user nix-grpc-daemon (trusted)6662worker1 # [ 147.446153] nix-daemon[842]: reaped child process 1956, status = succeeded6663lb # [ 147.474920] niks3-server[1030]: 2026/09/20 12:45:05 INFO Received uploads request method=POST path=/api/pending_closures6664worker1 # [ 147.467700] nix-grpc-daemon[1556]: time=2026-09-20T12:45:05.739Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6665worker1 # [ 147.471066] nix-grpc-daemon[1556]: time=2026-09-20T12:45:05.741Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6666lb # [ 147.491320] niks3-server[1030]: 2026/09/20 12:45:05 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6667lb # [ 147.496697] niks3-server[1030]: 2026/09/20 12:45:05 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6668lb # [ 147.500902] niks3-server[1030]: 2026/09/20 12:45:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6669lb # [ 147.502595] niks3-server[1030]: 2026/09/20 12:45:05 INFO Signed narinfos id=57 count=16670worker1 # [ 147.491872] nix-grpc-daemon[1556]: time=2026-09-20T12:45:05.763Z level=INFO msg="Uploading 1 narinfos"6671lb # [ 147.507041] niks3-server[1030]: 2026/09/20 12:45:05 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6672lb # [ 147.510709] niks3-server[1030]: 2026/09/20 12:45:05 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6673lb # [ 147.513472] niks3-server[1030]: 2026/09/20 12:45:05 INFO Completed upload id=576674worker1 # [ 147.501409] nix-grpc-daemon[1556]: time=2026-09-20T12:45:05.773Z level=INFO msg="Upload complete. (213ms)"6675lb # [ 147.516159] niks3-server[1030]: 2026/09/20 12:45:05 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6676worker1 # [ 147.505275] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=16677worker1 # [ 147.509278] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:05Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16678worker1 # [ 147.511981] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726679worker1 # [ 147.515816] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:05Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06680worker1 # [ 147.521699] nix-daemon[842]: reaped child process 1936, status = succeeded6681worker1 # [ 147.552489] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601726682worker1 # [ 147.559969] nix-grpc-daemon[1556]: time=2026-09-20T12:45:05.832Z level=INFO msg="All 2 paths already cached"6683worker1 # [ 147.563814] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:601726684worker1 # [ 147.569133] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6685worker1 # [ 147.703524] nix-daemon[842]: accepted connection from pid 1962, user nix-grpc-daemon (trusted)6686worker1 # [ 147.718389] nix-daemon[842]: reaped child process 1965, status = succeeded6687worker1 # [ 147.875135] nix-daemon[842]: accepted connection from pid 1967, user nix-grpc-daemon (trusted)6688worker1 # [ 147.890050] nix-daemon[842]: reaped child process 1970, status = succeeded6689lb # [ 147.915653] niks3-server[1030]: 2026/09/20 12:45:06 INFO Received uploads request method=POST path=/api/pending_closures6690worker1 # [ 147.911806] nix-grpc-daemon[1556]: time=2026-09-20T12:45:06.183Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6691worker1 # [ 147.913386] nix-grpc-daemon[1556]: time=2026-09-20T12:45:06.183Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6692lb # [ 147.944713] niks3-server[1030]: 2026/09/20 12:45:06 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6693lb # [ 147.954084] niks3-server[1030]: 2026/09/20 12:45:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6694worker1 # [ 147.947093] nix-grpc-daemon[1556]: time=2026-09-20T12:45:06.219Z level=INFO msg="Uploading 1 narinfos"6695lb # [ 147.959216] niks3-server[1030]: 2026/09/20 12:45:06 INFO Signed narinfos id=58 count=16696lb # [ 147.965579] niks3-server[1030]: 2026/09/20 12:45:06 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6697lb # [ 147.975612] niks3-server[1030]: 2026/09/20 12:45:06 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6698lb # [ 147.980747] niks3-server[1030]: 2026/09/20 12:45:06 INFO Completed upload id=586699worker1 # [ 147.970892] nix-grpc-daemon[1556]: time=2026-09-20T12:45:06.243Z level=INFO msg="Upload complete. (396ms)"6700worker1 # [ 147.973191] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=0 paths=1 nar_bytes_in=7526701lb # [ 147.986100] niks3-server[1030]: 2026/09/20 12:45:06 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6702worker1 # [ 147.978193] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726703worker1 # [ 147.984823] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6704worker1 # [ 147.987402] nix-daemon[842]: reaped child process 1960, status = succeeded6705worker1 # [ 147.993291] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6706worker1 # [ 149.019161] nix-daemon[842]: reaped child process 1974, status = succeeded6707worker1 # [ 149.180119] nix-daemon[842]: accepted connection from pid 1989, user nix-grpc-daemon (trusted)6708worker1 # [ 149.194497] nix-daemon[842]: reaped child process 1992, status = succeeded6709lb # [ 149.223581] niks3-server[1030]: 2026/09/20 12:45:07 INFO Received uploads request method=POST path=/api/pending_closures6710worker1 # [ 149.221632] nix-grpc-daemon[1556]: time=2026-09-20T12:45:07.493Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6711worker1 # [ 149.224769] nix-grpc-daemon[1556]: time=2026-09-20T12:45:07.495Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6712lb # [ 149.256441] niks3-server[1030]: 2026/09/20 12:45:07 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6713lb # [ 149.270149] niks3-server[1030]: 2026/09/20 12:45:07 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6714lb # [ 149.281527] niks3-server[1030]: 2026/09/20 12:45:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6715lb # [ 149.286230] niks3-server[1030]: 2026/09/20 12:45:07 INFO Signed narinfos id=59 count=16716worker1 # [ 149.276772] nix-grpc-daemon[1556]: time=2026-09-20T12:45:07.548Z level=INFO msg="Uploading 1 narinfos"6717lb # [ 149.291274] niks3-server[1030]: 2026/09/20 12:45:07 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6718lb # [ 149.299719] niks3-server[1030]: 2026/09/20 12:45:07 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6719lb # [ 149.303142] niks3-server[1030]: 2026/09/20 12:45:07 INFO Completed upload id=596720lb # [ 149.305442] niks3-server[1030]: 2026/09/20 12:45:07 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6721worker1 # [ 149.291272] nix-grpc-daemon[1556]: time=2026-09-20T12:45:07.563Z level=INFO msg="Upload complete. (287ms)"6722worker1 # [ 149.297978] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=16723worker1 # [ 149.305271] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:07Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16724worker1 # [ 149.316388] nix-daemon[842]: reaped child process 1972, status = succeeded6725worker1 # [ 149.339047] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726726worker1 # [ 149.346656] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601726727worker1 # [ 149.357199] nix-grpc-daemon[1556]: time=2026-09-20T12:45:07.629Z level=INFO msg="All 2 paths already cached"6728worker1 # [ 149.362841] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:601726729worker1 # [ 149.372159] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6730worker1 # [ 149.535359] nix-daemon[842]: accepted connection from pid 1996, user nix-grpc-daemon (trusted)6731worker1 # [ 149.550942] nix-daemon[842]: reaped child process 1999, status = succeeded6732worker1 # [ 149.711738] nix-daemon[842]: accepted connection from pid 2001, user nix-grpc-daemon (trusted)6733worker1 # [ 149.731319] nix-daemon[842]: reaped child process 2004, status = succeeded6734lb # [ 149.755585] niks3-server[1030]: 2026/09/20 12:45:08 INFO Received uploads request method=POST path=/api/pending_closures6735worker1 # [ 149.748259] nix-grpc-daemon[1556]: time=2026-09-20T12:45:08.019Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6736worker1 # [ 149.750302] nix-grpc-daemon[1556]: time=2026-09-20T12:45:08.019Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6737lb # [ 149.770786] niks3-server[1030]: 2026/09/20 12:45:08 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6738lb # [ 149.772651] niks3-server[1030]: 2026/09/20 12:45:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6739lb # [ 149.774828] niks3-server[1030]: 2026/09/20 12:45:08 INFO Signed narinfos id=60 count=16740worker1 # [ 149.764762] nix-grpc-daemon[1556]: time=2026-09-20T12:45:08.036Z level=INFO msg="Uploading 1 narinfos"6741lb # [ 149.778843] niks3-server[1030]: 2026/09/20 12:45:08 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6742lb # [ 149.783925] niks3-server[1030]: 2026/09/20 12:45:08 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6743lb # [ 149.786948] niks3-server[1030]: 2026/09/20 12:45:08 INFO Completed upload id=606744worker1 # [ 149.775190] nix-grpc-daemon[1556]: time=2026-09-20T12:45:08.047Z level=INFO msg="Upload complete. (397ms)"6745lb # [ 149.789475] niks3-server[1030]: 2026/09/20 12:45:08 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6746worker1 # [ 149.779200] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=0 paths=1 nar_bytes_in=7526747worker1 # [ 149.782667] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726748worker1 # [ 149.789981] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6749worker1 # [ 149.801310] nix-daemon[842]: reaped child process 1994, status = succeeded6750worker1 # [ 149.806595] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6751worker1 # [ 151.023884] nix-daemon[842]: reaped child process 2008, status = succeeded6752worker1 # [ 151.181925] nix-daemon[842]: accepted connection from pid 2023, user nix-grpc-daemon (trusted)6753worker1 # [ 151.195269] nix-daemon[842]: reaped child process 2026, status = succeeded6754lb # [ 151.222904] niks3-server[1030]: 2026/09/20 12:45:09 INFO Received uploads request method=POST path=/api/pending_closures6755worker1 # [ 151.215052] nix-grpc-daemon[1556]: time=2026-09-20T12:45:09.486Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6756worker1 # [ 151.216595] nix-grpc-daemon[1556]: time=2026-09-20T12:45:09.488Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6757lb # [ 151.245092] niks3-server[1030]: 2026/09/20 12:45:09 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6758lb # [ 151.249564] niks3-server[1030]: 2026/09/20 12:45:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6759lb # [ 151.252410] niks3-server[1030]: 2026/09/20 12:45:09 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6760lb # [ 151.256937] niks3-server[1030]: 2026/09/20 12:45:09 INFO Signed narinfos id=61 count=16761worker1 # [ 151.247491] nix-grpc-daemon[1556]: time=2026-09-20T12:45:09.519Z level=INFO msg="Uploading 1 narinfos"6762lb # [ 151.262207] niks3-server[1030]: 2026/09/20 12:45:09 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6763lb # [ 151.267152] niks3-server[1030]: 2026/09/20 12:45:09 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6764lb # [ 151.270048] niks3-server[1030]: 2026/09/20 12:45:09 INFO Completed upload id=616765worker1 # [ 151.257988] nix-grpc-daemon[1556]: time=2026-09-20T12:45:09.530Z level=INFO msg="Upload complete. (243ms)"6766lb # [ 151.272911] niks3-server[1030]: 2026/09/20 12:45:09 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6767worker1 # [ 151.262057] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=16768worker1 # [ 151.264565] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:09Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16769worker1 # [ 151.267341] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726770worker1 # [ 151.274462] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601726771worker1 # [ 151.278192] nix-daemon[842]: reaped child process 2006, status = succeeded6772worker1 # [ 151.281260] nix-grpc-daemon[1556]: time=2026-09-20T12:45:09.553Z level=INFO msg="All 2 paths already cached"6773worker1 # [ 151.284179] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:601726774worker1 # [ 151.289556] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6775worker1 # [ 151.426704] nix-daemon[842]: accepted connection from pid 2030, user nix-grpc-daemon (trusted)6776worker1 # [ 151.440521] nix-daemon[842]: reaped child process 2033, status = succeeded6777worker1 # [ 151.586119] nix-daemon[842]: accepted connection from pid 2035, user nix-grpc-daemon (trusted)6778worker1 # [ 151.599623] nix-daemon[842]: reaped child process 2038, status = succeeded6779lb # [ 151.623801] niks3-server[1030]: 2026/09/20 12:45:09 INFO Received uploads request method=POST path=/api/pending_closures6780worker1 # [ 151.616063] nix-grpc-daemon[1556]: time=2026-09-20T12:45:09.887Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6781worker1 # [ 151.617583] nix-grpc-daemon[1556]: time=2026-09-20T12:45:09.887Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6782lb # [ 151.635555] niks3-server[1030]: 2026/09/20 12:45:09 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6783lb # [ 151.640313] niks3-server[1030]: 2026/09/20 12:45:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6784lb # [ 151.642950] niks3-server[1030]: 2026/09/20 12:45:09 INFO Signed narinfos id=62 count=16785worker1 # [ 151.631116] nix-grpc-daemon[1556]: time=2026-09-20T12:45:09.903Z level=INFO msg="Uploading 1 narinfos"6786lb # [ 151.645731] niks3-server[1030]: 2026/09/20 12:45:09 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6787lb # [ 151.650773] niks3-server[1030]: 2026/09/20 12:45:09 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6788lb # [ 151.655164] niks3-server[1030]: 2026/09/20 12:45:09 INFO Completed upload id=626789worker1 # [ 151.643070] nix-grpc-daemon[1556]: time=2026-09-20T12:45:09.915Z level=INFO msg="Upload complete. (346ms)"6790lb # [ 151.656413] niks3-server[1030]: 2026/09/20 12:45:09 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6791worker1 # [ 151.645271] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=0 paths=1 nar_bytes_in=7526792worker1 # [ 151.648214] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:601726793worker1 # [ 151.652813] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6794worker1 # [ 151.658495] nix-daemon[842]: reaped child process 2028, status = succeeded6795worker1 # [ 151.665248] nix-daemon[842]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)6796worker1 # [ 152.680749] nix-daemon[842]: reaped child process 2042, status = succeeded6797worker1 # [ 152.801519] nix-daemon[842]: accepted connection from pid 2057, user nix-grpc-daemon (trusted)6798worker1 # [ 152.816455] nix-daemon[842]: reaped child process 2060, status = succeeded6799lb # [ 152.840763] niks3-server[1030]: 2026/09/20 12:45:11 INFO Received uploads request method=POST path=/api/pending_closures6800worker1 # [ 152.837092] nix-grpc-daemon[1556]: time=2026-09-20T12:45:11.108Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6801worker1 # [ 152.839176] nix-grpc-daemon[1556]: time=2026-09-20T12:45:11.110Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6802lb # [ 152.877122] niks3-server[1030]: 2026/09/20 12:45:11 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6803lb # [ 152.885162] niks3-server[1030]: 2026/09/20 12:45:11 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6804lb # [ 152.891642] niks3-server[1030]: 2026/09/20 12:45:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6805lb # [ 152.896248] niks3-server[1030]: 2026/09/20 12:45:11 INFO Signed narinfos id=63 count=16806worker1 # [ 152.886752] nix-grpc-daemon[1556]: time=2026-09-20T12:45:11.158Z level=INFO msg="Uploading 1 narinfos"6807lb # [ 152.902515] niks3-server[1030]: 2026/09/20 12:45:11 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6808lb # [ 152.907848] niks3-server[1030]: 2026/09/20 12:45:11 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6809lb # [ 152.910838] niks3-server[1030]: 2026/09/20 12:45:11 INFO Completed upload id=636810worker1 # [ 152.898854] nix-grpc-daemon[1556]: time=2026-09-20T12:45:11.171Z level=INFO msg="Upload complete. (227ms)"6811lb # [ 152.912766] niks3-server[1030]: 2026/09/20 12:45:11 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6812worker1 # [ 152.901515] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60172 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=16813worker1 # [ 152.909268] nix-daemon[842]: reaped child process 2040, status = succeeded6814client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.74 seconds)6815worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6816worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)6817client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16818worker2 # [ 153.234824] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:541766819worker2 # [ 153.238762] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541766820worker1 # [ 153.224570] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:11Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06821lb # [ 156.820220] envoy[909]: conn peer=[2001:db8:1::1]:57058 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27150 tx=10719 ms=174956822client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.24 seconds)6823(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 48.04 seconds)6824subtest: low disk drains a worker and builds go to the other6825worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6826worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.97 seconds)6827worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6828worker1 # [ 184.678894] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:42Z level=info event=unhealthy reason=min_free6829worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.08 seconds)6830client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&26831worker1 # [ 185.548967] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:601726832client # don't know how to build these paths:6833client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6834worker1 # [ 185.555304] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:601726835worker1 # [ 185.569558] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:43Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06836worker1 # [ 185.571234] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:43Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16837worker2 # [ 185.643738] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541766838worker2 # [ 185.653505] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541766839client # copying 1 paths to 'lb:50051'...6840client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6841worker2 # [ 185.661820] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:541766842worker2 # [ 185.668752] nix-daemon[857]: accepted connection from pid 1713, user nix-grpc-daemon (trusted)6843worker2 # [ 185.682756] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:43Z level=info event=niks3_push_started pid=17696844worker2 # [ 185.861564] nix-grpc-daemon[1769]: time=2026-09-20T12:45:44.128Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""6845worker2 # [ 186.014154] nix-daemon[857]: accepted connection from pid 1782, user nix-grpc-daemon (trusted)6846worker2 # [ 186.026925] nix-daemon[857]: reaped child process 1785, status = succeeded6847worker2 # [ 186.187933] nix-daemon[857]: accepted connection from pid 1787, user nix-grpc-daemon (trusted)6848worker2 # [ 186.200754] nix-daemon[857]: reaped child process 1790, status = succeeded6849lb # [ 186.200603] niks3-server[1030]: 2026/09/20 12:45:44 INFO Received uploads request method=POST path=/api/pending_closures6850worker2 # [ 186.228435] nix-grpc-daemon[1769]: time=2026-09-20T12:45:44.495Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6851worker2 # [ 186.231253] nix-grpc-daemon[1769]: time=2026-09-20T12:45:44.497Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6852lb # [ 186.247370] niks3-server[1030]: 2026/09/20 12:45:44 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6853lb # [ 186.254833] niks3-server[1030]: 2026/09/20 12:45:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6854lb # [ 186.264046] niks3-server[1030]: 2026/09/20 12:45:44 INFO Signed narinfos id=64 count=16855worker2 # [ 186.283947] nix-grpc-daemon[1769]: time=2026-09-20T12:45:44.551Z level=INFO msg="Uploading 1 narinfos"6856lb # [ 186.270665] niks3-server[1030]: 2026/09/20 12:45:44 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6857lb # [ 186.280571] niks3-server[1030]: 2026/09/20 12:45:44 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6858lb # [ 186.286505] niks3-server[1030]: 2026/09/20 12:45:44 INFO Completed upload id=646859worker2 # [ 186.304946] nix-grpc-daemon[1769]: time=2026-09-20T12:45:44.572Z level=INFO msg="Upload complete. (439ms)"6860lb # [ 186.288906] niks3-server[1030]: 2026/09/20 12:45:44 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6861worker2 # [ 186.308070] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54176 duration_s=0 paths=1 nar_bytes_in=5126862worker2 # [ 186.311050] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541766863worker2 # [ 186.318062] nix-daemon[857]: accepted connection from pid 1713, user nix-grpc-daemon (trusted)6864worker2 # [ 186.322359] nix-daemon[857]: reaped child process 1767, status = succeeded6865client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6866worker2 # [ 186.328753] nix-daemon[857]: accepted connection from pid 1713, user nix-grpc-daemon (trusted)6867client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6868lb # [ 186.821519] envoy[909]: conn peer=[2001:db8:1::1]:34192 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=895 tx=497 ms=300416869client # farm-a> LOG-farm-a-drain6870worker2 # [ 187.743899] nix-daemon[857]: reaped child process 1794, status = succeeded6871worker2 # [ 187.852772] nix-daemon[857]: accepted connection from pid 1809, user nix-grpc-daemon (trusted)6872worker2 # [ 187.865406] nix-daemon[857]: reaped child process 1812, status = succeeded6873lb # [ 187.863389] niks3-server[1030]: 2026/09/20 12:45:46 INFO Received uploads request method=POST path=/api/pending_closures6874worker2 # [ 187.888649] nix-grpc-daemon[1769]: time=2026-09-20T12:45:46.155Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6875worker2 # [ 187.890760] nix-grpc-daemon[1769]: time=2026-09-20T12:45:46.157Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6876lb # [ 187.893415] niks3-server[1030]: 2026/09/20 12:45:46 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6877lb # [ 187.910894] niks3-server[1030]: 2026/09/20 12:45:46 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6878lb # [ 187.921924] niks3-server[1030]: 2026/09/20 12:45:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6879lb # [ 187.926838] niks3-server[1030]: 2026/09/20 12:45:46 INFO Signed narinfos id=65 count=16880worker2 # [ 187.946045] nix-grpc-daemon[1769]: time=2026-09-20T12:45:46.213Z level=INFO msg="Uploading 1 narinfos"6881lb # [ 187.931268] niks3-server[1030]: 2026/09/20 12:45:46 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6882lb # [ 187.942418] niks3-server[1030]: 2026/09/20 12:45:46 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6883lb # [ 187.947677] niks3-server[1030]: 2026/09/20 12:45:46 INFO Completed upload id=656884worker2 # [ 187.964585] nix-grpc-daemon[1769]: time=2026-09-20T12:45:46.232Z level=INFO msg="Upload complete. (228ms)"6885lb # [ 187.949388] niks3-server[1030]: 2026/09/20 12:45:46 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6886worker2 # [ 187.968419] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54176 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=16887worker1 # [ 187.948200] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:46Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06888worker2 # [ 187.980711] nix-daemon[857]: reaped child process 1792, status = succeeded6889worker1 # [ 187.952284] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:46Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16890worker2 # [ 188.021765] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541766891worker2 # [ 188.037513] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541766892worker2 # [ 188.050259] nix-grpc-daemon[1769]: time=2026-09-20T12:45:46.317Z level=INFO msg="All 1 paths already cached"6893client # copying 1 paths to 'lb:50051'...6894client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6895worker2 # [ 188.057229] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:541766896worker2 # [ 188.065515] nix-daemon[857]: accepted connection from pid 1713, user nix-grpc-daemon (trusted)6897worker2 # [ 188.231448] nix-daemon[857]: accepted connection from pid 1816, user nix-grpc-daemon (trusted)6898worker2 # [ 188.245485] nix-daemon[857]: reaped child process 1819, status = succeeded6899worker2 # [ 188.409311] nix-daemon[857]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)6900worker2 # [ 188.422033] nix-daemon[857]: reaped child process 1824, status = succeeded6901lb # [ 188.419069] niks3-server[1030]: 2026/09/20 12:45:46 INFO Received uploads request method=POST path=/api/pending_closures6902worker2 # [ 188.440662] nix-grpc-daemon[1769]: time=2026-09-20T12:45:46.708Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6903worker2 # [ 188.442210] nix-grpc-daemon[1769]: time=2026-09-20T12:45:46.709Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6904lb # [ 188.437075] niks3-server[1030]: 2026/09/20 12:45:46 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6905lb # [ 188.440438] niks3-server[1030]: 2026/09/20 12:45:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6906lb # [ 188.443123] niks3-server[1030]: 2026/09/20 12:45:46 INFO Signed narinfos id=66 count=16907worker2 # [ 188.460149] nix-grpc-daemon[1769]: time=2026-09-20T12:45:46.727Z level=INFO msg="Uploading 1 narinfos"6908lb # [ 188.444939] niks3-server[1030]: 2026/09/20 12:45:46 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6909lb # [ 188.450173] niks3-server[1030]: 2026/09/20 12:45:46 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6910lb # [ 188.460223] niks3-server[1030]: 2026/09/20 12:45:46 INFO Completed upload id=666911worker2 # [ 188.478578] nix-grpc-daemon[1769]: time=2026-09-20T12:45:46.746Z level=INFO msg="Upload complete. (399ms)"6912lb # [ 188.462989] niks3-server[1030]: 2026/09/20 12:45:46 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6913worker2 # [ 188.481032] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54176 duration_s=0 paths=1 nar_bytes_in=6246914worker2 # [ 188.484654] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541766915worker2 # [ 188.490322] nix-daemon[857]: accepted connection from pid 1713, user nix-grpc-daemon (trusted)6916worker2 # [ 188.497154] nix-daemon[857]: reaped child process 1814, status = succeeded6917worker2 # [ 188.500447] nix-daemon[857]: accepted connection from pid 1713, user nix-grpc-daemon (trusted)6918client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6919client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6920client # farm-b> LOG-farm-b-drain6921worker2 # [ 189.916612] nix-daemon[857]: reaped child process 1828, status = succeeded6922worker2 # [ 190.034918] nix-daemon[857]: accepted connection from pid 1843, user nix-grpc-daemon (trusted)6923worker2 # [ 190.047640] nix-daemon[857]: reaped child process 1846, status = succeeded6924lb # [ 190.045279] niks3-server[1030]: 2026/09/20 12:45:48 INFO Received uploads request method=POST path=/api/pending_closures6925worker2 # [ 190.066352] nix-grpc-daemon[1769]: time=2026-09-20T12:45:48.333Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6926worker2 # [ 190.067849] nix-grpc-daemon[1769]: time=2026-09-20T12:45:48.335Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6927lb # [ 190.063574] niks3-server[1030]: 2026/09/20 12:45:48 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6928lb # [ 190.065618] niks3-server[1030]: 2026/09/20 12:45:48 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6929lb # [ 190.070478] niks3-server[1030]: 2026/09/20 12:45:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6930lb # [ 190.072052] niks3-server[1030]: 2026/09/20 12:45:48 INFO Signed narinfos id=67 count=16931worker2 # [ 190.090356] nix-grpc-daemon[1769]: time=2026-09-20T12:45:48.357Z level=INFO msg="Uploading 1 narinfos"6932lb # [ 190.076149] niks3-server[1030]: 2026/09/20 12:45:48 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6933lb # [ 190.080190] niks3-server[1030]: 2026/09/20 12:45:48 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6934lb # [ 190.082847] niks3-server[1030]: 2026/09/20 12:45:48 INFO Completed upload id=676935worker2 # [ 190.099712] nix-grpc-daemon[1769]: time=2026-09-20T12:45:48.367Z level=INFO msg="Upload complete. (192ms)"6936lb # [ 190.085529] niks3-server[1030]: 2026/09/20 12:45:48 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6937worker2 # [ 190.103076] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54176 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=16938worker2 # [ 190.108686] nix-daemon[857]: reaped child process 1826, status = succeeded6939worker1 # [ 190.084738] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:48Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06940worker1 # [ 190.088882] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:48Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16941worker2 # [ 190.156534] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541766942worker2 # [ 190.167837] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541766943worker2 # [ 190.180159] nix-grpc-daemon[1769]: time=2026-09-20T12:45:48.447Z level=INFO msg="All 2 paths already cached"6944client # copying 1 paths to 'lb:50051'...6945client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6946worker2 # [ 190.187949] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:541766947worker2 # [ 190.199144] nix-daemon[857]: accepted connection from pid 1713, user nix-grpc-daemon (trusted)6948worker2 # [ 190.358586] nix-daemon[857]: accepted connection from pid 1850, user nix-grpc-daemon (trusted)6949worker2 # [ 190.371630] nix-daemon[857]: reaped child process 1853, status = succeeded6950worker2 # [ 190.526234] nix-daemon[857]: accepted connection from pid 1855, user nix-grpc-daemon (trusted)6951worker2 # [ 190.538677] nix-daemon[857]: reaped child process 1858, status = succeeded6952lb # [ 190.535477] niks3-server[1030]: 2026/09/20 12:45:48 INFO Received uploads request method=POST path=/api/pending_closures6953worker2 # [ 190.556886] nix-grpc-daemon[1769]: time=2026-09-20T12:45:48.824Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6954worker2 # [ 190.558739] nix-grpc-daemon[1769]: time=2026-09-20T12:45:48.825Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6955lb # [ 190.552413] niks3-server[1030]: 2026/09/20 12:45:48 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6956lb # [ 190.558170] niks3-server[1030]: 2026/09/20 12:45:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6957lb # [ 190.561887] niks3-server[1030]: 2026/09/20 12:45:48 INFO Signed narinfos id=68 count=16958worker2 # [ 190.581158] nix-grpc-daemon[1769]: time=2026-09-20T12:45:48.848Z level=INFO msg="Uploading 1 narinfos"6959lb # [ 190.569103] niks3-server[1030]: 2026/09/20 12:45:48 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6960lb # [ 190.573042] niks3-server[1030]: 2026/09/20 12:45:48 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6961lb # [ 190.575671] niks3-server[1030]: 2026/09/20 12:45:48 INFO Completed upload id=686962worker2 # [ 190.592434] nix-grpc-daemon[1769]: time=2026-09-20T12:45:48.859Z level=INFO msg="Upload complete. (382ms)"6963worker2 # [ 190.594359] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54176 duration_s=0 paths=1 nar_bytes_in=7526964lb # [ 190.578296] niks3-server[1030]: 2026/09/20 12:45:48 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6965worker2 # [ 190.597616] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541766966worker2 # [ 190.602283] nix-daemon[857]: accepted connection from pid 1713, user nix-grpc-daemon (trusted)6967worker2 # [ 190.608129] nix-daemon[857]: reaped child process 1848, status = succeeded6968client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6969client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6970worker2 # [ 190.611172] nix-daemon[857]: accepted connection from pid 1713, user nix-grpc-daemon (trusted)6971client # farm-top> LOG-farm-top-drain6972worker2 # [ 191.625712] nix-daemon[857]: reaped child process 1862, status = succeeded6973worker2 # [ 191.765305] nix-daemon[857]: accepted connection from pid 1877, user nix-grpc-daemon (trusted)6974worker2 # [ 191.778903] nix-daemon[857]: reaped child process 1880, status = succeeded6975lb # [ 191.773626] niks3-server[1030]: 2026/09/20 12:45:50 INFO Received uploads request method=POST path=/api/pending_closures6976worker2 # [ 191.794703] nix-grpc-daemon[1769]: time=2026-09-20T12:45:50.062Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6977worker2 # [ 191.796211] nix-grpc-daemon[1769]: time=2026-09-20T12:45:50.063Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6978lb # [ 191.804707] niks3-server[1030]: 2026/09/20 12:45:50 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6979lb # [ 191.819373] niks3-server[1030]: 2026/09/20 12:45:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6980worker2 # [ 191.842247] nix-grpc-daemon[1769]: time=2026-09-20T12:45:50.109Z level=INFO msg="Uploading 1 narinfos"6981lb # [ 191.825092] niks3-server[1030]: 2026/09/20 12:45:50 INFO Signed narinfos id=69 count=16982lb # [ 191.829978] niks3-server[1030]: 2026/09/20 12:45:50 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6983lb # [ 191.838593] niks3-server[1030]: 2026/09/20 12:45:50 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6984lb # [ 191.845953] niks3-server[1030]: 2026/09/20 12:45:50 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6985lb # [ 191.848719] niks3-server[1030]: 2026/09/20 12:45:50 INFO Completed upload id=696986worker2 # [ 191.865845] nix-grpc-daemon[1769]: time=2026-09-20T12:45:50.133Z level=INFO msg="Upload complete. (248ms)"6987lb # [ 191.850980] niks3-server[1030]: 2026/09/20 12:45:50 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6988worker2 # [ 191.872493] nix-grpc-daemon[1713]: ts=2026-09-20T12:45:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54176 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=16989worker2 # [ 191.884476] nix-daemon[857]: reaped child process 1860, status = succeeded6990client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 6.55 seconds)6991client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath6992client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.16 seconds)6993worker1: must succeed: rm /nix/.rw-store/fill6994worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.11 seconds)6995worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6996worker1 # [ 192.683251] nix-grpc-daemon[1472]: ts=2026-09-20T12:45:50Z level=info event=healthy reason=min_free6997worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.11 seconds)6998(finished: subtest: low disk drains a worker and builds go to the other, in 10.06 seconds)6999(finished: run the VM test script, in 194.24 seconds)7000test script finished in 194.84s7001cleanup7002kill QemuMachine (pid 49)7003client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)7004kill QemuMachine (pid 50)7005lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)7006kill QemuMachine (pid 51)7007worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)7008kill QemuMachine (pid 52)7009worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)7010(finished: cleanup, in 1.24 seconds)7011additionally exposed symbols:7012 client, lb, worker1, worker2,7013 vlan1,7014 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh